ATDB-LDV

Task: 260549 (regular)

id (api)	260549
type	regular
slurm jobs (api)	jobs for task 260549 {'finished': 85}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	if_comp_test
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lc17_013
activity (API) + status	843578, finished
specification (API)	-
creationTime	2024-10-18 07:35:55
purge_policy	no
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	26727
dataproducts	None
size_to_process	29.3 GB
size_processed	29.3 GB
total_processing_time	3520
quality	good
calculated qualities	{'per_task': ['good'], 'per_sasid': 'good'}
remarks	None

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	10-31-2024, 09:56:41	None	8445
ARCHIVER	cleaning	finishing	10-31-2024, 09:56:21	None	8425
ARCHIVER	Success	archived	10-31-2024, 09:56:20	None	8424
ARCHIVER	ingested	archiving	10-31-2024, 09:56:05	None	8409
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:03:39	None	30463	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:03:07	None	30431	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:02:37	None	30401	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:02:07	None	30371	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:01:37	None	30341	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:01:07	None	30311	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:00:37	None	30281	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:00:06	None	30250	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:59:35	None	30219	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:59:03	None	30187	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:58:33	None	30157	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:58:03	None	30127	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:57:32	None	30096	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:57:01	None	30065	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:56:30	None	30034	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:55:59	None	30003	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:55:29	None	29973	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:54:57	None	29941	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:54:25	None	29909	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:53:54	None	29878	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:53:23	None	29847	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:52:52	None	29816	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:52:20	None	29784	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:51:50	None	29754	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:51:18	None	29722	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:50:47	None	29691	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:50:17	None	29661	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:49:46	None	29630	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:49:14	None	29598	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:48:43	None	29567	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:48:12	None	29536	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:47:19	None	29483	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:46:42	None	29446	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:46:10	None	29414	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:45:40	None	29384	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:45:10	None	29354	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:44:39	None	29323	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:44:07	None	29291	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:43:35	None	29259	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:43:03	None	29227	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:42:34	None	29198	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:42:03	None	29167	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:41:32	None	29136	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:41:00	None	29104	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:40:30	None	29074	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:40:00	None	29044	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:39:30	None	29014	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:38:59	None	28983	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:38:27	None	28951	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:37:56	None	28920	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:37:23	None	28887	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:36:53	None	28857	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:36:20	None	28824	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:35:50	None	28794	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:35:17	None	28761	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:34:47	None	28731	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:34:18	None	28702	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:33:47	None	28671	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:33:16	None	28640	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:32:44	None	28608	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:32:14	None	28578	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:31:43	None	28547	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:31:11	None	28515	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:30:40	None	28484	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:30:09	None	28453	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:29:38	None	28422	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:29:07	None	28391	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:28:36	None	28360	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:28:04	None	28328	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:27:35	None	28299	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:27:04	None	28268	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:26:33	None	28237	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:26:01	None	28205	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:25:31	None	28175	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:25:00	None	28144	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:24:28	None	28112	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:23:57	None	28081	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:23:21	None	28045	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:22:45	None	28009	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:22:09	None	27973	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 15:21:33	None	27937	cannot marshal None unless allow_none is enabled
ARCHIVER	submitting	archiving	10-29-2024, 15:16:03	None	27607
ARCHIVER	submitting	archiving	10-29-2024, 15:16:02	None	27606
ARCHIVER	submitting	archiving	10-29-2024, 15:16:01	None	27605
ARCHIVER	submitting	archiving	10-29-2024, 15:16:00	None	27604
ARCHIVER	submitting	archiving	10-29-2024, 15:15:59	None	27603
ARCHIVER	submitting	archiving	10-29-2024, 15:15:59	None	27603
ARCHIVER	submitting	archiving	10-29-2024, 15:15:58	None	27602
ARCHIVER	submitting	archiving	10-29-2024, 15:15:56	None	27600
ARCHIVER	submitting	archiving	10-29-2024, 15:15:55	None	27599
ARCHIVER	submitting	archiving	10-29-2024, 15:15:54	None	27598
ARCHIVER	submitting	archiving	10-29-2024, 15:15:53	None	27597
ARCHIVER	submitting	archiving	10-29-2024, 15:15:52	None	27596
ARCHIVER	submitting	archiving	10-29-2024, 15:15:51	None	27595
ARCHIVER	submitting	archiving	10-29-2024, 15:15:50	None	27594
ARCHIVER	submitting	archiving	10-29-2024, 15:15:50	None	27594
ARCHIVER	submitting	archiving	10-29-2024, 15:15:49	None	27593
ARCHIVER	submitting	archiving	10-29-2024, 15:15:48	None	27592
ARCHIVER	submitting	archiving	10-29-2024, 15:15:47	None	27591
ARCHIVER	submitting	archiving	10-29-2024, 15:15:46	None	27590
ARCHIVER	submitting	archiving	10-29-2024, 15:15:44	None	27588
ARCHIVER	submitting	archiving	10-29-2024, 15:15:43	None	27587
ARCHIVER	submitting	archiving	10-29-2024, 15:15:41	None	27585
ARCHIVER	submitting	archiving	10-29-2024, 15:15:40	None	27584
ARCHIVER	submitting	archiving	10-29-2024, 15:15:39	None	27583
ARCHIVER	submitting	archiving	10-29-2024, 15:15:39	None	27583
ARCHIVER	submitting	archiving	10-29-2024, 15:15:38	None	27582
ARCHIVER	submitting	archiving	10-29-2024, 15:15:37	None	27581
ARCHIVER	submitting	archiving	10-29-2024, 15:15:36	None	27580
ARCHIVER	submitting	archiving	10-29-2024, 15:15:35	None	27579
ARCHIVER	submitting	archiving	10-29-2024, 15:15:34	None	27578
ARCHIVER	submitting	archiving	10-29-2024, 15:15:33	None	27577
ARCHIVER	submitting	archiving	10-29-2024, 15:15:32	None	27576
ARCHIVER	submitting	archiving	10-29-2024, 15:15:31	None	27575
ARCHIVER	submitting	archiving	10-29-2024, 15:15:30	None	27574
ARCHIVER	submitting	archiving	10-29-2024, 15:15:28	None	27572
ARCHIVER	submitting	archiving	10-29-2024, 15:15:27	None	27571
ARCHIVER	submitting	archiving	10-29-2024, 15:15:26	None	27570
ARCHIVER	submitting	archiving	10-29-2024, 15:15:25	None	27569
ARCHIVER	submitting	archiving	10-29-2024, 15:15:24	None	27568
ARCHIVER	submitting	archiving	10-29-2024, 15:15:23	None	27567
ARCHIVER	submitting	archiving	10-29-2024, 15:15:22	None	27566
ARCHIVER	submitting	archiving	10-29-2024, 15:15:21	None	27565
ARCHIVER	submitting	archiving	10-29-2024, 15:15:19	None	27563
ARCHIVER	submitting	archiving	10-29-2024, 15:15:19	None	27563
ARCHIVER	submitting	archiving	10-29-2024, 15:15:18	None	27562
ARCHIVER	submitting	archiving	10-29-2024, 15:15:17	None	27561
ARCHIVER	submitting	archiving	10-29-2024, 15:15:16	None	27560
ARCHIVER	submitting	archiving	10-29-2024, 15:15:15	None	27559
ARCHIVER	submitting	archiving	10-29-2024, 15:15:14	None	27558
ARCHIVER	submitting	archiving	10-29-2024, 15:15:14	None	27558
ARCHIVER	submitting	archiving	10-29-2024, 15:15:12	None	27556
ARCHIVER	submitting	archiving	10-29-2024, 15:15:11	None	27555
ARCHIVER	submitting	archiving	10-29-2024, 15:15:10	None	27554
ARCHIVER	submitting	archiving	10-29-2024, 15:15:09	None	27553
ARCHIVER	submitting	archiving	10-29-2024, 15:15:09	None	27553
ARCHIVER	submitting	archiving	10-29-2024, 15:15:08	None	27552
ARCHIVER	submitting	archiving	10-29-2024, 15:15:07	None	27551
ARCHIVER	submitting	archiving	10-29-2024, 15:15:06	None	27550
ARCHIVER	submitting	archiving	10-29-2024, 15:15:06	None	27550
ARCHIVER	submitting	archiving	10-29-2024, 15:15:05	None	27549
ARCHIVER	submitting	archiving	10-29-2024, 15:15:04	None	27548
ARCHIVER	submitting	archiving	10-29-2024, 15:15:03	None	27547
ARCHIVER	submitting	archiving	10-29-2024, 15:15:02	None	27546
ARCHIVER	submitting	archiving	10-29-2024, 15:15:01	None	27545
ARCHIVER	submitting	archiving	10-29-2024, 15:15:00	None	27544
ARCHIVER	submitting	archiving	10-29-2024, 15:14:59	None	27543
ARCHIVER	submitting	archiving	10-29-2024, 15:14:58	None	27542
ARCHIVER	submitting	archiving	10-29-2024, 15:14:58	None	27542
ARCHIVER	submitting	archiving	10-29-2024, 15:14:57	None	27541
ARCHIVER	submitting	archiving	10-29-2024, 15:14:56	None	27540
ARCHIVER	submitting	archiving	10-29-2024, 15:14:55	None	27539
ARCHIVER	submitting	archiving	10-29-2024, 15:14:54	None	27538
ARCHIVER	submitting	archiving	10-29-2024, 15:14:53	None	27537
ARCHIVER	submitting	archiving	10-29-2024, 15:14:52	None	27536
ARCHIVER	submitting	archiving	10-29-2024, 15:14:52	None	27536
ARCHIVER	submitting	archiving	10-29-2024, 15:14:51	None	27535
ARCHIVER	submitting	archiving	10-29-2024, 15:14:50	None	27534
ARCHIVER	submitting	archiving	10-29-2024, 15:14:49	None	27533
ARCHIVER	submitting	archiving	10-29-2024, 15:14:48	None	27532
ARCHIVER	submitting	archiving	10-29-2024, 15:14:47	None	27531
ARCHIVER	submitting	archiving	10-29-2024, 15:14:46	None	27530
PREARCHIVER	SIP created	pre_archived	10-29-2024, 15:14:40	None	27524
PREARCHIVER	submitting	pre_archiving	10-29-2024, 14:45:47	None	25791
STAGER	STAGER	scrubbed	10-29-2024, 14:45:37	None	25781	None
STAGER	STAGER	scrubbing	10-29-2024, 14:45:35	None	25779	None
DATAMANAGER	copy_finished	stored	10-18-2024, 08:08:46	None	1970
DATAMANAGER	copy_issued	storing	10-18-2024, 08:08:27	None	1951
DATAMANAGER	issuing_copying	storing	10-18-2024, 08:06:54	None	1858
AGGREGATOR	collected H5	processed	10-18-2024, 08:05:44	None	1788
AGGREGATOR	collect_h5	aggregating	10-18-2024, 08:05:43	None	1787
EXECUTOR	running	processed	10-18-2024, 08:05:39	None	3520	None
EXECUTOR	running	processing	10-18-2024, 07:57:51	None	1315	logfile
DATAMANAGER	copy_skipped	fetched	10-18-2024, 07:57:25	None	1289
STAGER	STAGER	staged	10-18-2024, 07:57:18	None	1282	None
STAGER	STAGER	staging	10-18-2024, 07:51:41	None	945	None