ATDB-LDV

Task: 260550 (regular)

id (api)	260550
type	regular
slurm jobs (api)	jobs for task 260550 {'finished': 85}
priority	100
status	finished
workflow	29 - aggregated_compress_pipeline
inputs outputs metrics Quality
filter	if_comp_test
source location (inputs)
target location (processing)	srm.grid.sara.nl
project	lc17_013
activity (API) + status	843578, finished
specification (API)	-
creationTime	2024-10-18 07:35:55
purge_policy	no
cleanup_policy	defining
resume	True
is_summary	False
stage_request_id	26728
dataproducts	None
size_to_process	29.3 GB
size_processed	29.3 GB
total_processing_time	4488
quality	good
calculated qualities	{'per_task': ['good'], 'per_sasid': 'good'}
remarks	None

Log Entries

service	step	status	timestamp	cpu_cycles	wall_clock_time	log
ARCHIVER	Success	finished	10-31-2024, 11:27:52	None	13916
ARCHIVER	cleaning	finishing	10-31-2024, 11:27:33	None	13897
ARCHIVER	Success	archived	10-31-2024, 11:27:32	None	13896
ARCHIVER	ingested	archiving	10-31-2024, 11:26:36	None	13840
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:53:05	None	33429	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:52:33	None	33397	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:52:03	None	33367	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:51:33	None	33337	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:51:03	None	33307	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:50:33	None	33277	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:50:02	None	33246	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:49:32	None	33216	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:49:02	None	33186	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:48:31	None	33155	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:47:58	None	33122	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:47:01	None	33065	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:46:29	None	33033	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:45:58	None	33002	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:45:27	None	32971	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:44:55	None	32939	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:44:25	None	32909	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:43:52	None	32876	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:43:21	None	32845	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:42:49	None	32813	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:42:18	None	32782	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:41:46	None	32750	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:41:15	None	32719	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:40:45	None	32689	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:40:13	None	32657	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:39:42	None	32626	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:39:11	None	32595	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:38:39	None	32563	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:38:09	None	32533	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:37:38	None	32502	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:37:02	None	32466	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:36:30	None	32434	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:36:00	None	32404	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:35:29	None	32373	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:34:59	None	32343	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:34:27	None	32311	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:33:56	None	32280	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:33:23	None	32247	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:32:53	None	32217	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:32:23	None	32187	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:31:53	None	32157	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:31:22	None	32126	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:30:50	None	32094	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:30:20	None	32064	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:29:50	None	32034	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:29:20	None	32004	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:28:50	None	31974	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:28:18	None	31942	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:27:47	None	31911	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:27:17	None	31881	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:26:46	None	31850	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:26:14	None	31818	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:25:43	None	31787	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:25:12	None	31756	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:24:39	None	31723	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:24:08	None	31692	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:23:37	None	31661	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:23:06	None	31630	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:22:34	None	31598	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:22:04	None	31568	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:21:33	None	31537	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:21:01	None	31505	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:20:30	None	31474	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:19:59	None	31443	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:19:28	None	31412	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:18:57	None	31381	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:18:28	None	31352	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:17:51	None	31315	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:16:57	None	31261	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:16:26	None	31230	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:15:53	None	31197	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:15:23	None	31167	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:14:53	None	31137	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:14:22	None	31106	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:13:50	None	31074	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:13:20	None	31044	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:12:50	None	31014	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:12:19	None	30983	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:11:47	None	30951	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:11:16	None	30920	cannot marshal None unless allow_none is enabled
ARCHIVER	update_final_archiving	archived_failed	10-29-2024, 16:10:45	None	30889	cannot marshal None unless allow_none is enabled
ARCHIVER	submitting	archiving	10-29-2024, 16:05:32	None	30576
ARCHIVER	submitting	archiving	10-29-2024, 16:05:31	None	30575
ARCHIVER	submitting	archiving	10-29-2024, 16:05:30	None	30574
ARCHIVER	submitting	archiving	10-29-2024, 16:05:29	None	30573
ARCHIVER	submitting	archiving	10-29-2024, 16:05:29	None	30573
ARCHIVER	submitting	archiving	10-29-2024, 16:05:28	None	30572
ARCHIVER	submitting	archiving	10-29-2024, 16:05:27	None	30571
ARCHIVER	submitting	archiving	10-29-2024, 16:05:26	None	30570
ARCHIVER	submitting	archiving	10-29-2024, 16:05:25	None	30569
ARCHIVER	submitting	archiving	10-29-2024, 16:05:24	None	30568
ARCHIVER	submitting	archiving	10-29-2024, 16:05:23	None	30567
ARCHIVER	submitting	archiving	10-29-2024, 16:05:22	None	30566
ARCHIVER	submitting	archiving	10-29-2024, 16:05:21	None	30565
ARCHIVER	submitting	archiving	10-29-2024, 16:05:21	None	30565
ARCHIVER	submitting	archiving	10-29-2024, 16:05:20	None	30564
ARCHIVER	submitting	archiving	10-29-2024, 16:05:19	None	30563
ARCHIVER	submitting	archiving	10-29-2024, 16:05:18	None	30562
ARCHIVER	submitting	archiving	10-29-2024, 16:05:18	None	30562
ARCHIVER	submitting	archiving	10-29-2024, 16:05:17	None	30561
ARCHIVER	submitting	archiving	10-29-2024, 16:05:16	None	30560
ARCHIVER	submitting	archiving	10-29-2024, 16:05:15	None	30559
ARCHIVER	submitting	archiving	10-29-2024, 16:05:14	None	30558
ARCHIVER	submitting	archiving	10-29-2024, 16:05:14	None	30558
ARCHIVER	submitting	archiving	10-29-2024, 16:05:13	None	30557
ARCHIVER	submitting	archiving	10-29-2024, 16:05:12	None	30556
ARCHIVER	submitting	archiving	10-29-2024, 16:05:11	None	30555
ARCHIVER	submitting	archiving	10-29-2024, 16:05:10	None	30554
ARCHIVER	submitting	archiving	10-29-2024, 16:05:10	None	30554
ARCHIVER	submitting	archiving	10-29-2024, 16:05:09	None	30553
ARCHIVER	submitting	archiving	10-29-2024, 16:05:08	None	30552
ARCHIVER	submitting	archiving	10-29-2024, 16:05:07	None	30551
ARCHIVER	submitting	archiving	10-29-2024, 16:05:06	None	30550
ARCHIVER	submitting	archiving	10-29-2024, 16:05:05	None	30549
ARCHIVER	submitting	archiving	10-29-2024, 16:05:05	None	30549
ARCHIVER	submitting	archiving	10-29-2024, 16:05:04	None	30548
ARCHIVER	submitting	archiving	10-29-2024, 16:05:03	None	30547
ARCHIVER	submitting	archiving	10-29-2024, 16:05:02	None	30546
ARCHIVER	submitting	archiving	10-29-2024, 16:05:01	None	30545
ARCHIVER	submitting	archiving	10-29-2024, 16:05:01	None	30545
ARCHIVER	submitting	archiving	10-29-2024, 16:05:00	None	30544
ARCHIVER	submitting	archiving	10-29-2024, 16:04:59	None	30543
ARCHIVER	submitting	archiving	10-29-2024, 16:04:58	None	30542
ARCHIVER	submitting	archiving	10-29-2024, 16:04:58	None	30542
ARCHIVER	submitting	archiving	10-29-2024, 16:04:57	None	30541
ARCHIVER	submitting	archiving	10-29-2024, 16:04:56	None	30540
ARCHIVER	submitting	archiving	10-29-2024, 16:04:55	None	30539
ARCHIVER	submitting	archiving	10-29-2024, 16:04:54	None	30538
ARCHIVER	submitting	archiving	10-29-2024, 16:04:54	None	30538
ARCHIVER	submitting	archiving	10-29-2024, 16:04:53	None	30537
ARCHIVER	submitting	archiving	10-29-2024, 16:04:52	None	30536
ARCHIVER	submitting	archiving	10-29-2024, 16:04:51	None	30535
ARCHIVER	submitting	archiving	10-29-2024, 16:04:51	None	30535
ARCHIVER	submitting	archiving	10-29-2024, 16:04:50	None	30534
ARCHIVER	submitting	archiving	10-29-2024, 16:04:49	None	30533
ARCHIVER	submitting	archiving	10-29-2024, 16:04:48	None	30532
ARCHIVER	submitting	archiving	10-29-2024, 16:04:47	None	30531
ARCHIVER	submitting	archiving	10-29-2024, 16:04:47	None	30531
ARCHIVER	submitting	archiving	10-29-2024, 16:04:46	None	30530
ARCHIVER	submitting	archiving	10-29-2024, 16:04:45	None	30529
ARCHIVER	submitting	archiving	10-29-2024, 16:04:44	None	30528
ARCHIVER	submitting	archiving	10-29-2024, 16:04:43	None	30527
ARCHIVER	submitting	archiving	10-29-2024, 16:04:42	None	30526
ARCHIVER	submitting	archiving	10-29-2024, 16:04:41	None	30525
ARCHIVER	submitting	archiving	10-29-2024, 16:04:40	None	30524
ARCHIVER	submitting	archiving	10-29-2024, 16:04:39	None	30523
ARCHIVER	submitting	archiving	10-29-2024, 16:04:38	None	30522
ARCHIVER	submitting	archiving	10-29-2024, 16:04:37	None	30521
ARCHIVER	submitting	archiving	10-29-2024, 16:04:36	None	30520
ARCHIVER	submitting	archiving	10-29-2024, 16:04:35	None	30519
ARCHIVER	submitting	archiving	10-29-2024, 16:04:35	None	30519
ARCHIVER	submitting	archiving	10-29-2024, 16:04:34	None	30518
ARCHIVER	submitting	archiving	10-29-2024, 16:04:33	None	30517
ARCHIVER	submitting	archiving	10-29-2024, 16:04:32	None	30516
ARCHIVER	submitting	archiving	10-29-2024, 16:04:31	None	30515
ARCHIVER	submitting	archiving	10-29-2024, 16:04:31	None	30515
ARCHIVER	submitting	archiving	10-29-2024, 16:04:30	None	30514
ARCHIVER	submitting	archiving	10-29-2024, 16:04:29	None	30513
ARCHIVER	submitting	archiving	10-29-2024, 16:04:28	None	30512
ARCHIVER	submitting	archiving	10-29-2024, 16:04:27	None	30511
ARCHIVER	submitting	archiving	10-29-2024, 16:04:26	None	30510
ARCHIVER	submitting	archiving	10-29-2024, 16:04:25	None	30509
PREARCHIVER	SIP created	pre_archived	10-29-2024, 15:28:23	None	28347
PREARCHIVER	submitting	pre_archiving	10-29-2024, 15:15:12	None	27556
STAGER	STAGER	scrubbed	10-29-2024, 14:45:37	None	25781	None
STAGER	STAGER	scrubbing	10-29-2024, 14:45:36	None	25780	None
DATAMANAGER	copy_finished	stored	10-18-2024, 08:06:23	None	1827
DATAMANAGER	copy_issued	storing	10-18-2024, 08:06:04	None	1808
DATAMANAGER	issuing_copying	storing	10-18-2024, 08:04:32	None	1716
AGGREGATOR	collected H5	processed	10-18-2024, 08:04:12	None	1696
AGGREGATOR	collect_h5	aggregating	10-18-2024, 08:04:11	None	1695
EXECUTOR	running	processed	10-18-2024, 08:04:07	None	4488	None
EXECUTOR	running	processing	10-18-2024, 07:54:43	None	1127	logfile
DATAMANAGER	copy_skipped	fetched	10-18-2024, 07:54:22	None	1106
STAGER	STAGER	staged	10-18-2024, 07:54:15	None	1099	None
STAGER	STAGER	staging	10-18-2024, 07:51:42	None	946	None