id (api) | 260226 |
type | regular |
slurm jobs (api) | jobs for task 260226 {} |
priority | 100 |
status | discarded |
workflow | 29 - aggregated_compress_pipeline |
inputs outputs metrics Quality | |
filter | ldv-spec:2093 |
source location (inputs) | |
target location (processing) | srm.grid.sara.nl |
project | com_lba_sparse |
activity (API) + status | 800548, reset |
specification (API) | - |
creationTime | 2024-09-27 08:00:47 |
purge_policy | no |
cleanup_policy | stored |
resume | True |
is_summary | False |
stage_request_id | 26392 |
dataproducts | None |
size_to_process | 242.7 MB |
size_processed | 242.9 MB |
total_processing_time | 238 |
quality | None |
calculated qualities | {'per_task': ['good'], 'per_sasid': 'moderate'} |
remarks | {'discard_reason': 'Cleanup action of tasks used for QA tests'} |
service | step | status | timestamp | cpu_cycles | wall_clock_time | log |
---|---|---|---|---|---|---|
CLEANUP | dcache | discarded | 02-27-2025, 08:41:03 | None | 2415 | |
CLEANUP | dcache | discarding | 02-27-2025, 08:41:01 | None | 2413 | |
CLEANUP | spider | cleaned_spider | 02-27-2025, 08:40:31 | None | 2383 | |
CLEANUP | spider | discarding | 02-27-2025, 08:40:29 | None | 2381 | |
DATAMANAGER | copy_finished | stored | 09-27-2024, 15:34:23 | None | 27215 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 15:33:48 | None | 27180 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 15:33:38 | None | 27170 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 15:33:19 | None | 27151 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 15:33:18 | None | 27150 | |
EXECUTOR | running | processed | 09-27-2024, 15:33:08 | None | 238 | None |
EXECUTOR | running | processing | 09-27-2024, 15:29:00 | None | 26892 | logfile |
DATAMANAGER | copy_finished | stored | 09-27-2024, 15:15:21 | None | 26073 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 15:14:48 | None | 26040 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 15:14:38 | None | 26030 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 15:14:37 | None | 26029 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 15:14:36 | None | 26028 | |
EXECUTOR | running | processed | 09-27-2024, 15:14:15 | None | 225 | None |
EXECUTOR | running | processing | 09-27-2024, 15:10:07 | None | 25759 | logfile |
DATAMANAGER | copy_finished | stored | 09-27-2024, 14:50:01 | None | 24553 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 14:49:26 | None | 24518 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 14:49:17 | None | 24509 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 14:49:16 | None | 24508 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 14:49:15 | None | 24507 | |
EXECUTOR | running | processed | 09-27-2024, 14:48:52 | None | 192 | None |
EXECUTOR | running | processing | 09-27-2024, 14:45:15 | None | 24267 | logfile |
DATAMANAGER | copy_finished | stored | 09-27-2024, 13:48:48 | None | 20880 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 13:48:14 | None | 20846 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 13:48:04 | None | 20836 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 13:47:40 | None | 20812 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 13:47:39 | None | 20811 | |
EXECUTOR | running | processed | 09-27-2024, 13:47:30 | None | 150 | None |
EXECUTOR | running | processing | 09-27-2024, 13:44:55 | None | 20647 | logfile |
DATAMANAGER | copy_finished | stored | 09-27-2024, 12:33:55 | None | 16387 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 12:33:21 | None | 16353 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 12:33:13 | None | 16345 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 12:32:58 | None | 16330 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 12:32:57 | None | 16329 | |
EXECUTOR | running | processed | 09-27-2024, 12:32:35 | None | 167 | None |
EXECUTOR | running | processing | 09-27-2024, 12:29:30 | None | 16122 | logfile |
DATAMANAGER | copy_finished | stored | 09-27-2024, 12:20:32 | None | 15584 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 12:19:58 | None | 15550 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 12:19:50 | None | 15542 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 12:19:49 | None | 15541 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 12:19:49 | None | 15541 | |
EXECUTOR | running | processed | 09-27-2024, 12:19:21 | None | 159 | None |
EXECUTOR | running | processing | 09-27-2024, 12:16:23 | None | 15335 | logfile |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 12:15:00 | None | 15252 | |
DATAMANAGER | submission | storing_failed | 09-27-2024, 12:15:00 | None | 15252 | Missing file 260226: {'size': 95512, 'surl': 'srm://srm.grid.sara.nl/pnfs/grid.sara.nl/data/lofar/ops/disk/ldv/com_lba_sparse/800548/260226/inspect.h5', 'class': 'File', 'nameext': '.h5', 'basename': 'inspect.h5', 'checksum': 'sha1$73c270f0204fd14ca8 |
DATAMANAGER | copy_finished | stored | 09-27-2024, 12:01:48 | None | 14460 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 12:01:46 | None | 14458 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 12:01:37 | None | 14449 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 12:01:30 | None | 14442 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 12:01:29 | None | 14441 | |
EXECUTOR | running | processed | 09-27-2024, 12:01:09 | None | 147 | None |
EXECUTOR | running | processing | 09-27-2024, 11:58:34 | None | 14266 | logfile |
DATAMANAGER | copy_finished | stored | 09-27-2024, 08:11:59 | None | 671 | |
DATAMANAGER | copy_issued | storing | 09-27-2024, 08:11:25 | None | 637 | |
DATAMANAGER | issuing_copying | storing | 09-27-2024, 08:11:17 | None | 629 | |
AGGREGATOR | collected H5 | processed | 09-27-2024, 08:10:51 | None | 603 | |
AGGREGATOR | collect_h5 | aggregating | 09-27-2024, 08:10:50 | None | 602 | |
EXECUTOR | running | processed | 09-27-2024, 08:10:37 | None | 335 | None |
EXECUTOR | running | processing | 09-27-2024, 08:02:50 | None | 122 | logfile |
DATAMANAGER | copy_skipped | fetched | 09-27-2024, 08:02:08 | None | 80 | |
STAGER | STAGER | staged | 09-27-2024, 08:01:59 | None | 71 | None |
STAGER | STAGER | staging | 09-27-2024, 08:01:26 | None | 38 | None |