Skip to content

Commit 1c361e0

Browse files
Benedikt Volkelsawenzel
authored andcommitted
Add metrics evaluation for o2dpg_sim_workflow
* added new utility script o2dpg_sim_metrics.py * add meta such as cpu-limit or mem-limit information to pipeline_metrics
1 parent 863977c commit 1c361e0

File tree

2 files changed

+504
-0
lines changed

2 files changed

+504
-0
lines changed

MC/bin/o2_dpg_workflow_runner.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -73,6 +73,9 @@ def setup_logger(name, log_file, level=logging.INFO):
7373
# second file logger
7474
metriclogger = setup_logger('pipeline_metric_logger', ('pipeline_metric_' + str(os.getpid()) + '.log', args.action_logfile)[args.action_logfile!=None])
7575

76+
# Immediately log imposed memory and CPU limit as well as further useful meta info
77+
metriclogger.info({"cpu_limit": args.cpu_limit, "mem_limit": args.mem_limit, "workflow_file": os.path.abspath(args.workflowfile), "target_task": args.target_tasks, "rerun_from": args.rerun_from, "target_labels": args.target_labels})
78+
7679
# for debugging without terminal access
7780
# TODO: integrate into standard logger
7881
def send_webhook(hook, t):

0 commit comments

Comments
 (0)