[Q] What process is being tracked on a launch job? about wandb HOT 3 OPEN

Hi @mfung37! Apologies you are running into this behavior, could you please provide a link to your workspace where you are experiencing it?

Could you please also talk a bit about your experiment setup? Do you use any external libraries?

from wandb.

Here is the workspace. The latest run "breezy-elevator-8" was the run where I ran the sample-launch-job. You can see the cpu usage chart in the systems tab, which I let run for around 40 minutes.

I was running with the external library autogluon, an AutoML solution, that I was interested in running on weights and biases. For my run, I had ran sample code that autogluon had that was modified to work with weights and biases to be a launch job.

However, the tracking of the cpu usage didn't seem to match what I saw on my system of close to 100% cpu consistently. Therefore, I was wondering what/how things are being tracked, so I can see if maybe I modify the code to fit my needs or choose not to run autogluon.

from wandb.

Hi @mfung37! Apologies for the delay in reply. I went over our code base and found that we currently use the psutil library for capturing our CPU metrics. Here is our SDK code that captures currently running processes' CPU usage.

from wandb.