[Feature Request] Get the input count and the success/fail count of a node in a batch run by python code about promptflow HOT 4 CLOSED

hi @CodeFree-xzk , thanks for your feedback! currently, we have not exposed such API to get the node or line level information; but these informations are already stored locally, so it's possible to collect them from the disk - let me briefly introduce that:

1. for each run, you can get its output path from run object; by default, it's a path under ~/.promptflow/.runs, named with its run name, and you can get its precise value via CLI command pf run show --name <run>

2. navigate to that folder, there will be two folders node_artifacts and flow_artifacts, which contains the informations about nodes and lines. there are same numbers of JSON files as the lines, each one corresponds to a line, and you can get what you expect (status, output and something else) from those files.
3. then it's your turn to collect what you need and transform them with your magic!

besides, we are working on some new features related to line level metrics with telemetry, which will expose some APIs to retrieve something related to your ask; but I cannot get you a precise timeline for now.

please take a look on the collection from run local storage first, and feel free to let me know if that does not work fine with your case, and I can explain more on what we are doing.

from promptflow.

Thank you for your suggestion! However, if I run the flow in web UI, where can I find the output file?

from promptflow.

Thank you for your suggestion! However, if I run the flow in web UI, where can I find the output file?

oh, I didn't realize we are talking about the runs in Azure - sorry about that.

for runs in Azure, those artifacts are persisted in Azure blob storage, which can be a little bit difficult to traverse, however, we have a feature that enable you to download all the artifacts from Azure to local, after that, you can do what I suggested above; you can refer to this doc: pfazure run download for more detail.

from promptflow.

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!

from promptflow.