gcm.arrow_strength providing different ranking about dowhy HOT 6 CLOSED

The arrow strength has some sampling for estimation which leads to variations between runs. You can reduce this by changing some parameters like tolerance (to a smaller number).

Generally, if the rankings change that much between runs, it seems the connections are either equally strong or too weak in general (or the model simply isn't capturing them accurately enough). What is the range of the values?

You can also take a look at estimating confidence intervals, they might provide better insights:
https://www.pywhy.org/dowhy/v0.11.1/user_guide/modeling_gcm/estimating_confidence_intervals.html#conveniently-bootstrapping-graph-training-on-random-subsets-of-training-data

from dowhy.

Thanks for sharing the link and this is helpful.
Is there any recommendation in the library on the following?

1. If the causal graph structure is not very certain. The "auto" option takes care of causal mechanisms, but is there anything similar for graph too?
2. What are the recommendations to improve this if we get say following evaluation result?

The overall average KL divergence between the generated and observed distribution is 0.6444021604490836
The estimated KL divergence indicates a good representation of the data distribution, but might indicate some smaller mismatches between the distributions.

from dowhy.

This issue is stale because it has been open for 14 days with no activity.

from dowhy.

Sorry for the late reply!

1. If the causal graph structure is not very certain. The "auto" option takes care of causal mechanisms, but is there anything similar for graph too?

You can take a look at https://github.com/py-why/causal-learn, this is a package for inferring the causal graph based on data.

2. What are the recommendations to improve this if we get say following evaluation result?

You could try and set the parameter for the quality in the auto assignment function to BETTER (see the docstring of the function). Let me know if this improves the results (i.e., lower KL divergence). Otherwise, you might need to manually check which causal mechanisms can be improved. Maybe the performance results of nodes can give some insights.

from dowhy.

This issue is stale because it has been open for 14 days with no activity.

from dowhy.

This issue was closed because it has been inactive for 7 days since being marked as stale.

from dowhy.