path downstream about astronomer-cosmos HOT 3 CLOSED

🤖

Hello @Lee2532,

I'm Dosu, a friendly bot here to assist you with your Cosmos repository questions and issues. I can help you troubleshoot bugs, answer queries, and guide you to become a contributor while you're waiting for a human maintainer. Looking forward to working together!

The issue you're experiencing might be due to the way the paths are set in the ProjectConfig class in Cosmos. In this class, the models_path, seeds_path, and snapshots_path are set relative to the dbt_project_path. If the dbt_project_path is not correctly set or if the relative paths are not correctly defined, Cosmos might not be able to find the models or snapshots, leading to issues with the downstream configuration.

Here is the relevant code from the ProjectConfig class:

class ProjectConfig:
    ...
    def __init__(
        self,
        dbt_project_path: str | Path | None = None,
        models_relative_path: str | Path = "models",
        seeds_relative_path: str | Path = "seeds",
        snapshots_relative_path: str | Path = "snapshots",
        manifest_path: str | Path | None = None,
        project_name: str | None = None,
    ):
        ...
        if dbt_project_path:
            self.dbt_project_path = Path(dbt_project_path)
            self.models_path = self.dbt_project_path / Path(models_relative_path)
            self.seeds_path = self.dbt_project_path / Path(seeds_relative_path)
            self.snapshots_path = self.dbt_project_path / Path(snapshots_relative_path)
            ...

Please ensure that the dbt_project_path is correctly set and that the relative paths for the models, seeds, and snapshots directories are correctly defined. If these paths are not correctly set, Cosmos might not be able to find the models or snapshots, leading to issues with the downstream configuration.

You can find this code in the cosmos/config.py file.

If you're still having issues after checking these paths, could you provide more information about the error messages you're seeing or the behavior you're experiencing? This could help in diagnosing the issue.

Sources

• cosmos/config.py

This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

If you want to continue the conversation, start your reply with @dosu-bot.

from astronomer-cosmos.

@Lee2532 did you consider using path selectors, as described in https://astronomer.github.io/astronomer-cosmos/configuration/selecting-excluding.html?

from astronomer-cosmos.

it works Thanks

from astronomer-cosmos.