Giter VIP home page Giter VIP logo

Comments (13)

belasobral93 avatar belasobral93 commented on May 30, 2024 2

from prefect-dbt.

belasobral93 avatar belasobral93 commented on May 30, 2024 1

from prefect-dbt.

sungchun12 avatar sungchun12 commented on May 30, 2024

To be assigned to Bela

from prefect-dbt.

sungchun12 avatar sungchun12 commented on May 30, 2024

@belasobral93

from prefect-dbt.

ahuang11 avatar ahuang11 commented on May 30, 2024

Hi, we were wondering if there's anything we can do to help add prefect-dbt to the docs?

from prefect-dbt.

sungchun12 avatar sungchun12 commented on May 30, 2024

@belasobral93 can you give input here?

from prefect-dbt.

belasobral93 avatar belasobral93 commented on May 30, 2024

@ahuang11 Hi there, can you validate for accuracy? (The formatting needs to be cleaned up, but I will ask our Docs team for their guidelines). Additionally I also am looking for a higher res version of the dag (image below) - can you help me find a copy?

Prefect

If your organization is using Prefect, the way you will run your jobs depends on the version you are on, and whether you are orchestrating dbt cloud or core jobs. A variety of options are described below.

- If you are using Prefect 2.0

For details on both of these methods, see prefect-dbt docs.

- If you are using Prefect 1.0

  • Invoking dbt cloud jobs
    - Trigger dbt Cloud jobs with the DbtCloudRunJob task. Running this task will generate a markdown artifact viewable in the Prefect UI. The artifact will contain links to the dbt artifacts generate as a result of the job run.
  • Invoking dbt through the cli
    • Use the DbtShellTask to schedule, execute and monitor your dbt runs.
    • Use the supported ShellTask to execute dbt commands through the shell.

dbt_and_prefect_ui
image

from prefect-dbt.

belasobral93 avatar belasobral93 commented on May 30, 2024

@ahuang11 wanted to make sure you saw my ask ^

from prefect-dbt.

ahuang11 avatar ahuang11 commented on May 30, 2024

Thanks for the reminder! Also cc @desertaxle

I fixed some hyperlinks and cleaned up the formatting a bit. Also maybe you can use this image?
https://user-images.githubusercontent.com/12350579/186269036-01f1090f-1887-433d-8331-ee7c8b315dd5.png

I think our marketing team may also want to comment on how we want to publish this.


Prefect

If your organization is using Prefect, the way you will run your jobs depends on the version you are on, and whether you are orchestrating dbt Cloud or core jobs. A variety of options are described below.

On Prefect 2

dbt Cloud

Use the trigger_dbt_cloud_job_run_and_wait_for_completion flow. As jobs are executing, you can poll dbt to see whether or not the job completes without failures, through the prefect UI.

dbt Core

Use the trigger_dbt_cli_command task.

For details on both of these methods, see prefect-dbt docs.

On Prefect 1

dbt Cloud

Trigger dbt Cloud jobs with the DbtCloudRunJob task. Running this task will generate a markdown artifact viewable in the Prefect UI. The artifact will contain links to the dbt artifacts generate as a result of the job run.

dbt Core

Use the DbtShellTask to schedule, execute and monitor your dbt runs. Use the supported ShellTask to execute dbt commands through the shell.

from prefect-dbt.

belasobral93 avatar belasobral93 commented on May 30, 2024

@ahuang11 thank you! If you want to give the language and images a run by your marketing team, let me know and I can get the approval from our docs/partnership team. If not, I'll go ahead and submit this draft tomorrow.

from prefect-dbt.

ahuang11 avatar ahuang11 commented on May 30, 2024

@belasobral93 thanks; I think it can be submitted as a draft! Curious if dbt team is open to updating this in the future (like in 3-6 months) as we rebrand off the migration period (deprecating Prefect 1 and updating Prefect 2 to simply Prefect)?

from prefect-dbt.

ahuang11 avatar ahuang11 commented on May 30, 2024

Thank you!

from prefect-dbt.

belasobral93 avatar belasobral93 commented on May 30, 2024

Changes are live!

from prefect-dbt.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.