prefecthq / prefect-recipes Goto Github PK
View Code? Open in Web Editor NEWSnippets and templates representing common Customer Success patterns
Home Page: https://PrefectHQ.github.io/prefect-recipes/
License: Apache License 2.0
Snippets and templates representing common Customer Success patterns
Home Page: https://PrefectHQ.github.io/prefect-recipes/
License: Apache License 2.0
Create descriptive readme for secret import
Showcase benefits of prefect-email to your workflow
https://prefecthq.github.io/prefect-email/
One or more recipes
n/a
No response
Showcase benefits of prefect-firebolt to your workflow
https://prefecthq.github.io/prefect-firebolt/
One or more recipes
n/a
No response
Show off the benefits of the prefect-azure collection to your workflow.
https://prefecthq.github.io/prefect-azure/
One or more recipes.
n/a
No response
https://docs.airbyte.io/deploying-airbyte/on-kubernetes
Optionally deploy as a stand alone cluster or with the prefect agent installed as well
https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-ec2-instance.html
Create a single cloudformation template + bootstrap script to deploy the prefect agent onto an ec2 instance
Showcase benefits of prefect-metricflow
https://alessandrolollo.github.io/prefect-metricflow/
One or more recipes
n/a
No response
Show off the benefits of the prefect-azure collection to your workflow.
https://alessandrolollo.github.io/prefect-cubejs/
One or more recipes
n/a
No response
As an engineer, i want to ensure that my airbyte configuration data is not lost in the event of an instance failure.
Showcase the benefits of prefect-fugue in your workflow
https://fugue-project.github.io/prefect-fugue/
One or more recipes
n/a
No response
As a solution engineer I want to have examples of popular CI tool gitlab CI registering prefect flows.
As a solution engineer I want to have examples of popular CI tool github actions registering prefect flows.
Showcase prefect-jupyter in your workflow
https://prefecthq.github.io/prefect-jupyter/
One or more examples
n/a
No response
Showcase the benefits of using prefect-dbt.
https://prefecthq.github.io/prefect-dbt/
One or more recipes
n/a
No response
Showcase the benefits of using prefect-databricks.
prefect-databricks
One or more recipes
n/a
No response
formatter: markdown
header-from: .header.md
settings:
anchor: true
color: true
default: true
escape: true
html: true
indent: 2
required: true
sensitive: true
type: true
sort:
enabled: true
by: required
output:
file: README.md
mode: replace
As a solution engineer I want to have examples of popular CI tool travis registering prefect flows.
Showcase benefits of prefect-gcp in your workflow
https://prefecthq.github.io/prefect-gcp/
One or more recipes
n/a
No response
user_data = templatefile("${path.module}/airbyte-install.sh",
{
region = "${data.aws_region.current.name}"
linux_type = "${var.linux_type}"
}
)
๐ Hey CS!
I would love to see/help with a terraform setup for deploying a "production-ready" Orion instance now that we have a basic k8s setup. As a consumer of this Orion instance, I would be particularly interested in:
I would be very interested in paring on this ๐
Showcase the benefits of prefect-github in your workflow
https://prefecthq.github.io/prefect-github/
One or more recipes
n/a
No response
Show off the benefits of using prefect-dask
https://prefecthq.github.io/prefect-dask/
One or more recipes
n/a
No response
When implementing large workflows at scale we often only want failed tasks to be re-run in the event of a failure as this preserves resources for other jobs in the infrastructure where our workflows are running.
Implementing cacheing on tasks and/or using results storage can help alleviate the need to re-run successful tasks in large workflows (caching docs). It would be helpful for users to have a template when implementing this for large workloads, in the same vein including reporting/logging for where the tasks may be failing and why.
Results (TBD)(currently uses local storage)
1.0 potential reference: https://discourse.prefect.io/t/how-to-resume-mapped-task-runs-from-failure-at-scale-or-limit-the-amount-of-allowed-runs-that-may-fail/715
None at the moment.
No response
A recipe detailing use of ECSTask block as users would like to see it in action.
Take a user from writing the flow through deployment!
Release Notes:
https://medium.com/the-prefect-blog/prefect-2-4-0-release-adds-support-for-aws-ecs-and-improves-deployment-cli-for-ci-cd-9582458e1e81
Docs/Prereqs:
https://docs.prefect.io/concepts/infrastructure/?h=ecstas#ecstask
n/a
No response
Showcase benefits of prefect-hex in your workflow
https://prefecthq.github.io/prefect-hex/
One or more recipes
n/a
No response
Several issues I noticed when trying to deploy Orion server from the Helm chart.
Showcase prefect-great-expectations in your workflow
https://prefecthq.github.io/prefect-great-expectations/
One or more recipes
n/a
No response
As someone who is new to Pydantic, I am curious to see how using it can improve my workflows.
not sure
not sure
No response
As a solution engineer I want consistent formatting for all code committed to recipe repos.
Create github action that runs black, flake8 and terraform checks to ensure that pre-commit formatting standards have been adhered to.
https://docs.airbyte.io/deploying-airbyte/on-kubernetes
Optionally deploy as a stand alone cluster or with the prefect agent installed as well
Event-Driven-Flows.
Dynamically created deployments.
Flows that use .context
Recipes for this
Using the 1.0 guides
No response
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.