conda-forge / dagster-feedstock Goto Github PK

View Code? Open in Web Editor NEW

1.0 8.0 8.0 823 KB

A conda-smithy repository for dagster.

License: BSD 3-Clause "New" or "Revised" License

dagster-feedstock's Introduction

About dagster-feedstock

Feedstock license: BSD-3-Clause

About dagster

Home: https://github.com/dagster-io

Package license: Apache-2.0

Summary: The data orchestration platform built for productivity.

Documentation: https://dagster.readthedocs.io

Dagster is a system for building modern data applications. Combining an elegant programming model and beautiful tools, Dagster allows infrastructure engineers, data engineers, and data scientists to seamlessly collaborate to process and produce the trusted, reliable data needed in today's world.

About dagster-pipes

Home: https://github.com/dagster-io/dagster/tree/master/python_modules/dagster-pipes

Package license: Apache-2.0

Summary: Toolkit for Dagster integrations with transform logic outside of Dagster

About dagster

Home: https://github.com/dagster-io/dagster

Package license: Apache-2.0

Summary: The data orchestration platform built for productivity.

Documentation: https://dagster.readthedocs.io

Dagster lets you define pipelines in terms of the data flow between reusable, logical components, then test locally and run anywhere. With a unified view of pipelines and the assets they produce, Dagster can schedule and orchestrate Pandas, Spark, SQL, or anything else that Python can invoke.

Dagster is designed for data platform engineers, data engineers, and full-stack data scientists. Building a data platform with Dagster makes your stakeholders more independent and your systems more robust. Developing data pipelines with Dagster makes testing easier and deploying faster.

About dagster-airflow

Home: https://github.com/dagster-io/dagster/tree/master/python_modules/dagster-airflow

Package license: Apache-2.0

Summary: Airflow plugin for Dagster

About dagster-graphql

Home: https://github.com/dagster-io/dagster/tree/master/python_modules/dagster-graphql

Package license: Apache-2.0

Summary: The GraphQL frontend to python dagster.

About dagster-webserver

Home: https://github.com/dagster-io/dagster/tree/master/python_modules/dagster-webserver

Package license: Apache-2.0

Summary: Web UI for dagster.

About dagit

Home: https://github.com/dagster-io/dagster/tree/master/python_modules/dagit

Package license: Apache-2.0

Summary: Dagster UI

Current build status

All platforms:

Current release info

Name	Downloads	Version	Platforms

Installing dagster

Installing dagster from the conda-forge channel can be achieved by adding conda-forge to your channels with:

conda config --add channels conda-forge
conda config --set channel_priority strict

Once the conda-forge channel has been enabled, dagit, dagster, dagster-airflow, dagster-graphql, dagster-pipes, dagster-webserver can be installed with conda:

conda install dagit dagster dagster-airflow dagster-graphql dagster-pipes dagster-webserver

or with mamba:

mamba install dagit dagster dagster-airflow dagster-graphql dagster-pipes dagster-webserver

It is possible to list all of the versions of dagit available on your platform with conda:

conda search dagit --channel conda-forge

or with mamba:

mamba search dagit --channel conda-forge

Alternatively, mamba repoquery may provide more information:

# Search all versions available on your platform:
mamba repoquery search dagit --channel conda-forge

# List packages depending on `dagit`:
mamba repoquery whoneeds dagit --channel conda-forge

# List dependencies of `dagit`:
mamba repoquery depends dagit --channel conda-forge

About conda-forge

conda-forge is a community-led conda channel of installable packages. In order to provide high-quality builds, the process has been automated into the conda-forge GitHub organization. The conda-forge organization contains one repository for each of the installable packages. Such a repository is known as a feedstock.

A feedstock is made up of a conda recipe (the instructions on what and how to build the package) and the necessary configurations for automatic building using freely available continuous integration services. Thanks to the awesome service provided by Azure, GitHub, CircleCI, AppVeyor, Drone, and TravisCI it is possible to build and upload installable packages to the conda-forge anaconda.org channel for Linux, Windows and OSX respectively.

To manage the continuous integration and simplify feedstock maintenance conda-smithy has been developed. Using the conda-forge.yml within this repository, it is possible to re-render all of this feedstock's supporting files (e.g. the CI configuration files) with conda smithy rerender.

For more information please check the conda-forge documentation.

Terminology

feedstock - the conda recipe (raw material), supporting scripts and CI configuration.

conda-smithy - the tool which helps orchestrate the feedstock. Its primary use is in the construction of the CI .yml files and simplify the management of many feedstocks.

conda-forge - the place where the feedstock and smithy live and work to produce the finished article (built conda distributions)

Updating dagster-feedstock

If you would like to improve the dagster recipe or build a new package version, please fork this repository and submit a PR. Upon submission, your changes will be run on the appropriate platforms to give the reviewer an opportunity to confirm that the changes result in a successful build. Once merged, the recipe will be re-built and uploaded automatically to the conda-forge channel, whereupon the built conda packages will be available for everybody to install and use from the conda-forge channel. Note that all branches in the conda-forge/dagster-feedstock are immediately built and any created packages are uploaded, so PRs should be based on branches in forks and branches in the main repository should only be used to build distinct package versions.

In order to produce a uniquely identifiable distribution:

If the version of a package is not being increased, please add or increase the build/number.
If the version of a package is being increased, please remember to return the build/number back to 0.

Feedstock Maintainers

dagster-feedstock's People

Contributors

Stargazers

Watchers

Forkers

regro-cf-autotick-bot bollwyvl xhochy anacondarecipes anacondarecipes conda-forge-admin dhirschfeld zaneselvans

dagster-feedstock's Issues

@conda-forge-admin please update version

Additional comment:

No response

@conda-forge-admin please rerender

Additional comment:

No response

Dagster 0.9.11

Just in case the bot doesn't pick it up (hasn't been) 0.9.11 (just) dropped:

https://github.com/dagster-io/dagster/releases/tag/0.9.11

We should be able to remove some of the dagster-dbt license special cases.

I probably will not get to it this weekend.

Add a helper script for updating the sha sums?

When a new pack of releases come, the tick bot will only update one sha. Is there a convention for adding helper scripts in a way that future migrations won't mess with them? I'm imagining a pretty short script to be run by a maintainer that:

reads the meta.yml
finds all the name pairs
downloads all the new tarballs
gets their shas
replaces them in meta.yml

Maintainer permissions?

Hi there, I'm just reaching out per the comments at dagster-io/dagster#413 (comment) to ask for maintainer permissions on this.

Build on `osx-arm64`

I read the conda-forge documentation and could not find the solution for my problem there.

Issue:

The current feedstock does not support the new Mac M1s. It would be nice to also build osx-arm64 packages. I believe this can be done automatically https://conda-forge.org/blog/posts/2020-10-29-macos-arm64/ .

Environment (conda list):

$ conda list

Details about conda and system ( conda info ):

$ conda info

PyPI and conda-forge versions for many dagster packages do not match

Solution to issue cannot be found in the documentation.

I checked the documentation.

Issue

As I mentioned in this discussion, it appears that the immature library packages (currently v0.21.6) are getting assigned the mature package version (currently v1.5.6) somehow in the conda-forge packaging, which leads to a big version discrepancy between the PyPI and conda-forge versions for the same package, e.g. dagster-postgres. Full text of the above discussion:

We are using conda-lock to create a reproducible environment that we run Dagster in. It reads dependencies and version constraints from pyproject.toml, solves the environment using mamba, and produces a complete environment specification in a lockfile. We're in the process of switching to using Postgres instead of SQLite for the EventLogs, since SQLite has been locking up on us due to concurrency. However, when trying to add the new dependency I discovered that the PyPI and conda-forge versioning for the dagster-postgres package seem to be completely unrelated to each other.

On PyPI the current version is 0.21.6
On conda-forge the current version is 1.5.5

Is it supposed to be this way? Typically conda packages track the same versions as their PyPI counterparts, and dagster-postgres seems to be an official package. It looks like the 0.21.6 version is probably the "libs" version, while 1.5.5 is the overall Dagster version.

Having these two versioning schemes be out of sync makes it difficult to specify the environment in a straightforward way, because the tools parsing pyproject.toml could ultimately seek the package either from PyPI or conda-forge.

I notice that this seems to be a common, but not universal, situation, across many of the dagster-* packages. Searching conda-forge packages it looks like everything has a most recent version of 1.5.5:

mamba search 'dagster-*==1.5.5'

Loading channels: done
# Name                       Version           Build  Channel
dagster-airbyte                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-airflow                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-aws                    1.5.5    pyhd8ed1ab_0  conda-forge
dagster-celery                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-celery-docker           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-celery-k8s             1.5.5    pyhd8ed1ab_0  conda-forge
dagster-census                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-dask                   1.5.5    pyhd8ed1ab_0  conda-forge
dagster-datadog                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-dbt                    1.5.5    pyhd8ed1ab_0  conda-forge
dagster-docker                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-duckdb                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-duckdb-pandas           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-duckdb-polars           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-duckdb-pyspark           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-fivetran               1.5.5    pyhd8ed1ab_0  conda-forge
dagster-gcp                    1.5.5    pyhd8ed1ab_0  conda-forge
dagster-gcp-pandas             1.5.5    pyhd8ed1ab_0  conda-forge
dagster-gcp-pyspark            1.5.5    pyhd8ed1ab_0  conda-forge
dagster-ge                     1.5.5    pyhd8ed1ab_0  conda-forge
dagster-github                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-graphql                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-k8s                    1.5.5    pyhd8ed1ab_0  conda-forge
dagster-managed-elements           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-mlflow                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-msteams                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-mysql                  1.5.5    pyhd8ed1ab_0  conda-forge
dagster-pagerduty              1.5.5    pyhd8ed1ab_0  conda-forge
dagster-pandas                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-pandera                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-papertrail             1.5.5    pyhd8ed1ab_0  conda-forge
dagster-pipes                  1.5.5    pyhd8ed1ab_0  conda-forge
dagster-postgres               1.5.5    pyhd8ed1ab_0  conda-forge
dagster-prometheus             1.5.5    pyhd8ed1ab_0  conda-forge
dagster-pyspark                1.5.5    pyhd8ed1ab_0  conda-forge
dagster-shell                  1.5.5    pyhd8ed1ab_0  conda-forge
dagster-slack                  1.5.5    pyhd8ed1ab_0  conda-forge
dagster-snowflake              1.5.5    pyhd8ed1ab_0  conda-forge
dagster-snowflake-pandas           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-snowflake-pyspark           1.5.5    pyhd8ed1ab_0  conda-forge
dagster-spark                  1.5.5    pyhd8ed1ab_0  conda-forge
dagster-ssh                    1.5.5    pyhd8ed1ab_0  conda-forge
dagster-twilio                 1.5.5    pyhd8ed1ab_0  conda-forge
dagster-wandb                  1.5.5    pyhd8ed1ab_0  conda-forge
dagster-webserver              1.5.5    pyhd8ed1ab_0  conda-forge

While many but not all of the same dagster-* packages have the libs version 0.21.6 on PyPI.

dagster-airbyte: 0.21.6
dagster-dbt: 0.21.6
dagster-mysql: 0.21.6
dagster-papertrail: 0.21.6
dagster-spark: 0.21.6

dagster-airflow: 1.5.6
dagster-graphql: 1.5.6
dagster-pipes 1.5.6
dagster-webserver 1.5.6

Looking at the conda-forge/dagster-feedstock which produces these packages, it seems like the intention is for the immature library packages to have the immature library version lib_version (currently 0.21.6), but for some reason that's not working:

  - name: dagster-postgres
    build:
      noarch: python
      version: {{ lib_version }}
      script: cd dagster-postgres && {{ PYTHON }} -m pip install . -vv --no-deps --no-build-isolation

    requirements:
      host:
        - pip
        - python >=3.8
      run:
        - {{ pin_subpackage("dagster", max_pin="x.x.x") }}
        - psycopg2-binary
        - python >=3.8

    test:
      imports:
        - dagster_postgres
      commands:
        - pip check
      requires:
        - python >=3.8
        - pip

    about:
      home: https://github.com/dagster-io/dagster/tree/master/python_modules/libraries/dagster-postgres
      license: Apache-2.0
      license_family: APACHE
      license_file: dagster-postgres/LICENSE
      summary: A Dagster integration for postgres

It also seems like the intention in the documentation about library versioning

Looking at the conda build docs on multiple outputs it does seem like the versions key is supposed to allow each of the subpackages to have its own version, but for some reason that's clearly not happening.

Installed packages

# packages in environment at /Users/zane/miniforge3:
#
# Name                    Version                   Build  Channel
annotated-types           0.6.0              pyhd8ed1ab_0    conda-forge
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
boltons                   23.0.0             pyhd8ed1ab_0    conda-forge
brotli-python             1.1.0           py310h1253130_0    conda-forge
bzip2                     1.0.8                h3422bc3_4    conda-forge
c-ares                    1.19.1               hb547adb_0    conda-forge
ca-certificates           2023.7.22            hf0a4a13_0    conda-forge
cachecontrol              0.13.1             pyhd8ed1ab_0    conda-forge
cachecontrol-with-filecache 0.13.1             pyhd8ed1ab_0    conda-forge
cachy                     0.3.0              pyhd8ed1ab_1    conda-forge
certifi                   2023.7.22          pyhd8ed1ab_0    conda-forge
cffi                      1.15.1          py310h2399d43_3    conda-forge
charset-normalizer        3.2.0              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
click-default-group       1.2.4              pyhd8ed1ab_0    conda-forge
clikit                    0.6.2              pyhd8ed1ab_2    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
conda                     23.9.0          py310hbe9552e_0    conda-forge
conda-libmamba-solver     23.9.2             pyhd8ed1ab_0    conda-forge
conda-lock                2.4.2              pyhd8ed1ab_0    conda-forge
conda-package-handling    2.2.0              pyh38be061_0    conda-forge
conda-package-streaming   0.9.0              pyhd8ed1ab_0    conda-forge
crashtest                 0.4.1              pyhd8ed1ab_0    conda-forge
cryptography              41.0.3          py310hdd3b5e7_0    conda-forge
distlib                   0.3.7              pyhd8ed1ab_0    conda-forge
ensureconda               1.4.3              pyhd8ed1ab_0    conda-forge
filelock                  3.13.1             pyhd8ed1ab_0    conda-forge
fmt                       10.1.1               h1995070_0    conda-forge
gitdb                     4.0.11             pyhd8ed1ab_0    conda-forge
gitpython                 3.1.40             pyhd8ed1ab_0    conda-forge
html5lib                  1.1                pyh9f0ad1d_0    conda-forge
icu                       73.2                 hc8870d7_0    conda-forge
idna                      3.4                pyhd8ed1ab_0    conda-forge
importlib-metadata        6.8.0              pyha770c72_0    conda-forge
importlib_metadata        6.8.0                hd8ed1ab_0    conda-forge
jaraco.classes            3.3.0              pyhd8ed1ab_0    conda-forge
jinja2                    3.1.2              pyhd8ed1ab_1    conda-forge
jsonpatch                 1.32               pyhd8ed1ab_0    conda-forge
jsonpointer               2.0                        py_0    conda-forge
keyring                   24.2.0          py310hbe9552e_1    conda-forge
krb5                      1.21.2               h92f50d5_0    conda-forge
libarchive                3.7.2                h82b9b87_0    conda-forge
libcurl                   8.4.0                h2d989ff_0    conda-forge
libcxx                    16.0.6               h4653b0c_0    conda-forge
libedit                   3.1.20191231         hc8eb9b7_2    conda-forge
libev                     4.33                 h642e427_1    conda-forge
libffi                    3.4.2                h3422bc3_5    conda-forge
libiconv                  1.17                 he4db4b2_0    conda-forge
libmamba                  1.5.3                h0a6dc31_1    conda-forge
libmambapy                1.5.3           py310h3812fd7_1    conda-forge
libnghttp2                1.52.0               hae82a92_0    conda-forge
libsolv                   0.7.24               ha614eb4_3    conda-forge
libsqlite                 3.43.0               hb31c410_0    conda-forge
libssh2                   1.11.0               h7a5bd25_0    conda-forge
libxml2                   2.11.5               h25269f3_1    conda-forge
libzlib                   1.2.13               h53f4e23_5    conda-forge
lz4-c                     1.9.4                hb7217d7_0    conda-forge
lzo                       2.10              h642e427_1000    conda-forge
mamba                     1.5.3           py310ha5d4528_1    conda-forge
markupsafe                2.1.3           py310h2aa6e3c_1    conda-forge
more-itertools            10.1.0             pyhd8ed1ab_0    conda-forge
msgpack-python            1.0.6           py310h38f39d4_0    conda-forge
ncurses                   6.4                  h7ea286d_0    conda-forge
openssl                   3.1.4                h0d3ecfb_0    conda-forge
packaging                 23.1               pyhd8ed1ab_0    conda-forge
pastel                    0.2.1              pyhd8ed1ab_0    conda-forge
pip                       23.2.1             pyhd8ed1ab_0    conda-forge
pkginfo                   1.9.6              pyhd8ed1ab_0    conda-forge
platformdirs              3.11.0             pyhd8ed1ab_0    conda-forge
pluggy                    1.3.0              pyhd8ed1ab_0    conda-forge
pybind11-abi              4                    hd8ed1ab_3    conda-forge
pycosat                   0.6.4           py310h8e9501a_1    conda-forge
pycparser                 2.21               pyhd8ed1ab_0    conda-forge
pydantic                  2.4.2              pyhd8ed1ab_1    conda-forge
pydantic-core             2.10.1          py310had9acf8_0    conda-forge
pylev                     1.4.0              pyhd8ed1ab_0    conda-forge
pyopenssl                 23.2.0             pyhd8ed1ab_1    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
python                    3.10.12         h01493a6_0_cpython    conda-forge
python_abi                3.10                    3_cp310    conda-forge
pyyaml                    6.0.1           py310h2aa6e3c_1    conda-forge
readline                  8.2                  h92ec313_1    conda-forge
reproc                    14.2.4               h1a8c8d9_0    conda-forge
reproc-cpp                14.2.4               hb7217d7_0    conda-forge
requests                  2.31.0             pyhd8ed1ab_0    conda-forge
ruamel.yaml               0.17.32         py310h2aa6e3c_0    conda-forge
ruamel.yaml.clib          0.2.7           py310h8e9501a_1    conda-forge
setuptools                68.1.2             pyhd8ed1ab_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
smmap                     5.0.0              pyhd8ed1ab_0    conda-forge
tk                        8.6.12               he1e0b03_0    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
tomlkit                   0.12.2             pyha770c72_0    conda-forge
toolz                     0.12.0             pyhd8ed1ab_0    conda-forge
tqdm                      4.66.1             pyhd8ed1ab_0    conda-forge
truststore                0.8.0              pyhd8ed1ab_0    conda-forge
typing-extensions         4.8.0                hd8ed1ab_0    conda-forge
typing_extensions         4.8.0              pyha770c72_0    conda-forge
tzdata                    2023c                h71feb2d_0    conda-forge
urllib3                   1.26.18            pyhd8ed1ab_0    conda-forge
virtualenv                20.24.6            pyhd8ed1ab_0    conda-forge
webencodings              0.5.1              pyhd8ed1ab_2    conda-forge
wheel                     0.41.2             pyhd8ed1ab_0    conda-forge
xz                        5.2.6                h57fd34a_0    conda-forge
yaml                      0.2.5                h3422bc3_2    conda-forge
yaml-cpp                  0.8.0                h13dd4ca_0    conda-forge
zipp                      3.17.0             pyhd8ed1ab_0    conda-forge
zstandard                 0.19.0          py310h8e9501a_0    conda-forge
zstd                      1.5.5                h4f39d0f_0    conda-forge

Environment info

active environment : base
    active env location : /Users/zane/miniforge3
            shell level : 1
       user config file : /Users/zane/.condarc
 populated config files : /Users/zane/miniforge3/.condarc
                          /Users/zane/.condarc
          conda version : 23.9.0
    conda-build version : not installed
         python version : 3.10.12.final.0
       virtual packages : __archspec=1=arm64
                          __osx=13.6=0
                          __unix=0=0
       base environment : /Users/zane/miniforge3  (writable)
      conda av data dir : /Users/zane/miniforge3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/osx-arm64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/osx-arm64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-arm64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /Users/zane/miniforge3/pkgs
                          /Users/zane/.conda/pkgs
       envs directories : /Users/zane/miniforge3/envs
                          /Users/zane/.conda/envs
               platform : osx-arm64
             user-agent : conda/23.9.0 requests/2.31.0 CPython/3.10.12 Darwin/22.6.0 OSX/13.6
                UID:GID : 1000:20
             netrc file : None
           offline mode : False

@conda-forge-admin please update version

Additional comment:

No response

@conda-forge-admin please rerender

Additional comment:

No response

[warning] failed package validation and/or copy for commit 990857a63f2152d332a8b20253870882d00f3eee

Hi @conda-forge/dagster! This is the friendly automated conda-forge-webservice!

It appears that one or more of your feedstock's outputs did not copy from the
staging channel (cf-staging) to the production channel (conda-forge). :(

This failure can happen for a lot of reasons, including an outdated feedstock
token. Below we have put some information about the failure to help you debug it.

Rerendering the feedstock will usually fix these problems.

If you have any issues or questions, you can find us on gitter in the
community chat room or you can bump us right here.

output validation (is this output allowed for your feedstock?):

noarch/dagster-gcp-pyspark-1.3.2-pyhd8ed1ab_1.conda: True

copied (did this output get copied to the production channel?):

noarch/dagster-gcp-pyspark-1.3.2-pyhd8ed1ab_1.conda: False

@conda-forge-admin please update version

Additional comment:

No response

restore dagster-aws

As of #77, as it appears the run/test environments for ~~dagster-snowflake and~~ dagster-aws have become unsolveable. Some more careful study of the upstreams is likely required.

package dagster 0.10.4

shame on me for not waiting until a friday to package a new dagster. new one dropped while i was doing the 0.10.3 release. Might also take the time to investigate #78 and other things we had given up on for a while...

@conda-forge-admin please update version

Additional comment:

No response

add dagster-msteams

looks like a new package for MS Teams:

https://github.com/dagster-io/dagster/blob/master/python_modules/libraries/dagster-msteams/setup.py

dagster 0.9.15

Since the bot seems to be 💤...

https://github.com/dagster-io/dagster/releases/tag/0.9.15

Will wait until probably sunday before tackling this, partially to see if another patch release drops (has happened).

Important points:

can relax hard pins on grpc/protobuf stuff 🎉
- dagster-io/dagster#3085

Errors while solving for versions above 0.13.14

I read the conda-forge documentation and could not find the solution for my problem there.

Issue:

I'm trying to create new environments using an environment.yml file, and conda, mamba, and micromamba all are failing to solve environments with versions of dagster above 0.13.14.

channels:
  - conda-forge
  - defaults
dependencies:
  - python=3.10
  - dagster=0.13.19
  - dagit=0.13.19
  - dagster-postgres
  - dagster-graphql

Mamba's output:

➜ mamba env create -n dagster-test -f=environment.yml

conda-forge/osx-64       Using cache
conda-forge/noarch       Using cache
pkgs/r/noarch            [====================] (00m:00s) No change
pkgs/main/osx-64         [====================] (00m:00s) No change
pkgs/main/noarch         [====================] (00m:00s) No change
pkgs/r/osx-64            [====================] (00m:00s) No change


Looking for: ['python=3.10', 'dagster=0.13.19', 'dagit=0.13.19', 'dagster-postgres', 'dagster-graphql']


Encountered problems while solving:
  - nothing provides dagster 0.13.19 py38h578d9bd_0 needed by dagit-0.13.19-pyhd8ed1ab_0
  - nothing provides dagster 0.13.15 py39hf3d152e_0 needed by dagster-postgres-0.13.15-pyhd8ed1ab_0

Conda gives a bit of a more detailed error

➜ conda env create -n dagster-test -f=environment.yml
Collecting package metadata (repodata.json): done
Solving environment: /
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
Examining conflict for dagster-graphql dagster-postgres dagster: : 9it [00:21,  Examining conflict for dagster-graphql dagster-postgres: : 9it [00:51,  2.29s/itExamining conflict for dagster-graphql dagster-postgres: : 10it [00:51,  8.93s/i                                                                              failed
Solving environment: -
Found conflicts! Looking for incompatible packages.
This can take several minutes.  Press CTRL-C to abort.
Examining conflict for dagster-graphql dagster-postgres dagster: : 9it [00:23,  Examining conflict for dagster-graphql dagster-postgres: : 9it [00:59,  2.59s/itExamining conflict for dagster-graphql dagster-postgres: : 10it [00:59, 10.52s/i                                                                              failed

UnsatisfiableError: The following specifications were found to be incompatible with each other:

Output in format: Requested package -> Available versions

Package idna conflicts for:
dagster=0.13.19 -> requests -> idna[version='>=2.5,<2.6|>=2.5,<2.7|>=2.5,<2.8|>=2.5,<2.9|>=2.5,<3|>=2.5,<4']
dagster-graphql -> requests -> idna[version='>=2.5,<2.6|>=2.5,<2.7|>=2.5,<2.8|>=2.5,<2.9|>=2.5,<3|>=2.5,<4']
dagit=0.13.19 -> requests -> idna[version='>=2.5,<2.6|>=2.5,<2.7|>=2.5,<2.8|>=2.5,<2.9|>=2.5,<3|>=2.5,<4']

Package ca-certificates conflicts for:
dagster-graphql -> python -> ca-certificates
python=3.10 -> openssl[version='>=3.0.0,<4.0a0'] -> ca-certificates
dagster-postgres -> python -> ca-certificates

Package pyrsistent conflicts for:
dagster-graphql -> dagster=0.11.4 -> pyrsistent[version='>=0.14.8']
dagster-postgres -> dagster=0.11.4 -> pyrsistent[version='>=0.14.8']

Package dagster conflicts for:
dagit=0.13.19 -> dagster==0.13.19=py38h578d9bd_0
dagster-graphql -> dagster[version='0.10.3.*|0.10.4.*|0.10.6.*|0.10.7.*|0.10.8.*|0.11.0.*|0.11.1.*|0.11.10.*|0.11.15.*|0.12.13.*|0.12.14.*|0.12.15.*|0.13.1.*|0.13.10.*|0.13.11.*|0.13.12.*|0.13.13.*|0.13.14.*|0.13.15|0.13.16|0.13.17|0.13.18|0.13.19|0.13.9.*|0.13.7.*|0.13.6.*|0.13.5.*|0.13.4.*|0.13.2.*|0.12.9.*|0.12.8.*|0.12.7.*|0.12.6.*|0.12.5.*|0.12.4.*|0.12.3.*|0.12.2.*|0.11.8.*|0.11.7.*|0.11.6.*|0.11.5.*|0.11.4.*|0.11.3.*|0.11.2.*|0.9.21.*|0.9.20.*|0.9.19.*|0.9.18.*|0.9.15.*|0.9.14.*|0.9.13.*|0.9.9.*|0.9.5.*|0.9.3.*|0.9.2.*|0.9.1.*|0.8.5.*|0.8.4.*|0.8.3.*|0.8.2.*|0.8.1.*|0.7.16.*|0.7.15.*|0.7.14.*|0.7.13.*|0.7.12.*|0.7.11.post0.*|0.7.3.*|0.7.2.*|0.7.1.*|0.7.0.*|0.6.9.*',build='py38h578d9bd_0|py37h89c1867_0|py38h578d9bd_0|py38h578d9bd_0']
dagster-postgres -> dagster[version='0.10.3.*|0.10.4.*|0.10.6.*|0.10.7.*|0.10.8.*|0.11.0.*|0.11.1.*|0.11.10.*|0.11.15.*|0.12.13.*|0.12.14.*|0.12.15.*|0.13.1.*|0.13.10.*|0.13.11.*|0.13.12.*|0.13.13.*|0.13.14.*|0.13.15|0.13.16|0.13.17|0.13.18|0.13.19|0.13.9.*|0.13.7.*|0.13.6.*|0.13.5.*|0.13.4.*|0.13.2.*|0.12.9.*|0.12.8.*|0.12.7.*|0.12.6.*|0.12.5.*|0.12.4.*|0.12.3.*|0.12.2.*|0.11.8.*|0.11.7.*|0.11.6.*|0.11.5.*|0.11.4.*|0.11.3.*|0.11.2.*|0.9.21.*|0.9.20.*|0.9.19.*|0.9.18.*|0.9.15.*|0.9.14.*|0.9.13.*|0.9.9.*|0.9.5.*|0.9.3.*|0.9.2.*|0.9.1.*|0.8.5.*|0.8.4.*|0.8.3.*|0.8.2.*|0.8.1.*|0.7.16.*|0.7.15.*|0.7.14.*|0.7.13.*|0.7.12.*|0.7.11.post0.*|0.7.3.*|0.7.2.*|0.7.1.*|0.7.0.*|0.6.9.*',build=py39hf3d152e_0]
dagster=0.13.19

Package gevent conflicts for:
dagster-postgres -> dagster=0.8.5 -> gevent
dagster-graphql -> gevent
dagit=0.13.19 -> gevent

Package python conflicts for:
python=3.10
dagster-postgres -> dagster=0.13.14 -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.10,<3.11.0a0|>=3.7,<3.8.0a0|>=3.8,<3.9.0a0|>=3.9,<3.10.0a0|>=3.6,<3.7.0a0|>=3.5,<3.6.0a0|3.4.*']
dagster-postgres -> python[version='>=3.6']
dagster-graphql -> gevent -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.10,<3.11.0a0|>=3.7,<3.8.0a0|>=3.9,<3.10.0a0|>=3.8,<3.9.0a0|>=3.6,<3.7.0a0|>=3.5,<3.6.0a0|>=2.7|3.4.*']
dagit=0.13.19 -> click[version='>=7.0,<9.0'] -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3.10,<3.11.0a0|>=3.7,<3.8.0a0|>=3.9,<3.10.0a0|>=3.8,<3.9.0a0|>=3.6,<3.7.0a0|>=3.7|>=3.5,<3.6.0a0|3.4.*']
dagit=0.13.19 -> python[version='>=3.6']
dagster-graphql -> python[version='>=3.6']

Package dagster-graphql conflicts for:
dagster-graphql
dagit=0.13.19 -> dagster-graphql==0.13.19=pyhd8ed1ab_0

Package tabulate conflicts for:
dagster-postgres -> dagster=0.13.14 -> tabulate
dagster-graphql -> dagster=0.13.14 -> tabulate
dagster=0.13.19 -> tabulate

Package pyobjc-framework-cocoa conflicts for:
dagster=0.13.19 -> watchdog[version='>=0.8.3'] -> pyobjc-framework-cocoa[version='>=4.2.2']
dagit=0.13.19 -> watchdog[version='>=0.8.3'] -> pyobjc-framework-cocoa[version='>=4.2.2']The following specifications were found to be incompatible with your system:

  - feature:/osx-64::__osx==10.16=0
  - feature:|@/osx-64::__osx==10.16=0

Your installed version is: 10.16



NERACOOS_ERDDAP_K8S on  next-thredds [!?] took 4m 17s
➜ mamba env create -n neracoos-dagster-test -f=services/dagster/environment.yml
conda-forge/osx-64       Using cache
conda-forge/noarch       Using cache
pkgs/main/osx-64         [====================] (00m:00s) No change
pkgs/r/osx-64            [====================] (00m:00s) No change
pkgs/r/noarch            [====================] (00m:00s) No change
pkgs/main/noarch         [====================] (00m:00s) Done


Looking for: ['python=3.10', 'dagster=0.13.19', 'dagit=0.13.19', 'dagster-postgres=0.13.19', 'dagster-graphql=0.13.19']


Encountered problems while solving:
  - nothing provides dagster 0.13.19 py38h578d9bd_0 needed by dagit-0.13.19-pyhd8ed1ab_0
  - nothing provides dagster 0.13.19 py39hf3d152e_0 needed by dagster-postgres-0.13.19-pyhd8ed1ab_0
  - nothing provides dagster 0.13.19 py38h578d9bd_0 needed by dagster-graphql-0.13.19-pyhd8ed1ab_0

CC @ocefpaf

Environment (conda list):

$ conda list

Details about conda and system ( conda info ):

➜ conda info

     active environment : None
            shell level : 0
       user config file : /Users/akerney/.condarc
 populated config files : /Users/akerney/.condarc
          conda version : 4.11.0
    conda-build version : not installed
         python version : 3.7.3.final.0
       virtual packages : __osx=10.16=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /usr/local/miniconda3  (writable)
      conda av data dir : /usr/local/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/osx-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/osx-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /usr/local/miniconda3/pkgs
       envs directories : /usr/local/miniconda3/envs
                          /Users/akerney/.conda/envs
               platform : osx-64
             user-agent : conda/4.11.0 requests/2.27.1 CPython/3.7.3 Darwin/21.3.0 OSX/10.16
                UID:GID : 502:20
             netrc file : None
           offline mode : False

➜ mamba info

                  __    __    __    __
                 /  \  /  \  /  \  /  \
                /    \/    \/    \/    \
███████████████/  /██/  /██/  /██/  /████████████████████████
              /  / \   / \   / \   / \  \____
             /  /   \_/   \_/   \_/   \    o \__,
            / _/                       \_____/  `
            |/
        ███╗   ███╗ █████╗ ███╗   ███╗██████╗  █████╗
        ████╗ ████║██╔══██╗████╗ ████║██╔══██╗██╔══██╗
        ██╔████╔██║███████║██╔████╔██║██████╔╝███████║
        ██║╚██╔╝██║██╔══██║██║╚██╔╝██║██╔══██╗██╔══██║
        ██║ ╚═╝ ██║██║  ██║██║ ╚═╝ ██║██████╔╝██║  ██║
        ╚═╝     ╚═╝╚═╝  ╚═╝╚═╝     ╚═╝╚═════╝ ╚═╝  ╚═╝

        mamba (0.15.3) supported by @QuantStack

        GitHub:  https://github.com/mamba-org/mamba
        Twitter: https://twitter.com/QuantStack

█████████████████████████████████████████████████████████████


     active environment : None
            shell level : 0
       user config file : /Users/akerney/.condarc
 populated config files : /Users/akerney/.condarc
          conda version : 4.11.0
    conda-build version : not installed
         python version : 3.7.3.final.0
       virtual packages : __osx=10.16=0
                          __unix=0=0
                          __archspec=1=x86_64
       base environment : /usr/local/miniconda3  (writable)
      conda av data dir : /usr/local/miniconda3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/osx-64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/osx-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /usr/local/miniconda3/pkgs
       envs directories : /usr/local/miniconda3/envs
                          /Users/akerney/.conda/envs
               platform : osx-64
             user-agent : conda/4.11.0 requests/2.27.1 CPython/3.7.3 Darwin/21.3.0 OSX/10.16
                UID:GID : 502:20
             netrc file : None
           offline mode : False

update for 1.1.17, version scheme

Comment:

https://github.com/dagster-io/dagster/releases/tag/1.1.17

The dagster-airflow library as been moved to 1.x.x to denote the stability of its api's going forward.

`papermill` not compatible with `py>=312`

xref: #296 (comment)

@conda-forge-admin, update version

Additional comment:

No response

dagster 0.9.5

Just in case the bot doesn't fire:

https://github.com/dagster-io/dagster/releases/tag/0.9.4

dagster 0.9.17

As we were (and are) blocked on #74, I entirely missed 0.9.16.

Of note, looks like grpcio-health-checking will be needed, as it is now a hard dagster dep...

Dagster "monostock"?

Thanks for getting this one going!

Mentioned over on conda-forge/dagster_graphql-feedstock#2

Also, while looking over the repos, it looks like dag(ster|git)* are simultaneously released with the same version. Perhaps it makes sense to:

move them all into one feedtock (dagster?)

keep triggering the bot off the main dagster pypi tarball, as they make tags-per-push

do all the builds from source.

It's a big source tarball (they check in their yarn packages) but it should be much easier to keep everything consistent.

Right now, I'm just seeing what i can do with dagster, and not looking for another ecosystem to be on the hook to maintain, but would be interested in exploring at least getting to the above... if it did work, it should be much easier to maintain.

@conda-forge-admin please update version

Additional comment:

No response

Revert tqdm test pin

The upstream fix is in for this:

#87 (comment)

We should remove the pin on the next release, but it's probably not hurting enough to warrant another 20+ builds on its own.

Package dagster 0.10.0

Looks like a pretty heavy release:

https://github.com/dagster-io/dagster/releases/tag/0.10.0

@conda-forge-admin please update version

Additional comment:

No response

Not getting bot updates

It looks like we aren't getting bot PRs, and I am not presently using dagster in anger, I hadn't noticed. It looks like 0.7.11 just dropped...

https://pypi.org/project/dagster/0.7.11

I'll try to work up something new this weekend... by hand, I suppose, unless there is a quick way to request/debug why the bot isn't firing...

Remove version pin prohibiting use of pydantic v2

Solution to issue cannot be found in the documentation.

I checked the documentation.

Issue

As of v1.5.5 Dagster supports the use of Pydantic v2. See:

However, there's still a version pin in the conda packaging that prohibits its use in the conda-forge packaging recipe meta.yml:

    requirements:
      host:
        - python >=3.8
        - pip
      run:
        - {{ pin_subpackage("dagster-pipes", max_pin="x.x.x") }}
        - alembic >=1.2.1,!=1.6.3,!=1.7.0,!=1.11.0
        - click >=5.0
        - coloredlogs >=6.1,<=14.0
        - croniter >=0.3.34
        - docstring_parser
        - grpcio >=1.44.0
        - grpcio-health-checking >=1.44.0
        - jinja2
        - packaging >=20.9
        - pendulum
        - protobuf >=3.20.0
        - psutil >=1.0
        - pydantic >1.10.0,!=1.10.7,<2.0.0
        - python >=3.8
        - python-dateutil
        - python-dotenv
        - pytz
        - pywin32-on-windows
        - pyyaml >=5.1
        - requests
        - setuptools
        - sqlalchemy >=1.0
        - tabulate
        - tomli
        - toposort >=1.0
        - tqdm
        - typing_extensions >=4.4.0
        - universal_pathlib
        - watchdog >=0.8.3

Which leads to environment solving failures under conda / mamba that don't happen under pip e.g.

mamba create -n dagster-pydantic-test dagster=1.5.6 pydantic=2.4.2

Could not solve for environment specs
The following packages are incompatible
├─ dagster 1.5.6**  is installable and it requires
│  └─ pydantic >1.10.0,!=1.10.7,<2.0.0 , which can be installed;
└─ pydantic 2.4.2**  is not installable because it conflicts with any installable versions previously reported.

mamba create -y -n dagster-pydantic-test python=3.11 && \
mamba activate dagster-pydantic-test && \
pip install "dagster==1.5.6" "pydantic==2.4.2"

Collecting dagster==1.5.6
  Downloading dagster-1.5.6-py3-none-any.whl.metadata (11 kB)
Collecting pydantic==2.4.2
  Using cached pydantic-2.4.2-py3-none-any.whl.metadata (158 kB)
Collecting click>=5.0 (from dagster==1.5.6)
  Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting coloredlogs<=14.0,>=6.1 (from dagster==1.5.6)
  Using cached coloredlogs-14.0-py2.py3-none-any.whl (43 kB)
Collecting Jinja2 (from dagster==1.5.6)
  Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting PyYAML>=5.1 (from dagster==1.5.6)
  Using cached PyYAML-6.0.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (2.1 kB)
Collecting alembic!=1.11.0,!=1.6.3,!=1.7.0,>=1.2.1 (from dagster==1.5.6)
  Using cached alembic-1.12.1-py3-none-any.whl.metadata (7.3 kB)
Collecting croniter>=0.3.34 (from dagster==1.5.6)
  Using cached croniter-2.0.1-py2.py3-none-any.whl.metadata (24 kB)
Collecting grpcio>=1.44.0 (from dagster==1.5.6)
  Downloading grpcio-1.59.2-cp311-cp311-macosx_10_10_universal2.whl.metadata (4.0 kB)
Collecting grpcio-health-checking>=1.44.0 (from dagster==1.5.6)
  Downloading grpcio_health_checking-1.59.2-py3-none-any.whl.metadata (1.3 kB)
Collecting packaging>=20.9 (from dagster==1.5.6)
  Using cached packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Collecting pendulum (from dagster==1.5.6)
  Using cached pendulum-2.1.2-cp311-cp311-macosx_13_0_arm64.whl
Collecting protobuf>=3.20.0 (from dagster==1.5.6)
  Downloading protobuf-4.25.0-cp37-abi3-macosx_10_9_universal2.whl.metadata (541 bytes)
Collecting python-dateutil (from dagster==1.5.6)
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting python-dotenv (from dagster==1.5.6)
  Using cached python_dotenv-1.0.0-py3-none-any.whl (19 kB)
Collecting pytz (from dagster==1.5.6)
  Using cached pytz-2023.3.post1-py2.py3-none-any.whl.metadata (22 kB)
Collecting requests (from dagster==1.5.6)
  Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Requirement already satisfied: setuptools in /Users/zane/miniforge3/envs/dagster-pydantic-test/lib/python3.11/site-packages (from dagster==1.5.6) (68.2.2)
Collecting tabulate (from dagster==1.5.6)
  Using cached tabulate-0.9.0-py3-none-any.whl (35 kB)
Collecting tomli (from dagster==1.5.6)
  Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Collecting tqdm (from dagster==1.5.6)
  Using cached tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
Collecting typing-extensions>=4.4.0 (from dagster==1.5.6)
  Using cached typing_extensions-4.8.0-py3-none-any.whl.metadata (3.0 kB)
Collecting sqlalchemy>=1.0 (from dagster==1.5.6)
  Downloading SQLAlchemy-2.0.23-cp311-cp311-macosx_11_0_arm64.whl.metadata (9.6 kB)
Collecting toposort>=1.0 (from dagster==1.5.6)
  Using cached toposort-1.10-py3-none-any.whl (8.5 kB)
Collecting watchdog>=0.8.3 (from dagster==1.5.6)
  Using cached watchdog-3.0.0-cp311-cp311-macosx_11_0_arm64.whl (91 kB)
Collecting docstring-parser (from dagster==1.5.6)
  Using cached docstring_parser-0.15-py3-none-any.whl (36 kB)
Collecting universal-pathlib (from dagster==1.5.6)
  Using cached universal_pathlib-0.1.4-py3-none-any.whl.metadata (8.9 kB)
Collecting dagster-pipes==1.5.6 (from dagster==1.5.6)
  Downloading dagster_pipes-1.5.6-py3-none-any.whl.metadata (714 bytes)
Collecting annotated-types>=0.4.0 (from pydantic==2.4.2)
  Using cached annotated_types-0.6.0-py3-none-any.whl.metadata (12 kB)
Collecting pydantic-core==2.10.1 (from pydantic==2.4.2)
  Using cached pydantic_core-2.10.1-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.5 kB)
Collecting Mako (from alembic!=1.11.0,!=1.6.3,!=1.7.0,>=1.2.1->dagster==1.5.6)
  Using cached Mako-1.2.4-py3-none-any.whl (78 kB)
Collecting humanfriendly>=7.1 (from coloredlogs<=14.0,>=6.1->dagster==1.5.6)
  Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)
Collecting MarkupSafe>=2.0 (from Jinja2->dagster==1.5.6)
  Using cached MarkupSafe-2.1.3-cp311-cp311-macosx_10_9_universal2.whl.metadata (3.0 kB)
Collecting pytzdata>=2020.1 (from pendulum->dagster==1.5.6)
  Using cached pytzdata-2020.1-py2.py3-none-any.whl (489 kB)
Collecting six>=1.5 (from python-dateutil->dagster==1.5.6)
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting charset-normalizer<4,>=2 (from requests->dagster==1.5.6)
  Downloading charset_normalizer-3.3.2-cp311-cp311-macosx_11_0_arm64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests->dagster==1.5.6)
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1 (from requests->dagster==1.5.6)
  Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB)
Collecting certifi>=2017.4.17 (from requests->dagster==1.5.6)
  Using cached certifi-2023.7.22-py3-none-any.whl.metadata (2.2 kB)
Collecting fsspec>=2022.1.0 (from universal-pathlib->dagster==1.5.6)
  Using cached fsspec-2023.10.0-py3-none-any.whl.metadata (6.8 kB)
Downloading dagster-1.5.6-py3-none-any.whl (1.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 2.3 MB/s eta 0:00:00
Using cached pydantic-2.4.2-py3-none-any.whl (395 kB)
Downloading dagster_pipes-1.5.6-py3-none-any.whl (15 kB)
Using cached pydantic_core-2.10.1-cp311-cp311-macosx_11_0_arm64.whl (1.7 MB)
Using cached alembic-1.12.1-py3-none-any.whl (226 kB)
Using cached annotated_types-0.6.0-py3-none-any.whl (12 kB)
Using cached click-8.1.7-py3-none-any.whl (97 kB)
Using cached croniter-2.0.1-py2.py3-none-any.whl (19 kB)
Downloading grpcio-1.59.2-cp311-cp311-macosx_10_10_universal2.whl (9.5 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.5/9.5 MB 9.9 MB/s eta 0:00:00
Downloading grpcio_health_checking-1.59.2-py3-none-any.whl (17 kB)
Using cached packaging-23.2-py3-none-any.whl (53 kB)
Downloading protobuf-4.25.0-cp37-abi3-macosx_10_9_universal2.whl (393 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 393.9/393.9 kB 3.9 MB/s eta 0:00:00
Using cached pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
Using cached PyYAML-6.0.1-cp311-cp311-macosx_11_0_arm64.whl (167 kB)
Downloading SQLAlchemy-2.0.23-cp311-cp311-macosx_11_0_arm64.whl (2.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 8.0 MB/s eta 0:00:00
Using cached typing_extensions-4.8.0-py3-none-any.whl (31 kB)
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Using cached tqdm-4.66.1-py3-none-any.whl (78 kB)
Using cached universal_pathlib-0.1.4-py3-none-any.whl (20 kB)
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Downloading charset_normalizer-3.3.2-cp311-cp311-macosx_11_0_arm64.whl (118 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 119.0/119.0 kB 1.2 MB/s eta 0:00:00
Downloading fsspec-2023.10.0-py3-none-any.whl (166 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 166.4/166.4 kB 1.5 MB/s eta 0:00:00
Using cached MarkupSafe-2.1.3-cp311-cp311-macosx_10_9_universal2.whl (17 kB)
Using cached urllib3-2.0.7-py3-none-any.whl (124 kB)
Installing collected packages: toposort, pytz, dagster-pipes, watchdog, urllib3, typing-extensions, tqdm, tomli, tabulate, six, PyYAML, pytzdata, python-dotenv, protobuf, packaging, MarkupSafe, idna, humanfriendly, grpcio, fsspec, docstring-parser, click, charset-normalizer, certifi, annotated-types, universal-pathlib, sqlalchemy, requests, python-dateutil, pydantic-core, Mako, Jinja2, grpcio-health-checking, coloredlogs, pydantic, pendulum, croniter, alembic, dagster
Successfully installed Jinja2-3.1.2 Mako-1.2.4 MarkupSafe-2.1.3 PyYAML-6.0.1 alembic-1.12.1 annotated-types-0.6.0 certifi-2023.7.22 charset-normalizer-3.3.2 click-8.1.7 coloredlogs-14.0 croniter-2.0.1 dagster-1.5.6 dagster-pipes-1.5.6 docstring-parser-0.15 fsspec-2023.10.0 grpcio-1.59.2 grpcio-health-checking-1.59.2 humanfriendly-10.0 idna-3.4 packaging-23.2 pendulum-2.1.2 protobuf-4.25.0 pydantic-2.4.2 pydantic-core-2.10.1 python-dateutil-2.8.2 python-dotenv-1.0.0 pytz-2023.3.post1 pytzdata-2020.1 requests-2.31.0 six-1.16.0 sqlalchemy-2.0.23 tabulate-0.9.0 tomli-2.0.1 toposort-1.10 tqdm-4.66.1 typing-extensions-4.8.0 universal-pathlib-0.1.4 urllib3-2.0.7 watchdog-3.0.0

Installed packages

# packages in environment at /Users/zane/miniforge3:
#
# Name                    Version                   Build  Channel
annotated-types           0.6.0              pyhd8ed1ab_0    conda-forge
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
boltons                   23.0.0             pyhd8ed1ab_0    conda-forge
brotli-python             1.1.0           py310h1253130_0    conda-forge
bzip2                     1.0.8                h3422bc3_4    conda-forge
c-ares                    1.19.1               hb547adb_0    conda-forge
ca-certificates           2023.7.22            hf0a4a13_0    conda-forge
cachecontrol              0.13.1             pyhd8ed1ab_0    conda-forge
cachecontrol-with-filecache 0.13.1             pyhd8ed1ab_0    conda-forge
cachy                     0.3.0              pyhd8ed1ab_1    conda-forge
certifi                   2023.7.22          pyhd8ed1ab_0    conda-forge
cffi                      1.15.1          py310h2399d43_3    conda-forge
charset-normalizer        3.2.0              pyhd8ed1ab_0    conda-forge
click                     8.1.7           unix_pyh707e725_0    conda-forge
click-default-group       1.2.4              pyhd8ed1ab_0    conda-forge
clikit                    0.6.2              pyhd8ed1ab_2    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
conda                     23.9.0          py310hbe9552e_0    conda-forge
conda-libmamba-solver     23.9.2             pyhd8ed1ab_0    conda-forge
conda-lock                2.4.2              pyhd8ed1ab_0    conda-forge
conda-package-handling    2.2.0              pyh38be061_0    conda-forge
conda-package-streaming   0.9.0              pyhd8ed1ab_0    conda-forge
crashtest                 0.4.1              pyhd8ed1ab_0    conda-forge
cryptography              41.0.3          py310hdd3b5e7_0    conda-forge
distlib                   0.3.7              pyhd8ed1ab_0    conda-forge
ensureconda               1.4.3              pyhd8ed1ab_0    conda-forge
filelock                  3.13.1             pyhd8ed1ab_0    conda-forge
fmt                       10.1.1               h1995070_0    conda-forge
gitdb                     4.0.11             pyhd8ed1ab_0    conda-forge
gitpython                 3.1.40             pyhd8ed1ab_0    conda-forge
html5lib                  1.1                pyh9f0ad1d_0    conda-forge
icu                       73.2                 hc8870d7_0    conda-forge
idna                      3.4                pyhd8ed1ab_0    conda-forge
importlib-metadata        6.8.0              pyha770c72_0    conda-forge
importlib_metadata        6.8.0                hd8ed1ab_0    conda-forge
jaraco.classes            3.3.0              pyhd8ed1ab_0    conda-forge
jinja2                    3.1.2              pyhd8ed1ab_1    conda-forge
jsonpatch                 1.32               pyhd8ed1ab_0    conda-forge
jsonpointer               2.0                        py_0    conda-forge
keyring                   24.2.0          py310hbe9552e_1    conda-forge
krb5                      1.21.2               h92f50d5_0    conda-forge
libarchive                3.7.2                h82b9b87_0    conda-forge
libcurl                   8.4.0                h2d989ff_0    conda-forge
libcxx                    16.0.6               h4653b0c_0    conda-forge
libedit                   3.1.20191231         hc8eb9b7_2    conda-forge
libev                     4.33                 h642e427_1    conda-forge
libffi                    3.4.2                h3422bc3_5    conda-forge
libiconv                  1.17                 he4db4b2_0    conda-forge
libmamba                  1.5.3                h0a6dc31_1    conda-forge
libmambapy                1.5.3           py310h3812fd7_1    conda-forge
libnghttp2                1.52.0               hae82a92_0    conda-forge
libsolv                   0.7.24               ha614eb4_3    conda-forge
libsqlite                 3.43.0               hb31c410_0    conda-forge
libssh2                   1.11.0               h7a5bd25_0    conda-forge
libxml2                   2.11.5               h25269f3_1    conda-forge
libzlib                   1.2.13               h53f4e23_5    conda-forge
lz4-c                     1.9.4                hb7217d7_0    conda-forge
lzo                       2.10              h642e427_1000    conda-forge
mamba                     1.5.3           py310ha5d4528_1    conda-forge
markupsafe                2.1.3           py310h2aa6e3c_1    conda-forge
more-itertools            10.1.0             pyhd8ed1ab_0    conda-forge
msgpack-python            1.0.6           py310h38f39d4_0    conda-forge
ncurses                   6.4                  h7ea286d_0    conda-forge
openssl                   3.1.4                h0d3ecfb_0    conda-forge
packaging                 23.1               pyhd8ed1ab_0    conda-forge
pastel                    0.2.1              pyhd8ed1ab_0    conda-forge
pip                       23.2.1             pyhd8ed1ab_0    conda-forge
pkginfo                   1.9.6              pyhd8ed1ab_0    conda-forge
platformdirs              3.11.0             pyhd8ed1ab_0    conda-forge
pluggy                    1.3.0              pyhd8ed1ab_0    conda-forge
pybind11-abi              4                    hd8ed1ab_3    conda-forge
pycosat                   0.6.4           py310h8e9501a_1    conda-forge
pycparser                 2.21               pyhd8ed1ab_0    conda-forge
pydantic                  2.4.2              pyhd8ed1ab_1    conda-forge
pydantic-core             2.10.1          py310had9acf8_0    conda-forge
pylev                     1.4.0              pyhd8ed1ab_0    conda-forge
pyopenssl                 23.2.0             pyhd8ed1ab_1    conda-forge
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
python                    3.10.12         h01493a6_0_cpython    conda-forge
python_abi                3.10                    3_cp310    conda-forge
pyyaml                    6.0.1           py310h2aa6e3c_1    conda-forge
readline                  8.2                  h92ec313_1    conda-forge
reproc                    14.2.4               h1a8c8d9_0    conda-forge
reproc-cpp                14.2.4               hb7217d7_0    conda-forge
requests                  2.31.0             pyhd8ed1ab_0    conda-forge
ruamel.yaml               0.17.32         py310h2aa6e3c_0    conda-forge
ruamel.yaml.clib          0.2.7           py310h8e9501a_1    conda-forge
setuptools                68.1.2             pyhd8ed1ab_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
smmap                     5.0.0              pyhd8ed1ab_0    conda-forge
tk                        8.6.12               he1e0b03_0    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
tomlkit                   0.12.2             pyha770c72_0    conda-forge
toolz                     0.12.0             pyhd8ed1ab_0    conda-forge
tqdm                      4.66.1             pyhd8ed1ab_0    conda-forge
truststore                0.8.0              pyhd8ed1ab_0    conda-forge
typing-extensions         4.8.0                hd8ed1ab_0    conda-forge
typing_extensions         4.8.0              pyha770c72_0    conda-forge
tzdata                    2023c                h71feb2d_0    conda-forge
urllib3                   1.26.18            pyhd8ed1ab_0    conda-forge
virtualenv                20.24.6            pyhd8ed1ab_0    conda-forge
webencodings              0.5.1              pyhd8ed1ab_2    conda-forge
wheel                     0.41.2             pyhd8ed1ab_0    conda-forge
xz                        5.2.6                h57fd34a_0    conda-forge
yaml                      0.2.5                h3422bc3_2    conda-forge
yaml-cpp                  0.8.0                h13dd4ca_0    conda-forge
zipp                      3.17.0             pyhd8ed1ab_0    conda-forge
zstandard                 0.19.0          py310h8e9501a_0    conda-forge
zstd                      1.5.5                h4f39d0f_0    conda-forge

Environment info

active environment : base
    active env location : /Users/zane/miniforge3
            shell level : 1
       user config file : /Users/zane/.condarc
 populated config files : /Users/zane/miniforge3/.condarc
                          /Users/zane/.condarc
          conda version : 23.9.0
    conda-build version : not installed
         python version : 3.10.12.final.0
       virtual packages : __archspec=1=arm64
                          __osx=13.6=0
                          __unix=0=0
       base environment : /Users/zane/miniforge3  (writable)
      conda av data dir : /Users/zane/miniforge3/etc/conda
  conda av metadata url : None
           channel URLs : https://conda.anaconda.org/conda-forge/osx-arm64
                          https://conda.anaconda.org/conda-forge/noarch
                          https://repo.anaconda.com/pkgs/main/osx-arm64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/osx-arm64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /Users/zane/miniforge3/pkgs
                          /Users/zane/.conda/pkgs
       envs directories : /Users/zane/miniforge3/envs
                          /Users/zane/.conda/envs
               platform : osx-arm64
             user-agent : conda/23.9.0 requests/2.31.0 CPython/3.10.12 Darwin/22.6.0 OSX/13.6
                UID:GID : 1000:20
             netrc file : None
           offline mode : False

conda-forge / dagster-feedstock Goto Github PK

dagster-feedstock's Introduction

About dagster-feedstock

About dagster

About dagster-pipes

About dagster

About dagster-airflow

About dagster-graphql

About dagster-webserver

About dagit

Current build status

Current release info

Installing dagster

About conda-forge

Terminology

Updating dagster-feedstock

Feedstock Maintainers

dagster-feedstock's People

Contributors

Stargazers

Watchers

Forkers

dagster-feedstock's Issues

Additional comment:

Additional comment:

Solution to issue cannot be found in the documentation.

Issue

Installed packages

Environment info

Additional comment:

Additional comment:

Additional comment:

Additional comment:

Comment:

Additional comment:

Additional comment:

Additional comment:

Solution to issue cannot be found in the documentation.

Issue

Installed packages

Environment info

Recommend Projects

Recommend Topics

Recommend Org