conda-forge / pandas-feedstock Goto Github PK
View Code? Open in Web Editor NEWA conda-smithy repository for pandas.
License: BSD 3-Clause "New" or "Revised" License
A conda-smithy repository for pandas.
License: BSD 3-Clause "New" or "Revised" License
It is currently possible to install incompatible pytz
/python-dateutil
dependencies, for example using: conda create -n test "pandas==1.4.2" "pytz<2020.1"
For how to do this, see: https://conda-forge.org/docs/maintainer/updating_pkgs.html#removing-broken-packages
bzip2 conda-forge/osx-64::bzip2-1.0.8-h0d85af4_4
ca-certificates conda-forge/osx-64::ca-certificates-2022.6.15-h033912b_0
libblas conda-forge/osx-64::libblas-3.9.0-15_osx64_openblas
libcblas conda-forge/osx-64::libcblas-3.9.0-15_osx64_openblas
libcxx conda-forge/osx-64::libcxx-14.0.6-hce7ea42_0
libffi conda-forge/osx-64::libffi-3.4.2-h0d85af4_5
libgfortran conda-forge/osx-64::libgfortran-5.0.0-9_3_0_h6c81a4c_23
libgfortran5 conda-forge/osx-64::libgfortran5-9.3.0-h6c81a4c_23
liblapack conda-forge/osx-64::liblapack-3.9.0-15_osx64_openblas
libopenblas conda-forge/osx-64::libopenblas-0.3.20-openmp_hb3cd9ec_0
libzlib conda-forge/osx-64::libzlib-1.2.12-hfe4f2af_1
llvm-openmp conda-forge/osx-64::llvm-openmp-14.0.4-ha654fa7_0
ncurses conda-forge/osx-64::ncurses-6.3-h96cf925_1
numpy conda-forge/osx-64::numpy-1.23.0-py310ha3f357c_0
openssl conda-forge/osx-64::openssl-3.0.5-hfe4f2af_0
pandas conda-forge/osx-64::pandas-1.4.2-py310h514ec25_1
pip conda-forge/noarch::pip-22.1.2-pyhd8ed1ab_0
python conda-forge/osx-64::python-3.10.5-hdd68b96_0_cpython
python-dateutil conda-forge/noarch::python-dateutil-2.8.2-pyhd8ed1ab_0
python_abi conda-forge/osx-64::python_abi-3.10-2_cp310
pytz conda-forge/noarch::pytz-2019.3-py_0
readline conda-forge/osx-64::readline-8.1.2-h3899abd_0
setuptools conda-forge/osx-64::setuptools-63.1.0-py310h2ec42d9_0
six conda-forge/noarch::six-1.16.0-pyh6c4a22f_0
sqlite conda-forge/osx-64::sqlite-3.39.0-hd9f0692_0
tk conda-forge/osx-64::tk-8.6.12-h5dbffcc_0
tzdata conda-forge/noarch::tzdata-2022a-h191b570_0
wheel conda-forge/noarch::wheel-0.37.1-pyhd8ed1ab_0
xz conda-forge/osx-64::xz-5.2.5-haf1e3a3_1
zlib conda-forge/osx-64::zlib-1.2.12-hfe4f2af_1
active environment : base
active env location : /Users/chrisjsewell/opt/miniconda3
shell level : 1
user config file : /Users/chrisjsewell/.condarc
populated config files : /Users/chrisjsewell/.condarc
conda version : 4.13.0
conda-build version : 3.21.9
python version : 3.8.13.final.0
virtual packages : __osx=10.15.7=0
__unix=0=0
__archspec=1=x86_64
base environment : /Users/chrisjsewell/opt/miniconda3 (writable)
conda av data dir : /Users/chrisjsewell/opt/miniconda3/etc/conda
conda av metadata url : None
channel URLs : https://conda.anaconda.org/conda-forge/osx-64
https://conda.anaconda.org/conda-forge/noarch
https://repo.anaconda.com/pkgs/main/osx-64
https://repo.anaconda.com/pkgs/main/noarch
https://repo.anaconda.com/pkgs/r/osx-64
https://repo.anaconda.com/pkgs/r/noarch
package cache : /Users/chrisjsewell/opt/miniconda3/pkgs
/Users/chrisjsewell/.conda/pkgs
envs directories : /Users/chrisjsewell/opt/miniconda3/envs
/Users/chrisjsewell/.conda/envs
platform : osx-64
user-agent : conda/4.13.0 requests/2.28.1 CPython/3.8.13 Darwin/19.6.0 OSX/10.15.7
UID:GID : 501:20
netrc file : None
offline mode : False
With Python 3.11 now available from conda-forge, pandas dependencies should be updated to include compatibility with it.
# packages in environment at c:\Users\user\Miniconda3\envs\py311:
#
# Name Version Build Channel
bzip2 1.0.8 h8ffe710_4 conda-forge
ca-certificates 2022.9.24 h5b45459_0 conda-forge
libffi 3.4.2 h8ffe710_5 conda-forge
libsqlite 3.39.4 hcfcfb64_0 conda-forge
libzlib 1.2.13 hcfcfb64_4 conda-forge
openssl 3.0.5 hcfcfb64_2 conda-forge
pip 22.3 pyhd8ed1ab_0 conda-forge
python 3.11.0 hcf16a7b_0_cpython conda-forge
setuptools 65.5.0 pyhd8ed1ab_0 conda-forge
tk 8.6.12 h8ffe710_0 conda-forge
tzdata 2022e h191b570_0 conda-forge
ucrt 10.0.22621.0 h57928b3_0 conda-forge
vc 14.3 h3d8a991_9 conda-forge
vs2015_runtime 14.32.31332 h1d6e394_9 conda-forge
wheel 0.37.1 pyhd8ed1ab_0 conda-forge
xz 5.2.6 h8d14728_0 conda-forge
active environment : py311
active env location : c:\Users\user\Miniconda3\envs\py311
shell level : 2
user config file : C:\Users\user\.condarc
populated config files : C:\Users\user\.condarc
conda version : 22.9.0
conda-build version : not installed
python version : 3.9.13.final.0
virtual packages : __win=0=0
__archspec=1=x86_64
base environment : c:\Users\user\Miniconda3 (writable)
conda av data dir : c:\Users\user\Miniconda3\etc\conda
conda av metadata url : None
channel URLs : https://conda.anaconda.org/conda-forge/win-64
https://conda.anaconda.org/conda-forge/noarch
https://repo.anaconda.com/pkgs/main/win-64
https://repo.anaconda.com/pkgs/main/noarch
https://repo.anaconda.com/pkgs/r/win-64
https://repo.anaconda.com/pkgs/r/noarch
https://repo.anaconda.com/pkgs/msys2/win-64
https://repo.anaconda.com/pkgs/msys2/noarch
package cache : c:\Users\user\Miniconda3\pkgs
C:\Users\user\.conda\pkgs
C:\Users\user\AppData\Local\conda\conda\pkgs
envs directories : c:\Users\user\Miniconda3\envs
C:\Users\user\.conda\envs
C:\Users\user\AppData\Local\conda\conda\envs
platform : win-64
user-agent : conda/22.9.0 requests/2.28.1 CPython/3.9.13 Windows/10 Windows/10.0.19044
administrator : False
netrc file : None
offline mode : False
xref: conda-forge/climlab-feedstock#63
xref: #88
xref: #129
Are we building for pypy or are waiting for pypy38 to renable it? I don't see pypy in #129
https://travis-ci.org/conda-forge/pandas-feedstock/builds/186561914
End of log says (https://travis-ci.org/conda-forge/pandas-feedstock/jobs/186561921):
creating build/temp.macosx-10.7-x86_64-3.6/pandas
gcc -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -arch x86_64 -Ipandas/src/klib -Ipandas/src -I/Users/travis/miniconda3/envs/_build_placehold_placehold_placehold_placehold_pla/lib/python3.6/site-packages/numpy/core/include -I/Users/travis/miniconda3/envs/_build_placehold_placehold_placehold_placehold_pla/include/python3.6m -c pandas/lib.c -o build/temp.macosx-10.7-x86_64-3.6/pandas/lib.o -Wno-unused-function
error: $MACOSX_DEPLOYMENT_TARGET mismatch: now "10.6" but "10.7" during configure
Command failed: /bin/bash -x -e /Users/travis/miniconda3/conda-bld/work/pandas-0.19.2/conda_build.sh
No response
What needs to be done to rebuild this for Python 3.10?
As far as I can tell, all of the dependencies from the recipe have been rebuilt already (or are agnostic). However, those rebuilds were triggered automatically, e.g. conda-forge/numpy-feedstock#245 and conda-forge/cython-feedstock#80. Is it just a matter of waiting until @regro-cf-autotick-bot decides to trigger it?
https://conda-forge.org/status/#python310 lists it as unsolvable, which seems odd given the above.
pandas (450) Error: not solvable (bot CI job): master: [
'linux_64_numpy1.21python3.10.____cpython: Encountered problems while solving:\n - package cython-0.29.17-py36he6710b0_0 requires python >=3.6,<3.7.0a0, but none of the providers can be installed\n',
'linux_aarch64_numpy1.21python3.10.____cpython: Encountered problems while solving:\n - nothing provides openssl >=1.0.2p,<1.0.3a needed by python-3.7.1-hd75c258_1001\n',
'linux_ppc64le_numpy1.21python3.10.____cpython: Encountered problems while solving:\n - package cython-0.29.17-py36he6710b0_0 requires python >=3.6,<3.7.0a0, but none of the providers can be installed\n',
'osx_64_numpy1.21python3.10.____cpython: Encountered problems while solving:\n - package cython-0.29.17-py36h0a44026_0 requires python >=3.6,<3.7.0a0, but none of the providers can be installed\n',
'osx_arm64_numpy1.21python3.10.____cpython: Encountered problems while solving:\n - package cython-0.29.23-py38hc4ed4cf_0 requires python >=3.8,<3.9.0a0, but none of the providers can be installed\n',
'win_64_numpy1.21python3.10.____cpython: Encountered problems while solving:\n - package cython-0.29.17-py36ha925a31_0 requires python >=3.6,<3.7.0a0, but none of the providers can be installed\n'
]
I'm not complaining. I'm just trying to understand what the process is.
NumPy 2.0.0 is in the process of being released (currently on 2.0.0rc1) with a number of changes ( numpy/numpy#24300 ). Most notably the way we build with NumPy may need changes. This will involve building with the latest NumPy and then configuring builds to support older NumPy versions (and validating binaries target the intended NumPy version)
There is some discussion about this in issue ( conda-forge/numpy-feedstock#311 ) along with details on how to test builds with NumPy 2.0.0rc1. The next step to take here would be to try building the Pandas packages with NumPy 2.0.0rc1
Not sure what the state of Pandas support for NumPy 2 is (and whether we need an RC or new fixes). So getting a better idea on what is still needed on the Pandas side would help
In #86 the pypy build failed, possibly on the numpy selector
failed to parse packages from exception: The following specifications were found to be incompatible with each other:
Output in format: Requested package -> Available versions
Package certifi conflicts for:
pip -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
cython[version='>=0.29.16'] -> setuptools -> certifi[version='>=2016.09|>=2016.9.26']
Package expat conflicts for:
python=3.6[build=*_73_pypy] -> pypy3.6=7.3.1 -> expat[version='>=2.2.9,<2.3.0a0']
cython[version='>=0.29.16'] -> pypy3.6[version='>=7.3.1'] -> expat[version='>=2.2.9,<2.3.0a0']
Package readline conflicts for:
pip -> python[version='>=3'] -> readline[version='6.2.*|7.0|>=7.0,<8.0a0|>=8.0,<9.0a0|7.*|7.0.*']
numpy=1.15.4 -> python[version='>=3.7,<3.8.0a0'] -> readline[version='6.2.*|7.0|>=7.0,<8.0a0|>=8.0,<9.0a0|7.*|7.0.*']
cython[version='>=0.29.16'] -> python[version='>=3.6,<3.7.0a0'] -> readline[version='6.2.*|7.0|>=7.0,<8.0a0|>=8.0,<9.0a0|7.*']
Package ca-certificates conflicts for:
pip -> python -> ca-certificates
numpy=1.15.4 -> python[version='>=2.7,<2.8.0a0'] -> ca-certificates
Package python conflicts for:
numpy=1.15.4 -> python[version='>=2.7,<2.8.0a0|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0']
python=3.6[build=*_73_pypy]
cython[version='>=0.29.16'] -> python[version='>=3.6,<3.7.0a0|>=3.8,<3.9.0a0|>=3.7,<3.8.0a0']
numpy=1.15.4 -> mkl_fft[version='>=1.0.6,<2.0a0'] -> python[version='2.7.*|3.5.*|3.6.*|>=3.8,<3.9.0a0|>=3.5,<3.6.0a0']
cython[version='>=0.29.16'] -> python_abi=3.6[build=*_cp36m] -> python[version='2.7.*|3.5.*|3.6.*|3.8.*|3.7.*|>=2.7,<2.8.0a0|>=3.5,<3.6.0a0|3.4.*']
pip -> python[version='2.7.*|3.5.*|3.6.*|>=2.7,<2.8.0a0|>=3|>=3.6,<3.7.0a0|>=3.7,<3.8.0a0|>=3.8,<3.9.0a0|>=3.5,<3.6.0a0|3.4.*']
Package libcxx conflicts for:
cython[version='>=0.29.16'] -> python[version='>=3.6,<3.7.0a0'] -> libcxx[version='>=10.0.1|>=9.0.0']
numpy=1.15.4 -> python[version='>=3.7,<3.8.0a0'] -> libcxx[version='>=10.0.0|>=9.0.1|>=9.0.0|>=10.0.1']
cython[version='>=0.29.16'] -> libcxx[version='>=10.0.0|>=9.0.1|>=4.0.1']
numpy=1.15.4 -> libcxx[version='>=4.0.1']
pip -> python[version='>=3'] -> libcxx[version='>=10.0.0|>=10.0.1|>=9.0.1|>=9.0.0|>=4.0.1']
libcxx[version='>=10.0.1']
Package libcxxabi conflicts for:
numpy=1.15.4 -> libcxx[version='>=4.0.1'] -> libcxxabi[version='4.0.1|4.0.1|8.0.0|8.0.0|8.0.0|8.0.0|8.0.1',build='hebd6815_0|3|4|0|2|1|hcfea43d_1']
cython[version='>=0.29.16'] -> libcxx[version='>=4.0.1'] -> libcxxabi[version='4.0.1|4.0.1|8.0.0|8.0.0|8.0.0|8.0.0|8.0.1',build='hebd6815_0|3|4|0|2|1|hcfea43d_1']
Note that strict channel priority may have removed packages required for satisfiability.
Issue:
Applying dropna/isna functions to DataFrame/Series. I've noted when the column is type 'object' it works properly.
Example:
df = pd.DataFrame([np.nan, 7, 5.5])
df.isna()
I get as result:
False
False
False
Example2:
df = pd.DataFrame([np.nan, 7, 5.5])
df.dropna()
I get as result the same DataFrame/Series:
Nan
7.0
5.5
No response
Seeing
Traceback (most recent call last):
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/test_tmp/run_test.py", line 2, in <module>
import arch
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/__init__.py", line 2, in <module>
from .univariate.mean import arch_model
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/univariate/__init__.py", line 5, in <module>
from arch.univariate import recursions_python
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/univariate/recursions_python.py", line 9, in <module>
from arch.compat.numba import jit
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/compat/numba.py", line 5, in <module>
from arch.utility.exceptions import PerformanceWarning
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/utility/__init__.py", line 5, in <module>
from arch.utility.cov import cov_nw
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/utility/cov.py", line 5, in <module>
from arch.typing import Float64Array
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/arch/typing.py", line 8, in <module>
from pandas import DataFrame, Series, Timestamp
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/pandas/__init__.py", line 22, in <module>
from pandas.compat import is_numpy_dev as _is_numpy_dev # pyright: ignore # noqa:F401
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/pandas/compat/__init__.py", line 25, in <module>
from pandas.compat.numpy import (
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/pandas/compat/numpy/__init__.py", line 4, in <module>
from pandas.util.version import Version
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/pandas/util/__init__.py", line 2, in <module>
from pandas.util._decorators import ( # noqa:F401
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/pandas/util/_decorators.py", line 14, in <module>
from pandas._libs.properties import cache_readonly
File "/Users/runner/miniforge3/conda-bld/arch-py_1695814679546/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeh/lib/pypy3.9/site-packages/pandas/_libs/__init__.py", line 13, in <module>
from pandas._libs.interval import Interval
TypeError: type 'cython_function_or_method' is not an acceptable base type
when importing pandas. THis has affected the statsmodels feedstock and arch-py feedstock.
libffi: 3.4.2-h8ffe710_5 conda-forge
libhwloc: 2.9.3-default_haede6df_1009 conda-forge
libiconv: 1.17-h8ffe710_0 conda-forge
liblapack: 3.9.0-18_win64_mkl conda-forge
libsqlite: 3.43.0-hcfcfb64_0 conda-forge
libxml2: 2.11.5-hc3477c8_1 conda-forge
libzlib: 1.2.13-hcfcfb64_5 conda-forge
m2w64-gcc-libgfortran: 5.3.0-6 conda-forge
m2w64-gcc-libs: 5.3.0-7 conda-forge
m2w64-gcc-libs-core: 5.3.0-7 conda-forge
m2w64-gmp: 6.1.0-2 conda-forge
m2w64-libwinpthread-git: 5.0.0.4634.697f757-2 conda-forge
mkl: 2022.1.0-h6a75c08_874 conda-forge
msys2-conda-epoch: 20160418-1 conda-forge
numpy: 1.25.2-py39h821adfb_0 conda-forge
openssl: 3.1.3-hcfcfb64_0 conda-forge
packaging: 23.1-pyhd8ed1ab_0 conda-forge
pandas: 2.0.3-py39haf6a60e_1 conda-forge
patsy: 0.5.3-pyhd8ed1ab_0 conda-forge
pip: 23.2.1-pyhd8ed1ab_0 conda-forge
platformdirs: 3.10.0-pyhd8ed1ab_0 conda-forge
pooch: 1.7.0-pyha770c72_3 conda-forge
pthreads-win32: 2.9.1-hfa6e2cd_3 conda-forge
pypy3.9: 7.3.12-h994e1e7_5 conda-forge
pysocks: 1.7.1-pyh0701188_6 conda-forge
python: 3.9.17-0_73_pypy conda-forge
python-dateutil: 2.8.2-pyhd8ed1ab_0 conda-forge
python-tzdata: 2023.3-pyhd8ed1ab_0 conda-forge
python_abi: 3.9-4_pypy39_pp73 conda-forge
pytz: 2023.3.post1-pyhd8ed1ab_0 conda-forge
requests: 2.31.0-pyhd8ed1ab_0 conda-forge
scipy: 1.11.2-py39hbf2a3dc_0 conda-forge
setuptools: 68.2.2-pyhd8ed1ab_0 conda-forge
six: 1.16.0-pyh6c4a22f_0 conda-forge
sqlite: 3.43.0-hcfcfb64_0 conda-forge
statsmodels: 0.14.0-py39hea5744f_1 conda-forge
tbb: 2021.10.0-h91493d7_1 conda-forge
tk: 8.6.13-hcfcfb64_0 conda-forge
typing-extensions: 4.8.0-hd8ed1ab_0 conda-forge
typing_extensions: 4.8.0-pyha770c72_0 conda-forge
tzdata: 2023c-h71feb2d_0 conda-forge
ucrt: 10.0.22621.0-h57928b3_0 conda-forge
urllib3: 2.0.5-pyhd8ed1ab_0 conda-forge
vc: 14.3-h64f974e_17 conda-forge
vc14_runtime: 14.36.32532-hdcecf7f_17 conda-forge
vs2015_runtime: 14.36.32532-h05e6639_17 conda-forge
wheel: 0.41.2-pyhd8ed1ab_0 conda-forge
win_inet_pton: 1.1.0-pyhd8ed1ab_6 conda-forge
xz: 5.2.6-h8d14728_0 conda-forge
zlib: 1.2.13-hcfcfb64_5 conda-forge
### Environment info
```shell
Log example here:
https://dev.azure.com/conda-forge/feedstock-builds/_build/results?buildId=789882&view=logs&jobId=5be07ae1-d8ba-5406-47b6-8e3a3a12f825&j=5be07ae1-d8ba-5406-47b6-8e3a3a12f825&t=c94d5231-acfc-5e67-dafc-77bdd383ead4
Issue:
I would except conda install -c conda-forge pandas
to install the latest release that is not a beta, alpha, rc, etc. Currently 0.24.0rc1 gets installed into my environment and seems to have some breaking features.
conda list
):
$ conda list
moorepants@garuda:teamo(master)$ conda list pandas
# packages in environment at /home/moorepants/miniconda3:
#
# Name Version Build Channel
pandas 0.24.0rc1 py36hfc679d8_0 conda-forge
conda
and system ( conda info
):
$ conda info
moorepants@garuda:teamo(master)$ conda info
active environment : None
user config file : /home/moorepants/.condarc
populated config files : /home/moorepants/.condarc
conda version : 4.5.12
conda-build version : 3.16.3
python version : 3.6.7.final.0
base environment : /home/moorepants/miniconda3 (writable)
channel URLs : https://conda.anaconda.org/conda-forge/linux-64
https://conda.anaconda.org/conda-forge/noarch
http://repo.continuum.io/pkgs/free/linux-64
http://repo.continuum.io/pkgs/free/noarch
https://conda.anaconda.org/pydy/linux-64
https://conda.anaconda.org/pydy/noarch
https://conda.anaconda.org/moorepants/linux-64
https://conda.anaconda.org/moorepants/noarch
package cache : /home/moorepants/miniconda3/pkgs
/home/moorepants/.conda/pkgs
envs directories : /home/moorepants/miniconda3/envs
/home/moorepants/.conda/envs
platform : linux-64
user-agent : conda/4.5.12 requests/2.21.0 CPython/3.6.7 Linux/4.15.0-43-generic ubuntu/18.04 glibc/2.27
UID:GID : 1000:1000
netrc file : /home/moorepants/.netrc
offline mode : False
No response
Issue:
In updating another package, conda bumped me up to pandas 0.23. However, when running code, I get this error:
ImportError in line 27 of /data/jmeppley/projects/Aloha_2_0/workflows/annotation.gene_catalog.snake:
dateutil 2.5.0 is the minimum required version
File "/data/jmeppley/projects/Aloha_2_0/workflows/annotation.gene_catalog.snake", line 27, in <module>
File "/data/jmeppley/projects/Aloha_2_0/catalog/conda.env/lib/python3.5/site-packages/pandas/__init__.py", line 23, in <module>
File "/data/jmeppley/projects/Aloha_2_0/catalog/conda.env/lib/python3.5/site-packages/pandas/compat/__init__.py", line 421, in <module>
Explicitly updating python-dateutil solved my problem. Should we add the requirement to the latest recipe?
==> WARNING: A newer version of conda exists. <==
current version: 4.5.9
latest version: 4.5.11
Please update conda by running
$ conda update -n base -c defaults conda
environment location: /home/jmeppley/projects/Aloha_2_0/catalog/conda.env
added / updated specs:
- numpy=1.12
- pandas=0.22
- py-metagenomics=1.1.1
The following packages will be downloaded:
package | build
---------------------------|-----------------
openblas-0.2.20 | 8 17.0 MB conda-forge
numpy-base-1.14.3 | py35h0ea5e3f_1 4.0 MB
numpy-1.12.1 |py35_blas_openblas_201 8.5 MB conda-forge
------------------------------------------------------------
Total: 29.5 MB
The following NEW packages will be INSTALLED:
libgfortran: 3.0.0-1 conda-forge
libopenblas: 0.2.20-h9ac9557_7
openblas: 0.2.20-8 conda-forge
The following packages will be UPDATED:
biopython: 1.70-np112py35_1 bioconda --> 1.72-py35_0 conda-forge
ca-certificates: 2018.1.18-0 conda-forge --> 2018.8.24-ha4d7672_0 conda-forge
certifi: 2018.1.18-py35_0 conda-forge --> 2018.8.24-py35_1 conda-forge
numpy: 1.12.1-py35hca0bb5e_1 --> 1.14.3-py35hcd700cb_1
openssl: 1.0.2o-0 conda-forge --> 1.0.2p-h470a237_0 conda-forge
pandas: 0.22.0-py35_0 conda-forge --> 0.23.0-py35_0 conda-forge
py-metagenomics: 1.0.0-py35_0 jmeppley --> 1.1.1-py35_0 jmeppley
Proceed ([y]/n)? y
Downloading and Extracting Packages
biopython-1.72 | 2.8 MB | ############################################################################################################################ | 100%
mkl_fft-1.0.6 | 574 KB | ############################################################################################################################ | 100%
certifi-2018.8.24 | 138 KB | ############################################################################################################################ | 100%
pandas-0.23.0 | 28.9 MB | ############################################################################################################################ | 100%
py-metagenomics-1.1. | 232 KB | ############################################################################################################################ | 100%
numpy-1.14.3 | 41 KB | ############################################################################################################################ | 100%
numpy-base-1.14.3 | 4.1 MB | ############################################################################################################################ | 100%
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
(/home/jmeppley/projects/Aloha_2_0/catalog/conda.env) [jmeppley@glutamate catalog]$ conda list | grep date
python-dateutil 2.3 py35_0 bioconda
</details>
<br/>
Simple Environment to reproduce:
I was able to reproduce the error by explicilty installing mismatched packages with:
conda create -n brokepanda -c conda-forge pandas "python-dateutil<2.5"
<details>
Packages installed:
. . .
The following NEW packages will be INSTALLED:
blas: 1.0-mkl
bzip2: 1.0.6-h470a237_2 conda-forge
ca-certificates: 2018.8.24-ha4d7672_0 conda-forge
certifi: 2018.8.24-py35_1 conda-forge
intel-openmp: 2019.0-118
libffi: 3.2.1-hfc679d8_5 conda-forge
libgcc-ng: 7.2.0-hdf63c60_3 conda-forge
libgfortran-ng: 7.2.0-hdf63c60_3 conda-forge
libstdcxx-ng: 7.2.0-hdf63c60_3 conda-forge
mkl: 2019.0-118
mkl_fft: 1.0.6-py35_0 conda-forge
mkl_random: 1.0.1-py35_0 conda-forge
ncurses: 6.1-hfc679d8_1 conda-forge
numpy: 1.15.0-py35h1b885b7_0
numpy-base: 1.15.0-py35h3dfced4_0
openssl: 1.0.2p-h470a237_0 conda-forge
pandas: 0.23.0-py35_0 conda-forge
pip: 18.0-py35_1 conda-forge
python: 3.5.5-h5001a0f_2 conda-forge
python-dateutil: 2.4.2-py35_0
pytz: 2018.5-py_0 conda-forge
readline: 7.0-haf1bffa_1 conda-forge
setuptools: 40.4.0-py35_0 conda-forge
six: 1.11.0-py35_1 conda-forge
sqlite: 3.25.1-hb1c47c0_0 conda-forge
tk: 8.6.8-ha92aebf_0 conda-forge
wheel: 0.31.1-py35_1 conda-forge
xz: 5.2.4-h470a237_1 conda-forge
zlib: 1.2.11-h470a237_3 conda-forge
. . .
Getting the error:
(brokepanda) [jmeppley@glutamate ~]$ python
Python 3.5.5 | packaged by conda-forge | (default, Jul 23 2018, 23:45:43)
[GCC 4.8.2 20140120 (Red Hat 4.8.2-15)] on linux
Type "help", "copyright", "credits" or "license" for more information.
import pandas
Traceback (most recent call last):
File "", line 1, in
File "/home/jmeppley/.conda/envs/brokepanda/lib/python3.5/site-packages/pandas/init.py", line 23, in
from pandas.compat.numpy import *
File "/home/jmeppley/.conda/envs/brokepanda/lib/python3.5/site-packages/pandas/compat/init.py", line 421, in
raise ImportError('dateutil 2.5.0 is the minimum required version')
ImportError: dateutil 2.5.0 is the minimum required version
</details>
<br/>
Details about <code>conda</code> and system ( <code>conda info</code> ):
<details>
$ conda info
active environment : /home/jmeppley/projects/Aloha_2_0/catalog/conda.env
active env location : /home/jmeppley/projects/Aloha_2_0/catalog/conda.env
shell level : 1
user config file : /home/jmeppley/.condarc
populated config files :
conda version : 4.5.9
conda-build version : not installed
python version : 3.6.4.final.0
base environment : /data/jmeppley/miniconda3 (writable)
channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
https://repo.anaconda.com/pkgs/main/noarch
https://repo.anaconda.com/pkgs/free/linux-64
https://repo.anaconda.com/pkgs/free/noarch
https://repo.anaconda.com/pkgs/r/linux-64
https://repo.anaconda.com/pkgs/r/noarch
https://repo.anaconda.com/pkgs/pro/linux-64
https://repo.anaconda.com/pkgs/pro/noarch
package cache : /data/jmeppley/miniconda3/pkgs
/home/jmeppley/.conda/pkgs
envs directories : /data/jmeppley/miniconda3/envs
/home/jmeppley/.conda/envs
platform : linux-64
user-agent : conda/4.5.9 requests/2.18.4 CPython/3.6.4 Linux/4.8.13-100.fc23.x86_64 fedora/23 glibc/2.22
UID:GID : 2000:520
netrc file : None
offline mode : False
</details>
It appears attempting to run the test suite on PyPy segfaults. See this CI build (also included the attached log for posterity). While this log is with Linux, this appears to happen on all OSes.
Hello!
I built a pandas environment from my miniconda via
conda create -n myenv pandas
using conda-forge
channel,
and the resulting environment isn't functional on my Linux x64 machine.
When I do the same using defaults
channel, I get a functional pandas environment.
I don't have the time to look into it myself, and just wanted to let you know that your feedstock is broken atm.
Best
Hi @conda-forge/pandas! This is the friendly automated conda-forge-webservice!
It appears that one or more of your feedstock's outputs did not copy from the
staging channel (cf-staging) to the production channel (conda-forge). :(
This failure can happen for a lot of reasons, including an outdated feedstock
token. Below we have put some information about the failure to help you debug it.
Rerendering the feedstock will usually fix these problems.
If you have any issues or questions, you can find us on gitter in the
community chat room or you can bump us right here.
error messages:
When trying to process meta.yaml using ruamel_yaml it shows a error. It can be suppressed now, but it will become a real error in future. If you want to use several sources you have to use a list like that:
source:
- url: <first url here>
sha256: <checksum for the url above>
- url: <second url here>
Otherwise YAML parsers raise DuplicatedKeyError or another exception with the same meaning.
Traceback (most recent call last):
File "/Users/runner/miniforge3/conda-bld/pandas_1693426048240/test_tmp/run_test.py", line 2, in <module>
import pandas
File "/Users/runner/miniforge3/conda-bld/pandas_1693426048240/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/pypy3.9/site-packages/pandas/__init__.py", line 46, in <module>
from pandas.core.api import (
File "/Users/runner/miniforge3/conda-bld/pandas_1693426048240/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/pypy3.9/site-packages/pandas/core/api.py", line 1, in <module>
from pandas._libs import (
File "/Users/runner/miniforge3/conda-bld/pandas_1693426048240/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placeho/lib/pypy3.9/site-packages/pandas/_libs/__init__.py", line 18, in <module>
from pandas._libs.interval import Interval
TypeError: type 'cython_function_or_method' is not an acceptable base type
Do I need Cython 3 for this to work?
(pandas is currently pinned to 0.29.36 since we have some perf regressions on Cython 3)
cc @mattip
Currently, installing pandas
doesn't constrain the versions of any of the 'optional-dependencies' specified in the project's metadata. This means its easy to find yourself in situations where importing pandas
results in warnings being emitted (slightly contrived example):
$ mamba create -n test pandas numexpr=2.7
$ conda activate test
$ python3 -c "import pandas"
/home/duncan/opt/mambaforge/envs/test/lib/python3.10/site-packages/numexpr/expressions.py:21: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
_np_version_forbids_neg_powint = LooseVersion(numpy.__version__) >= LooseVersion('1.12.0b1')
/home/duncan/opt/mambaforge/envs/test/lib/python3.10/site-packages/pandas/core/computation/expressions.py:21: UserWarning: Pandas requires version '2.8.0' or newer of 'numexpr' (version '2.7.3' currently installed).
from pandas.core.computation.check import NUMEXPR_INSTALLED
Is it reasonable to add requirements/run_constrained
to this recipe to map the version constraints for the optional dependencies?
I worry about the scope of this, given that there are ~35 optional dependencies, all with version constraints, and I don't want to burden the maintainers of this feedstock with more grunt work.
Seeing test failures on main
like the following (taken from this build also attached log):
<tests>/extension/test_sparse.py::TestReshaping::test_stack[0-columns0]
<tests>/extension/test_sparse.py::TestReshaping::test_stack[0-columns1]
<tests>/extension/test_sparse.py::TestMissing::test_fillna_limit_pad[0]
<tests>/extension/test_sparse.py::TestMissing::test_fillna_limit_backfill[0]
<tests>/extension/test_sparse.py::TestMissing::test_fillna_no_op_returns_copy[0]
<tests>/extension/test_sparse.py::TestMissing::test_fillna_series_method[0]
<tests>/frame/methods/test_sort_values.py::TestDataFrameSortValues::test_sort_values_sparse_no_warning[uint8]
<tests>/frame/methods/test_sort_values.py::TestDataFrameSortValues::test_sort_values_sparse_no_warning[bool]
<tests>/series/test_constructors.py::TestSeriesConstructors::test_constructor_signed_int_overflow_deprecation
Based on discussion offline with @mroeschke, these appear to be due to recent NumPy deprecations.
Note: This resulted in most of the CPython packages from PR ( #147 ) not being published.
Hey-lo,
Was just playing around with storing data in hdf, and got an error because pytables wasn't installed. Should it be included here as a dependency?
Specfically:
...
File "/opt/anaconda3/envs/my_env/lib/python2.7/site-packages/pandas/core/generic.py", line 1101, in to_hdf
return pytables.to_hdf(path_or_buf, key, self, **kwargs)
File "/opt/anaconda3/envs/my_env/lib/python2.7/site-packages/pandas/io/pytables.py", line 259, in to_hdf
complib=complib) as store:
File "/opt/anaconda3/envs/my_env/lib/python2.7/site-packages/pandas/io/pytables.py", line 389, in __init__
'importing'.format(ex=str(ex)))
ImportError: HDFStore requires PyTables, "No module named tables" problem importing
Seeing some mismatches in the Linux ppc64le
builds with test_rolling_var_numerical_issues
:
=================================== FAILURES ===================================
_______________ test_rolling_var_numerical_issues[var-1-values0] _______________
[gw1] linux -- Python 3.9.15 $PREFIX/bin/python
func = 'var', third_value = 1, values = [5e+33, 0, 0.5, 0.5, 2, 0]
@pytest.mark.xfail(is_platform_arm() and not is_platform_mac(), reason="GH 38921")
@pytest.mark.parametrize(
("func", "third_value", "values"),
[
("var", 1, [5e33, 0, 0.5, 0.5, 2, 0]),
("std", 1, [7.071068e16, 0, 0.7071068, 0.7071068, 1.414214, 0]),
("var", 2, [5e33, 0.5, 0, 0.5, 2, 0]),
("std", 2, [7.071068e16, 0.7071068, 0, 0.7071068, 1.414214, 0]),
],
)
def test_rolling_var_numerical_issues(func, third_value, values):
# GH: 37051
ds = Series([99999999999999999, 1, third_value, 2, 3, 1, 1])
result = getattr(ds.rolling(2), func)()
expected = Series([np.nan] + values)
> tm.assert_series_equal(result, expected)
$TEST_ENV/lib/python3.9/site-packages/pandas/tests/window/test_rolling.py:1209:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pandas/_libs/testing.pyx:52: in pandas._libs.testing.assert_almost_equal
???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> ???
E AssertionError: Series are different
E
E Series values are different (42.85714 %)
E [index]: [0, 1, 2, 3, 4, 5, 6]
E [left]: [nan, 5e+33, 0.0, -2.7212384506478592e+17, -2.7212384506478592e+17, -2.7212384506478592e+17, 0.0]
E [right]: [nan, 5e+33, 0.0, 0.5, 0.5, 2.0, 0.0]
pandas/_libs/testing.pyx:167: AssertionError
_______________ test_rolling_var_numerical_issues[std-1-values1] _______________
[gw1] linux -- Python 3.9.15 $PREFIX/bin/python
func = 'std', third_value = 1
values = [7.071068e+16, 0, 0.7071068, 0.7071068, 1.414214, 0]
@pytest.mark.xfail(is_platform_arm() and not is_platform_mac(), reason="GH 38921")
@pytest.mark.parametrize(
("func", "third_value", "values"),
[
("var", 1, [5e33, 0, 0.5, 0.5, 2, 0]),
("std", 1, [7.071068e16, 0, 0.7071068, 0.7071068, 1.414214, 0]),
("var", 2, [5e33, 0.5, 0, 0.5, 2, 0]),
("std", 2, [7.071068e16, 0.7071068, 0, 0.7071068, 1.414214, 0]),
],
)
def test_rolling_var_numerical_issues(func, third_value, values):
# GH: 37051
ds = Series([99999999999999999, 1, third_value, 2, 3, 1, 1])
result = getattr(ds.rolling(2), func)()
expected = Series([np.nan] + values)
> tm.assert_series_equal(result, expected)
$TEST_ENV/lib/python3.9/site-packages/pandas/tests/window/test_rolling.py:1209:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pandas/_libs/testing.pyx:52: in pandas._libs.testing.assert_almost_equal
???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> ???
E AssertionError: Series are different
E
E Series values are different (42.85714 %)
E [index]: [0, 1, 2, 3, 4, 5, 6]
E [left]: [nan, 7.071067811865475e+16, 0.0, 0.0, 0.0, 0.0, 0.0]
E [right]: [nan, 7.071068e+16, 0.0, 0.7071068, 0.7071068, 1.414214, 0.0]
pandas/_libs/testing.pyx:167: AssertionError
_______________ test_rolling_var_numerical_issues[var-2-values2] _______________
[gw1] linux -- Python 3.9.15 $PREFIX/bin/python
func = 'var', third_value = 2, values = [5e+33, 0.5, 0, 0.5, 2, 0]
@pytest.mark.xfail(is_platform_arm() and not is_platform_mac(), reason="GH 38921")
@pytest.mark.parametrize(
("func", "third_value", "values"),
[
("var", 1, [5e33, 0, 0.5, 0.5, 2, 0]),
("std", 1, [7.071068e16, 0, 0.7071068, 0.7071068, 1.414214, 0]),
("var", 2, [5e33, 0.5, 0, 0.5, 2, 0]),
("std", 2, [7.071068e16, 0.7071068, 0, 0.7071068, 1.414214, 0]),
],
)
def test_rolling_var_numerical_issues(func, third_value, values):
# GH: 37051
ds = Series([99999999999999999, 1, third_value, 2, 3, 1, 1])
result = getattr(ds.rolling(2), func)()
expected = Series([np.nan] + values)
> tm.assert_series_equal(result, expected)
$TEST_ENV/lib/python3.9/site-packages/pandas/tests/window/test_rolling.py:1209:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pandas/_libs/testing.pyx:52: in pandas._libs.testing.assert_almost_equal
???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> ???
E AssertionError: Series are different
E
E Series values are different (42.85714 %)
E [index]: [0, 1, 2, 3, 4, 5, 6]
E [left]: [nan, 5e+33, -2.7212384506478592e+17, 0.0, -2.7212384506478592e+17, -2.7212384506478592e+17, 0.0]
E [right]: [nan, 5e+33, 0.5, 0.0, 0.5, 2.0, 0.0]
pandas/_libs/testing.pyx:167: AssertionError
_______________ test_rolling_var_numerical_issues[std-2-values3] _______________
[gw1] linux -- Python 3.9.15 $PREFIX/bin/python
func = 'std', third_value = 2
values = [7.071068e+16, 0.7071068, 0, 0.7071068, 1.414214, 0]
@pytest.mark.xfail(is_platform_arm() and not is_platform_mac(), reason="GH 38921")
@pytest.mark.parametrize(
("func", "third_value", "values"),
[
("var", 1, [5e33, 0, 0.5, 0.5, 2, 0]),
("std", 1, [7.071068e16, 0, 0.7071068, 0.7071068, 1.414214, 0]),
("var", 2, [5e33, 0.5, 0, 0.5, 2, 0]),
("std", 2, [7.071068e16, 0.7071068, 0, 0.7071068, 1.414214, 0]),
],
)
def test_rolling_var_numerical_issues(func, third_value, values):
# GH: 37051
ds = Series([99999999999999999, 1, third_value, 2, 3, 1, 1])
result = getattr(ds.rolling(2), func)()
expected = Series([np.nan] + values)
> tm.assert_series_equal(result, expected)
$TEST_ENV/lib/python3.9/site-packages/pandas/tests/window/test_rolling.py:1209:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pandas/_libs/testing.pyx:52: in pandas._libs.testing.assert_almost_equal
???
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> ???
E AssertionError: Series are different
E
E Series values are different (42.85714 %)
E [index]: [0, 1, 2, 3, 4, 5, 6]
E [left]: [nan, 7.071067811865475e+16, 0.0, 0.0, 0.0, 0.0, 0.0]
E [right]: [nan, 7.071068e+16, 0.7071068, 0.0, 0.7071068, 1.414214, 0.0]
pandas/_libs/testing.pyx:167: AssertionError
Here's a link to the CI build (attached log for posterity).
pandas 0.25.0
had some bugs with indexing that are solved in 0.25.1
but, for some reason, some users are getting the 0.25.0
in their envs. To avoid headaches in a workshop next week I removed the 0.25.0
from the main
channel.
Issue: I built a new conda environment with Python 3.7 (Python 3.7.1 conda-forge, which is latest at conda-forge), channels list being 'conda-forge' at top and 'defaults' at 2nd place. Most packages are from conda-forge in the env but curiously, numpy and pandas are from the defaults channel. Manually trying to install numpy and pandas from conda-forge channel is also not working.
conda install -c conda-forge pandas numpy
Collecting package metadata: done
Solving environment: done
## Package Plan ##
environment location: /<>/anaconda3/envs/<>
added / updated specs:
- numpy
- pandas
The following packages will be downloaded:
package | build
---------------------------|-----------------
blas-1.0 | mkl 6 KB
------------------------------------------------------------
Total: 6 KB
The following packages will be UPDATED:
blas conda-forge --> pkgs/main
Proceed ([y]/n)? n
Exiting.
conda list
):
$ conda list
# packages in environment at /<>/anaconda3/envs/<>:
#
# Name Version Build Channel
atk 2.25.90 hf2eb9ee_1001 conda-forge
attrs 18.2.0 py_0 conda-forge
backcall 0.1.0 py_0 conda-forge
blas 1.0 mkl conda-forge
bleach 3.1.0 pypi_0 pypi
bzip2 1.0.6 h14c3975_1002 conda-forge
ca-certificates 2018.11.29 ha4d7672_0 conda-forge
cairo 1.14.12 h80bd089_1005 conda-forge
certifi 2018.11.29 py37_1000 conda-forge
cycler 0.10.0 py_1 conda-forge
dbus 1.13.0 h4e0c4b3_1000 conda-forge
decorator 4.3.0 py_0 conda-forge
entrypoints 0.3 py37_1000 conda-forge
expat 2.2.5 hf484d3e_1002 conda-forge
fontconfig 2.13.1 h2176d3f_1000 conda-forge
freetype 2.9.1 h3cfcefd_1004 conda-forge
gdk-pixbuf 2.36.12 h4f1c04b_1001 conda-forge
gettext 0.19.8.1 h9745a5d_1001 conda-forge
glib 2.56.2 had28632_1001 conda-forge
gmp 6.1.2 hf484d3e_1000 conda-forge
gobject-introspection 1.56.1 py37h9e29830_1001 conda-forge
graphite2 1.3.13 hf484d3e_1000 conda-forge
gst-plugins-base 1.12.5 h3865690_1000 conda-forge
gstreamer 1.12.5 h0cc0488_1000 conda-forge
gtk2 2.24.31 h5baeb44_1000 conda-forge
harfbuzz 1.9.0 he243708_1001 conda-forge
icu 58.2 hf484d3e_1000 conda-forge
intel-openmp 2019.1 144
ipykernel 5.1.0 py37h24bf2e0_1001 conda-forge
ipython 7.2.0 py37h24bf2e0_1000 conda-forge
ipython_genutils 0.2.0 py_1 conda-forge
ipywidgets 7.4.2 py_0 conda-forge
jedi 0.13.2 py37_1000 conda-forge
jinja2 2.10 py_1 conda-forge
jpeg 9c h14c3975_1001 conda-forge
jsonschema 3.0.0a3 py37_1000 conda-forge
jupyter 1.0.0 py_1 conda-forge
jupyter_client 5.2.4 py_0 conda-forge
jupyter_console 6.0.0 py_0 conda-forge
jupyter_contrib_core 0.3.3 py_2 conda-forge
jupyter_contrib_nbextensions 0.5.1 py37_0 conda-forge
jupyter_core 4.4.0 py_0 conda-forge
jupyter_highlight_selected_word 0.2.0 py37_1000 conda-forge
jupyter_latex_envs 1.4.4 py37_1000 conda-forge
jupyter_nbextensions_configurator 0.4.1 py37_0 conda-forge
kiwisolver 1.0.1 py37h6bb024c_1002 conda-forge
libffi 3.2.1 hf484d3e_1005 conda-forge
libgcc-ng 7.3.0 hdf63c60_0 conda-forge
libgfortran 3.0.0 1 conda-forge
libgfortran-ng 7.2.0 hdf63c60_3 conda-forge
libiconv 1.15 h14c3975_1004 conda-forge
libpng 1.6.36 h84994c4_1000 conda-forge
libsodium 1.0.16 h14c3975_1001 conda-forge
libstdcxx-ng 7.3.0 hdf63c60_0 conda-forge
libtiff 4.0.10 h648cc4a_1001 conda-forge
libuuid 2.32.1 h14c3975_1000 conda-forge
libxcb 1.13 h14c3975_1002 conda-forge
libxml2 2.9.8 h143f9aa_1005 conda-forge
libxslt 1.1.32 h4785a14_1002 conda-forge
lxml 4.3.0 py37h23eabaa_1000 conda-forge
markupsafe 1.1.0 py37h14c3975_1000 conda-forge
matplotlib 3.0.2 py37h8a2030e_1001 conda-forge
matplotlib-base 3.0.2 py37h167e16e_1001 conda-forge
mistune 0.8.4 py37h14c3975_1000 conda-forge
mkl 2019.1 144
mkl_fft 1.0.10 py37ha843d7b_0
mkl_random 1.0.2 py37hd81dba3_0
nbconvert 5.3.1 py_1 conda-forge
nbformat 4.4.0 py_1 conda-forge
ncurses 6.1 hf484d3e_1002 conda-forge
notebook 5.7.4 py37_1000 conda-forge
numpy 1.15.4 py37h7e9f1db_0
numpy-base 1.15.4 py37hde5b4d6_0
openblas 0.3.5 h9ac9557_1000 conda-forge
openssl 1.0.2p h14c3975_1002 conda-forge
pandas 0.23.4 py37h637b7d7_1000 conda-forge
pandoc 2.5 0 conda-forge
pandocfilters 1.4.2 py_1 conda-forge
pango 1.40.14 hf0c64fd_1003 conda-forge
parso 0.3.1 py_0 conda-forge
patsy 0.5.1 py_0 conda-forge
pcre 8.41 hf484d3e_1003 conda-forge
pexpect 4.6.0 py37_1000 conda-forge
pickleshare 0.7.5 py37_1000 conda-forge
pip 18.1 py37_1000 conda-forge
pixman 0.34.0 h14c3975_1003 conda-forge
prometheus_client 0.5.0 py_0 conda-forge
prompt_toolkit 2.0.7 py_0 conda-forge
pthread-stubs 0.4 h14c3975_1001 conda-forge
ptyprocess 0.6.0 py37_1000 conda-forge
pygments 2.3.1 py_0 conda-forge
pyparsing 2.3.1 py_0 conda-forge
pyqt 5.6.0 py37h13b7fb3_1008 conda-forge
pyrsistent 0.14.9 py37h14c3975_1000 conda-forge
python 3.7.1 hd21baee_1000 conda-forge
python-dateutil 2.7.5 py_0 conda-forge
pytz 2018.9 py_0 conda-forge
pyyaml 3.13 py37h14c3975_1001 conda-forge
pyzmq 17.1.2 py37h6afc9c9_1001 conda-forge
qt 5.6.2 hf516382_1011 conda-forge
qtconsole 4.4.3 py_0 conda-forge
readline 7.0 hf8c457e_1001 conda-forge
scikit-learn 0.20.2 py37hd81dba3_0
scipy 1.1.0 py37h7c811a0_2
send2trash 1.5.0 py_0 conda-forge
setuptools 40.6.3 py37_0 conda-forge
sip 4.18.1 py37hf484d3e_1000 conda-forge
six 1.12.0 py37_1000 conda-forge
sqlite 3.26.0 h67949de_1000 conda-forge
statsmodels 0.9.0 py37h3010b51_1000 conda-forge
terminado 0.8.1 py37_1001 conda-forge
testpath 0.4.2 py37_1000 conda-forge
tk 8.6.9 h84994c4_1000 conda-forge
tornado 5.1.1 py37h14c3975_1000 conda-forge
tqdm 4.29.1 py_0 conda-forge
traitlets 4.3.2 py37_1000 conda-forge
wcwidth 0.1.7 py_1 conda-forge
webencodings 0.5.1 py_1 conda-forge
wheel 0.32.3 py37_0 conda-forge
widgetsnbextension 3.4.2 py37_1000 conda-forge
xorg-kbproto 1.0.7 h14c3975_1002 conda-forge
xorg-libice 1.0.9 h14c3975_1004 conda-forge
xorg-libsm 1.2.3 h4937e3b_1000 conda-forge
xorg-libx11 1.6.6 h14c3975_1000 conda-forge
xorg-libxau 1.0.8 h14c3975_1006 conda-forge
xorg-libxdmcp 1.1.2 h14c3975_1007 conda-forge
xorg-libxext 1.3.3 h14c3975_1004 conda-forge
xorg-libxrender 0.9.10 h14c3975_1002 conda-forge
xorg-libxt 1.1.5 h14c3975_1002 conda-forge
xorg-renderproto 0.11.1 h14c3975_1002 conda-forge
xorg-xextproto 7.3.0 h14c3975_1002 conda-forge
xorg-xproto 7.0.31 h14c3975_1007 conda-forge
xz 5.2.4 h14c3975_1001 conda-forge
yaml 0.1.7 h14c3975_1001 conda-forge
zeromq 4.2.5 hf484d3e_1006 conda-forge
zlib 1.2.11 h14c3975_1004 conda-forge
conda
and system ( conda info
):
$ conda info
active environment : <>
active env location : /<>/anaconda3/envs/<>
shell level : 1
user config file : /<>/.condarc
populated config files : /<>/.condarc
conda version : 4.6.0
conda-build version : 3.17.5
python version : 3.6.7.final.0
base environment : /<>/anaconda3 (writable)
channel URLs : https://conda.anaconda.org/conda-forge/linux-64
https://conda.anaconda.org/conda-forge/noarch
https://repo.anaconda.com/pkgs/main/linux-64
https://repo.anaconda.com/pkgs/main/noarch
https://repo.anaconda.com/pkgs/free/linux-64
https://repo.anaconda.com/pkgs/free/noarch
https://repo.anaconda.com/pkgs/r/linux-64
https://repo.anaconda.com/pkgs/r/noarch
package cache : /<>/anaconda3/pkgs
/<>/.conda/pkgs
envs directories : /<>/anaconda3/envs
/<>/.conda/envs
platform : linux-64
user-agent : conda/4.6.0 requests/2.21.0 CPython/3.6.7 Linux/4.15.0-43-generic ubuntu/18.04.1 glibc/2.27
UID:GID : 1000:1000
netrc file : None
offline mode : False
I tried to install all of the optional dependencies with conda install -c conda-forge pandas-all
, but that package isn't found.
$ sha256sum v0.19.2.tar.gz
af634dd6ed3ca1f8635183f41e7f7769108531ccca8213067d9627857461702e v0.19.2.tar.gz
The recipe says it should be:
wget https://github.com/pydata/pandas/archive/v0.19.2.tar.gz
dd2ee30e21804675a6ef41bea854a023b8be3b840fd2aa33e7e1cc38066e781c
Uncompressed this package is around 100MB. For comparison the package on defaults is around 40MB
conda create -n size-pandas-defaults -c defaults pandas nomkl
conda create -n size-pandas -c conda-forge pandas nomkl
$ du -s size-pandas/lib/python3.7/site-packages/* | sort -nr | head -5
106084 size-pandas/lib/python3.7/site-packages/pandas
19676 size-pandas/lib/python3.7/site-packages/numpy
8532 size-pandas/lib/python3.7/site-packages/pip
2772 size-pandas/lib/python3.7/site-packages/pytz
2172 size-pandas/lib/python3.7/site-packages/setuptools
$ du -s size-pandas-defaults/lib/python3.7/site-packages/* | sort -nr | head -5
42436 size-pandas-defaults/lib/python3.7/site-packages/pandas
19592 size-pandas-defaults/lib/python3.7/site-packages/numpy
8388 size-pandas-defaults/lib/python3.7/site-packages/pip
2772 size-pandas-defaults/lib/python3.7/site-packages/pytz
2172 size-pandas-defaults/lib/python3.7/site-packages/setuptools
Issue:
conda list
):
# packages in environment at C:\Anaconda2\envs\test_pandas:
#
# Name Version Build Channel
blas 1.0 mkl
blosc 1.14.4 hc56fc5f_1000 conda-forge
bzip2 1.0.6 vc9_1 [vc9] conda-forge
certifi 2018.8.24 py27_1
hdf5 1.10.2 vc9_0 [vc9] conda-forge
icc_rt 2017.0.4 h97af966_0
intel-openmp 2019.0 118
lzo 2.10 vc9_0 [vc9] conda-forge
mkl 2019.0 118
mkl_fft 1.0.6 py27_0 conda-forge
numexpr 2.6.6 py27_0 conda-forge
numpy 1.15.2 py27hbe4291b_0
numpy-base 1.15.2 py27h2753ae9_0
pandas 0.23.4 py27h39f3610_0 conda-forge
pip 18.0 py27_1 conda-forge
pytables 3.4.3 py27hdd5b532_1
python 2.7.15 h2880e7c_1001 conda-forge
python-dateutil 2.7.3 py_0 conda-forge
pytz 2018.5 py_0 conda-forge
setuptools 40.4.0 py27_1000 conda-forge
six 1.11.0 py27_1 conda-forge
vc 9 0 conda-forge
vs2008_runtime 9.0.30729.6161 0 conda-forge
wheel 0.31.1 py27_1001 conda-forge
wincertstore 0.2 py27_1002 conda-forge
zlib 1.2.11 vc9_0 [vc9] conda-forge
conda
and system ( conda info
):
active environment : test_pandas
active env location : C:\Anaconda2\envs\test_pandas
shell level : 1
user config file : C:\Users\abdelouadoud\.condarc
populated config files : C:\Users\abdelouadoud\.condarc
conda version : 4.5.4
conda-build version : not installed
python version : 2.7.13.final.0
base environment : C:\Anaconda2 (writable)
channel URLs : https://conda.anaconda.org/bioconda/win-64
https://conda.anaconda.org/bioconda/noarch
https://conda.anaconda.org/r/win-64
https://conda.anaconda.org/r/noarch
https://repo.anaconda.com/pkgs/main/win-64
https://repo.anaconda.com/pkgs/main/noarch
https://repo.anaconda.com/pkgs/free/win-64
https://repo.anaconda.com/pkgs/free/noarch
https://repo.anaconda.com/pkgs/r/win-64
https://repo.anaconda.com/pkgs/r/noarch
https://repo.anaconda.com/pkgs/pro/win-64
https://repo.anaconda.com/pkgs/pro/noarch
https://repo.anaconda.com/pkgs/msys2/win-64
https://repo.anaconda.com/pkgs/msys2/noarch
https://conda.anaconda.org/conda-forge/win-64
https://conda.anaconda.org/conda-forge/noarch
package cache : C:\Anaconda2\pkgs
C:\Users\abdelouadoud\AppData\Local\conda\conda\pkgs
envs directories : C:\Anaconda2\envs
C:\Users\abdelouadoud\AppData\Local\conda\conda\envs
C:\Users\abdelouadoud\.conda\envs
platform : win-64
user-agent : conda/4.5.4 requests/2.12.4 CPython/2.7.13 Windows/7 Windows/6.1.7601
administrator : True
netrc file : None
offline mode : False
When running the following code with the environment above activated :
import pandas as pd
pd.Series([4, 5]).to_hdf('test', key='test')
I get
Warning! ***HDF5 library version mismatched error***
The HDF5 header files used to compile this application do not match
the version used by the HDF5 library to which this application is linked.
Data corruption or segmentation faults may occur if the application continues.
This can happen when an application was compiled by one version of HDF5 but
linked with a different version of static or shared HDF5 library.
You should recompile the application or check your shared library related
settings such as 'LD_LIBRARY_PATH'.
You can, at your own risk, disable this warning by setting the environment
variable 'HDF5_DISABLE_VERSION_CHECK' to a value of '1'.
Setting it to 2 or higher will suppress the warning messages totally.
Headers are 1.8.15, library is 1.10.1
SUMMARY OF THE HDF5 CONFIGURATION
=================================
General Information:
-------------------
HDF5 Version: 1.10.1
Configured on: 2018-02-22
Configured by: NMake Makefiles
Host system: Windows-6.3.9600
Uname information: Windows
Byte sex: little-endian
Installation point: C:/bld/hdf5_1519266479706/_b_env/Library
Compiling Options:
------------------
Build Mode: RELEASE
Debugging Symbols:
Asserts:
Profiling:
Optimization Level:
Linking Options:
----------------
Libraries:
Statically Linked Executables: OFF
LDFLAGS: /machine:x64
H5_LDFLAGS:
AM_LDFLAGS:
Extra libraries: C:/bld/hdf5_1519266479706/_b_env/Library/lib/z.lib
Archiver:
Ranlib:
Languages:
----------
C: yes
C Compiler: C:/Program Files (x86)/Microsoft Visual Studio 9.0/VC/bin/amd64/cl.exe 15.0.30729.1
CPPFLAGS:
H5_CPPFLAGS:
AM_CPPFLAGS:
CFLAGS: /DWIN32 /D_WINDOWS /W3
H5_CFLAGS:
AM_CFLAGS:
Shared C Library: YES
Static C Library: YES
Fortran: OFF
Fortran Compiler:
Fortran Flags:
H5 Fortran Flags:
AM Fortran Flags:
Shared Fortran Library: YES
Static Fortran Library: YES
C++: ON
C++ Compiler: C:/Program Files (x86)/Microsoft Visual Studio 9.0/VC/bin/amd64/cl.exe 15.0.30729.1
C++ Flags: /DWIN32 /D_WINDOWS /W3 /GR /EHsc
H5 C++ Flags:
AM C++ Flags:
Shared C++ Library: YES
Static C++ Library: YES
JAVA: OFF
JAVA Compiler:
Features:
---------
Parallel HDF5: OFF
High-level library: ON
Threadsafety: ON
Default API mapping: v110
With deprecated public symbols: ON
I/O filters (external): DEFLATE
MPE:
Direct VFD:
dmalloc:
Packages w/ extra debug output:
API Tracing: OFF
Using memory checker: OFF
Memory allocation sanity checks: OFF
Metadata trace file:
Function Stack Tracing: OFF
Strict File Format Checks: OFF
Optimization Instrumentation:
Bye...
This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.
This is currently reproducible only on the conda-forge channel (everything works as expected on the defaults) but we need to use the conda-forge channel to be able to use geopandas.
Pandas is the largest package in my environments reaching ~73 MB, almost half of that is in the test folder. I don't know how useful the tests are for an installed artifact and I wonder if we should remove them from the final package.
PS: The same happens in the wheel and download times would be greatly improved if the tests were removed there too.
I've got a quick question for the awesome folks behind pandas-feedstock project on conda-forge. I was wondering if it would be possible to create a v1.5.x branch to enable compatibility with Python 3.12.
Just recently, I had a fantastic experience on a rebuild PR for the pydantic project. Now I'm keen to send a pull request that ensures the latest version within the 1.x release range of pandas aslo works with Python 3.12.
I've already created the branch with a new commit here. So, could you consider creating a branch based on 66ac579 for this purpose?
Pandas 2.2.x apparently needs numpy 1.22.4 but the feedstock wasn't updated.
>>> import pandas
...
ImportError: this version of pandas is incompatible with numpy < 1.22.4
your numpy version is 1.21.6.
Please upgrade numpy to >= 1.22.4 to use this pandas version
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.