Comments (6)
@agstephens I've looked at these tests and found that introducing these changes doesn't cause the aggregation to break. The tests show that if the change is made on the first file in the time series then the new netcdf file includes the change otherwise the change is ignored.
If the change is made to all 3 there is an error - I'm still looking at this and making the files temporary.
from daops.
@ellesmith88: Do the statements above relate to all the different types of changes that are tested in test_xarray_aggregation.py
?
from daops.
@agstephens Yes it does, just added a second test for changing var_id
to show this.
from daops.
Thanks @ellesmith88, are there any arguments that we can set to force the behaviour to be stricter?
from daops.
@agstephens Sorry I just realised this isn't the case for var_id
which actually creates a new variable so that new_var_id
and old_var_id
are both in ds.variables
no matter which file is modified.
Looking at the arguments - haven't found anything that works yet.
from daops.
@ellesmith88: that seems like a logical response, that xarray
would just load two separate variables.
from daops.
Related Issues (20)
- Add features: CLI (subset only), Dockerfile and CWL file to the repo HOT 3
- order of elements of area needed for doc strings
- Add unit tests for ResultsDB object HOT 1
- In `check_result(...)` - check that data is not all missing HOT 1
- Enable selection of variables in daops interface
- daops production error: ZeroDivisionError: float divmod() - with tiny (lat, lon) box HOT 5
- New intake catalog approach could speed up `consolidate` step
- IndexError: list index out of range HOT 3
- Process error: Cannot apply_along_axis when any iteration dimensions are 0 HOT 5
- Check all occurrences of `open_dataset` and `open_xr_dataset` use `roocs-utils` version of the function HOT 4
- Can we delete reference to "orchestrate"? HOT 1
- daops: subset-by-point
- daops.consolidate() is inefficient if lots of files - can we provide hints in the file path mapper? HOT 3
- Could decadal fixes derive leadtime values on-the-fly? HOT 6
- daops consolidate - need to check why return types are different
- Fix lookup of catalogs in consolidate so that multiple catalogs could be used (e.g. cmip6 AND cmip5)
- Replicate content between ES indexes HOT 2
- Some CORDEX fixes have been captured by the py-cordex project
- Just send the command-line options directly into the `subset` function HOT 1
- Add unit tests for command-line HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from daops.