Giter VIP home page Giter VIP logo

chromag-pipeline's Introduction

ChroMag calibration pipeline

Documentation Status

Requirements

  • Python 3.7 or later

Installation

See the Installation guide.

Running

$ chromag --help
usage: chromag [-h] [-v] {cat,log,ls,end-of-day,eod} ...

ChroMag pipeline 0.1.0

positional arguments:
  {cat,log,ls,end-of-day,eod}
                        sub-command help
    cat                 display file header
    log                 display, and optionally filter, log output
    ls                  list files with extra ChroMag-specific info
    end-of-day (eod)    run end-of-day pipeline

options:
  -h, --help            show this help message and exit
  -v, --version         show program's version number and exit

Help for each sub-command can be obtained as well, e.g.:

$ chromag eod --help
usage: chromag end-of-day [-h] [-f CONFIGURATION_FILENAME] [date-expr ...]

positional arguments:
  date-expr             dates to run on in the form YYYYMMDD including lists (using commas) and
                        ranges (using hyphens where end date is not included)

options:
  -h, --help            show this help message and exit
  -f CONFIGURATION_FILENAME, --configuration-filename CONFIGURATION_FILENAME
                        Configuration filename

Development

Testing

To run the unit tests, use pytest:

pytest tests

The unit tests will automatically be run before a commit is allowed.

Linting

To get perform static analysis on the source code to check for common patterns that might cause errors or other problems, run pylint from the root directory of the repository:

pylint chromag tests

chromag-pipeline's People

Contributors

mgalloy avatar

Stargazers

Alfred de Wijn avatar

Watchers

 avatar James Cloos avatar Alfred de Wijn avatar  avatar  avatar

chromag-pipeline's Issues

Add ability to subset the catalog

This is frequently needed to get all the science files, all the files of a given wave region, etc. For example, it would be good to be able to do something like:

subset = catalog[catalog.wavelength == 617.57]

Release on PyPI

Frequent releases to PyPI would make the code more accessible to others.

Dark correction

The requirements for the dark to be used for dark subtraction:

  • use closest dark in time (no interpolation)
  • darks must match exposure time

Tasks

  • validate that darks don't vary with wavelength and polarization state
  • find/retrieve closest dark to a time
  • dark subtraction

Make plots from housekeeping file

Create system controlled by a configuration file that makes plots from a housekeeping file. The configuration file defines the plots made:

  • which columns of the housekeeping file are plotted on the x- and y-axes
  • what type of plot is made: time series, scatter plot, bar graph, etc.
  • ranges of the plot axes
  • filename of the output file

Make inventory files

There is raw data to test on in:

/export/data1/Data/ChroMag/raw

on our incoming data server.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.