Giter VIP home page Giter VIP logo

wazp's Introduction

WaZP version 2.0

WaZP short description

This is a code intended to identify and qualify galaxy clusters in large multi-band galaxy photometric surveys.

WaZP workflow

  1. 2 tilings of the sky - including overlaps
    • wtiles for detection
    • ptiles for characterization
  2. generate redshift slices
  3. computation of global survey quantities
  4. for each wtile
    • loop over redshift slices for detection
    • merge detections over slices
    • refine redshift of detections
  5. concatenate detections over all tiles
  6. for each ptile
    • loop over clusters:estimate richness and membership
  7. concatenate richnesses and membership
  8. merge detections and richnesses

Important assumption

The input galaxy catalogs are expected to be located in one directory as a list of fits files corresponding to a spatial partitioning based on Healpix with Nside=64. It can be nested of ring - this is specified in the data configuration file. Each file is named as #hpixel.fits

The associated masks/footprints are expected to follow the same structure and be named as #hpixel_footprint.fits. Note that there is also the option to have the footprint as a single file, which can be convenient for relatively small surveys.

These are described in the 'input_data_structure' section of the data config file.

WaZP with SLURM

The division of the sky in tiles offers an easy way to parallelize the code, which is now orchestrated by SLURM.

wazp_main generates and launches 4 sbatch scripts in array mode with dependencie:

  • wazp_tile (step 4 in the workflow)
  • wazp_concatenate (step 5)
  • pmem_tile (step 6)
  • pmem_concatenate (steps 7 and 8)

Installation

Create an environment with Conda:

conda create -n wazp python=3.11
conda activate wazp
conda install -c conda-forge cfitsio=3.430
conda install -c cta-observatory sparse2d
conda install -c conda-forge pip

Clone the repository:

git clone https://github.com/linea-it/wazp

Install WaZP with:

cd wazp/
python setup.py install

or

pip install wazp/

or, for developers

pip install -e wazp/

Execution

python [wazp/script path]/wazp_main.py wazp.cfg [wazp path]/data.cfg

Can be launched from anywhere. Outputs are written in the wazp.cfg file under -workdir- Make sure data.cfg describes your data and its location on disc.

wazp's People

Contributors

christophe-benoist avatar gschwend avatar m-aguena avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.