Episode 5 (Preprocessors) about esmvaltool_tutorial HOT 5 CLOSED

Initial setup

• Clone the tutorial repository

• Create a Google Doc to share the text to be added and share link on Gitter

• Create a branch and add a file called preprocessor.md to put the contents of this episode in.

• Commit changes

• Ensure you can run a server and view changes to the file

• Start adding content and maybe create a separate checklist for the contents being added

from esmvaltool_tutorial.

• Added content for introduction

• Added content for questions as laid out in the Questions and Objectives section of the Google Doc.

• Created examples and a Challenge

• Variable Groupings - example

• Created initial Pull request

• Add a list of common errors encountered

• Fix issues raised from review

from esmvaltool_tutorial.

@LisaBock - Can you tell me if this recipe works for you and produces multimodel means in the preproc directory?

 # recipe_variable_groups.yml
 ---
 documentation:

  description: |
   Example recipe to demonstrate grouping of variables in the diagnostic
    section. Additions made to test this recipe.

  authors:
    - schlund_manuel
    - swaminathan_ranjini

  maintainer:
   - swaminathan_ranjini

  projects:
   - crescendo
preprocessors:
  statistics:
    multi_model_statistics:
      span: full
      statistics: [mean, median]

  mask:
    mask_landsea:
      mask_out: sea


cmip5_datasets: &cmip5_datasets
  - {dataset: CanESM2, ensemble: "r(1:4)i1p1", project: CMIP5}
  - {dataset: MPI-ESM-LR, ensemble: "r(1:2)i1p1", project: CMIP5}


cmip6_datasets: &cmip6_datasets
  - {dataset: UKESM1-0-LL, ensemble: "r(1:4)i1p1f2", grid: gn, project: CMIP6}
  - {dataset: CanESM5, ensemble: "r(1:4)i1p2f1", grid: gn, project: CMIP6}

diagnostics:

  diag_variable_groups:
    description: Demonstrate the use of variable groups.
    variables:
      tas_cmip5: &variable_settings # need a name for the grouping
        short_name: tas # specify variable to look for
        mip: Amon
        exp: historical
        start_year: 2000
        end_year: 2005
        tag: TAS_CMIP5 #tag is optional if you are using these settings just once
        additional_datasets: *cmip5_datasets
      tas_obs:
        <<: *variable_settings
        preprocessor: mask
        tag: TAS_OBS
        additional_datasets:
          - {dataset: HadCRUT4, project: OBS, type: ground, version: 1, tier: 2}
      tas_cmip6:
        <<: *variable_settings
        tag: TAS_CMIP6 #nothing changes except the data set
        additional_datasets: *cmip6_datasets
    scripts: null

from esmvaltool_tutorial.

@LisaBock - Can you tell me if this recipe works for you and produces multimodel means in the preproc directory?

 # recipe_variable_groups.yml
 ---
 documentation:

  description: |
   Example recipe to demonstrate grouping of variables in the diagnostic
    section. Additions made to test this recipe.

  authors:
    - schlund_manuel
    - swaminathan_ranjini

  maintainer:
   - swaminathan_ranjini

  projects:
   - crescendo
preprocessors:
  statistics:
    multi_model_statistics:
      span: full
      statistics: [mean, median]

  mask:
    mask_landsea:
      mask_out: sea


cmip5_datasets: &cmip5_datasets
  - {dataset: CanESM2, ensemble: "r(1:4)i1p1", project: CMIP5}
  - {dataset: MPI-ESM-LR, ensemble: "r(1:2)i1p1", project: CMIP5}


cmip6_datasets: &cmip6_datasets
  - {dataset: UKESM1-0-LL, ensemble: "r(1:4)i1p1f2", grid: gn, project: CMIP6}
  - {dataset: CanESM5, ensemble: "r(1:4)i1p2f1", grid: gn, project: CMIP6}

diagnostics:

  diag_variable_groups:
    description: Demonstrate the use of variable groups.
    variables:
      tas_cmip5: &variable_settings # need a name for the grouping
        short_name: tas # specify variable to look for
        mip: Amon
        exp: historical
        start_year: 2000
        end_year: 2005
        tag: TAS_CMIP5 #tag is optional if you are using these settings just once
        additional_datasets: *cmip5_datasets
      tas_obs:
        <<: *variable_settings
        preprocessor: mask
        tag: TAS_OBS
        additional_datasets:
          - {dataset: HadCRUT4, project: OBS, type: ground, version: 1, tier: 2}
      tas_cmip6:
        <<: *variable_settings
        tag: TAS_CMIP6 #nothing changes except the data set
        additional_datasets: *cmip6_datasets
    scripts: null

@rswamina I think you missed to call the preprocessor "statistics".

from esmvaltool_tutorial.

Yes. it was pointed out to me...will fix and rerun. Thanks!

from esmvaltool_tutorial.