Computers & Geosciences: forked code repositories photo

cageo Goto Github PK

repos: 132.0 gists: 0.0

Name: Computers & Geosciences: forked code repositories

Type: Organization

Location: To search: type "firstauthorlastname-yearofpaperaccept"

Blog: http://www.journals.elsevier.com/computers-and-geosciences/

The Canadian Climate Data Scraping Tool (CCDST)

Canadian Climate Data Scraping Tool

Charmaine Bonifacio (a), Thomas E. Barchyn (b), Chris H. Hugenholtz (b), Stefan W. Kienzle (a,c)

(a) Department of Geography, University of Lethbridge, 4401 University Drive, Lethbridge, AB, Canada T1K 3M4 (b) Department of Geography, University of Calgary, 2500 University Drive NW, Calgary, AB, Canada T2N 1N4 (c) Applied Behavioural Ecology and Ecosystems Research Unit, University of South Africa, PO Box 392, Florida, Pretoria, South Africa

Abstract

In this paper we present a new software tool that automatically fetches, downloads and consolidates climate data from a Web database where the data are contained on multiple Web pages. The tool is called the Canadian Climate Data Scraping Tool (CCDST) and was developed to enhance access and simplify analysis of climate data from Canada's National Climate Data and Information Archive (NCDIA). The CCDST deconstructs a URL for a particular climate station in the NCDIA and then iteratively modifies the date parameters to download large volumes of data, remove individual file headers, and merge data files into one output file. This automated sequence enhances access to climate data by substantially reducing the time needed to manually download data from multiple Web pages. To this end, we present a case study of the temporal dynamics of blowing snow events that resulted in ~3.1 weeks time savings. Without the CCDST, the time involved in manually downloading climate data limits access and restrains researchers and students from exploring climate trends. The tool is coded as a Microsoft Excel macro and is available to researchers and students for free. The main concept and structure of the tool can be modified for other Web databases hosting geophysical data.

Keywords

Climate data online
Scraping tool
Canada

How To Use CCDST

Please download the user documentation and macro from the Download folder.

License

The Canadian Climate Scraping Tool is licensed under a GNU General Public License v2.0

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.

Computers & Geosciences: forked code repositories's Projects

3dvarbio

Variational Method for Data Assimilation

abdollahifard-2016

Reconstruction of binary geological images using analytical edge and object models Mohammad J. Abdollahifard, , Sadegh Ahmadi

acycle

Acycle: time-series analysis software for paleoclimate research and education

adamczyk-2017

agterberg-2012

The RASC and CASC programs for ranking, scaling and correlation of stratigraphic events, Frits Agterberg; Felix M Gradstein, PhD; Qiuming Cheng, PhD; Liu Gang, PhD

arnold-2012

"Hierarchical benchmark case study for history matching, uncertainty quantification and reservoir characterisation." Arnold, D., V. Demyanov, D. Tatum, T. Rojas, M. Christie, S. Geiger, and P. Corbett.

aset

ASET is a Matlab®-based toolbox developed to obtain, visualize, and validate calibrations between the echo intensity level from static ADCP measurements and suspended sediment concentration values measured simultaneously in different points of surveyed verticals with traditional techniques. In addition, once the calibration is obtained, ASET transforms the acoustic intensity signal into sediment concentration for each cell measured by the ADCP, obtaining the same spatial resolution as the velocity field in the cross-section or temporal series (for static measurements). Extrapolation methods are also included to estimate velocity and concentration values in areas not measured by the ADCP, (i.e., near bottom, surface, and banks), with visualization modules for the user to evaluate each method. Finally, an integration module makes possible to compute the total suspended sediment concentration in a cross-section.

author_instructions

Author instructions for uploading code when a paper is accepted in Computers & Geosciences

barbour-2013

psd: Adaptive, sine multitaper power spectral density estimation for R, Barbour, AJ & Parker R.L

barnes-2013-flatsurfaces

Efficiently assign drainage directions over flat surfaces in digital elevation models

becker-2017

3D XCT-GLCM Matlab code

benitez-2013

Spatial pattern recognition of seismic events in South West Colombia, Hernán D. Benítez*, Juan F. Flórez*, Diana P. Duque*, Alberto Benavides*, Olga Lucía Baquero**, Jiber Quintero**, Elkin Salcedo**

bignardi-2016

OpenHVSR: imaging the subsurface 2D/3D elastic properties through multiple HVSR modeling and inversionsamuel bignardi

bobillo-ares-2015

StrainModeler: A MATHEMATICA based program for 3D analysis of finite and progressive strain" By Nilo C. Bobillo-Ares (a), Jesus Aller, Fernando Bastida, Omar Menendez, Richard J. Lisle

bonifacio-2015

CCDST: A free Canadian climate data scraping tool, Charmaine Bonifacio, Thomas E. Barchyn, Chris H. Hugenholtz, Stefan W. Kienzle

bowman-2015

Near real time weather and ocean model data access with rNOMADS, Code examples from Bowman and Lees (2015) Computers & Geosciences DOI: 10.1016/j.cageo.2015.02.013

branching-decay

brown-2015

Determination of Hashin-Shtrikman Bounds on the Isotropic Effective Elastic Moduli of Polycrystals of any Symmetry, Michael J. Brown

brus-2014

Effects of spatial pattern persistence on the performance of sampling designs for regional trend monitoring, analyzed by simulation of space-time fields, Brus, D. & De Gruijter, J.

bucha-2013

GrafLab: A MATLAB-based graphical user interface program for computing functionals of the geopotential up to ultra-high degrees and orders, Blazej Bucha & Juraj Janak

cageo-2016-18-r1

Matlab files for solving the inverse geothermal problem as described in the paper: An efficient regularization method for a large scale ill-posed geothermal problem, Computers & Geosciences, 2017

cageo_latextemplate

This repository is a LaTeX project of a document that follows all the submission requirements for Computers & Geosciences.

cageo_wordtemplate

This repository is a Microsoft Word file that follows all the submission requirements for Computers & Geosciences.

casini-2013

GEOTHERM: a finite difference code for testing metamorphic P–T–t paths and tectonic models

castelao-2013

An objective reference system for studying rings in the ocean: a Python package to handle rings/eddies in the ocean

castillo-reyes_2018

PETGEM is a parallel python code for 3D Controlled-Source Electromagnetic Method (3D CSEM) in geophysics using edge finite elements (Nedelec finite elements).

chakravarthi-2013

MODTOHAF – A GUI based JAVA code for gravity modeling of strike limited sedimentary basins by means of growing bodies with exponential density contrast – depth variation

compest

An interface connecting COMSOL Multiphysics and PEST to solve inverse modelling problems using forward finite element models

corit

cuma-2013

Massively parallel regularized 3D inversion of potential fields on CPUs and GPUs by Cuma and Zhdanov, 2013