Giter VIP home page Giter VIP logo

mlso-utilities's Introduction

Internal general purpose utilities for MLSO operations

find_noncordyn_files.sh

Script for finding files in a directory hierarchy that are not in the cordyn group or don't have the given (optional) permissions.

syntax: ./find_noncordyn_files.sh rootdir [r][w][x]

For example, to find files that are not cordyn group in /hao/acos/sw/sbin or are cordyn group, but aren't group readable, do:

$ VERBOSE=1 ./find_noncordyn_files.sh /hao/acos/sw/sbin r
/hao/acos/sw/sbin/GetTicket
/hao/acos/sw/sbin/GetTicket.new
/hao/acos/sw/sbin/backup-databases.sh
/hao/acos/sw/sbin/pspt_web
Searched for files that were not group cordyn or without g+r set

fix_noncordyn_files.sh

Script for changing, in a directory hierarchy:

  1. all files to cordyn group with group read/write permissions
  2. all directories to cordyn group with executable permissions
syntax: ./fix_noncordyn_files.sh rootdir

hpss

Script for generating reports of HPSS usage.

usage: hpss [-h] [-p PREFIX] [-f] [-k] [-s SMALL_FILES_MAX] [root [root ...]]

HPSS file size utility

positional arguments:
  root                  HPSS root directory

optional arguments:
  -h, --help            show this help message and exit
  -p PREFIX, --prefix PREFIX
                        prefix for log files, default is hpss
  -f, --file            set to interpret root as a log file
  -k, --keep-log        set to not delete log file
  -s SMALL_FILES_MAX, --small-files-max SMALL_FILES_MAX
                        warn about files smaller than this size in bytes

hpss_gateway.sh

Script to start and stop the watch_hpss process to watch a directory for new files to send to the HPSS.

usage: hpss_gateway.sh action instrument

positional arguments:
  action      action to perform: start, stop, or restart
  instrument  instrument to watch for: KCor or CoMP

For example, common usage would be to restart the process for an instrument:

hpss_gateway.sh restart KCor

hpss_get.sh

Script to generate an hsi input file that will download a directory hierarchy in tape order.

usage: hpss_get.sh hpss_dir [output_file]

positional arguments:
  hpss_dir      directory to download, i.e., /CORDYN/COMP/2018
  output_file   output file for hsi commands

watch_hpss

Script to watch a directory for new files to send to the HPSS. This routine should generally be started and stopped by hpss_gateway.sh.

usage: watch_hpss [-h] instrument

Watch for files to send to HPSS

positional arguments:
  instrument  instrument to watch for: KCor or CoMP

optional arguments:
  -h, --help  show this help message and exit

mlso-utilities's People

Contributors

mgalloy avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Forkers

bberkeyu

mlso-utilities's Issues

Create script to install Anaconda with required packages

When Python 3.10, I want to install a new Anaconda along with the packages that we need that are not in the default installation, e.g., SunPy.

  • When will Python 3.10 be released?
  • What packages should be installed in the base installation, and which should be in virtual environments?

Download

Check resolution of MLSO DOIs

DataCite only checks a single, random DOI in UCAR.UCAR to make sure it resolves to the correct URL. We should automatically check the resolution of all the DOIs controlled by MLSO.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.