Giter VIP home page Giter VIP logo

gtfs-validator's Introduction

Canonical GTFS Schedule Validator

Test Package Document End to end End to end big End to end 100 Rule acceptance tests Docker image Join the gtfs-validator chat

A General Transit Feed Specification (GTFS) Schedule (static) feed validator, maintained by MobilityData.


Using the Desktop appUsing the command lineUsing Docker

☑️ List of rules implemented

🤝 Contribute to the project


This README contains information for the latest version of the project, which is under active development. You can find the latest version of the validator application on the Releases page.

Introduction

This is a cross-platform application written in Java that performs the following steps:

  1. Loads input GTFS zip file from a URL or disk.
  2. Checks file integrity, numeric type parsing and ranges.
  3. Performs complete validation against the GTFS Schedule standard.
  4. Provides an easy-to-use validation report in HTML format that can be opened in the browser and shared with other parties. See an example of a validation report. The report is also available in JSON format that can be used for parsing and running additional analyses.
validator_demo.mp4

Running the app

Setup

  1. Navigate to the Releases page and download the latest Gtfs Validator installer for your operating system:
    • Windows => .msi
    • Mac OS => .dmg
    • Linux => .deb
  2. Install application to your workstation.

Run it

Once installed, run the application and you will see the following screen:

Application-Windows

There are two primary options to set:

  • GTFS Input: Use this to specify the GTFS feed to validate. You can specify a URL, ZIP file, or a directory containing the individual .txt files of a feed. You can paste the input location directly into the input field or use the Choose Local File... button to open a file-chooser dialog to select a file on your local system.
  • Output Directory: This is the directory where the validation reports will be written.

With these two options set, click the "Validate" button to begin validation.

Visualize the results

When validation is complete, the application will automatically open the HTML validation report in your local browser. In addition, the application creates the following files in the output directory:

  • report.html: the validation report in HTML format. It can be opened in a browser.
  • report.json: the validation report in JSON format.
  • system_errors.json: this file will be created every-time the validator is run. If no system errors were encountered, this file will be empty.

Advanced Options

Before running validation, tap the Advanced button to configure other aspects of the application, including:

  • Number of threads used to run the validator.
  • The country code used for phone number validation.

Run the app via command line

Setup

  1. Install Java 11 or higher. To check which version of Java is installed on your computer, type the following command in the terminal: java --version.
  2. Navigate to the Releases page and download the latest Gtfs Validator CLI jar (not OS-specific). It is located in the Assets section of the release, and it looks like gtfs-validator-vX.X.X_cli.jar
  3. Open the terminal on your computer
  4. Navigate to the directory containing the jar file. You can do this by typing the following command in the terminal:cd {directory path}, where {directory path} is the absolute or relative path to the directory. You can then make sure you're in the right directory by typing pwd in the terminal (this stands for present working directory). You can also make sure the jar file is there by typing ls in the terminal (this stands for list and will display the list of files in this directory). More about commands to navigate file and directories here.

Run it

You can run this validator using a GTFS dataset on your computer, or from a URL.

  • To validate a GTFS dataset on your computer, run the following command in the terminal, replacing the text in brackets:

    • java -jar {name of the jar file} -i {path to the GTFS file} -o {name of the output directory that will be created}
    • here is an example of what the command could look like: java -jar gtfs-validator-cli.jar -i /myDirectory/gtfs.zip -o output
  • To validate a GTFS dataset from a URL, run the following command in the terminal, replacing the text in brackets:

    • java -jar {name of the jar file} -u {URL to the GTFS file} -o {name of the output directory that will be created}
    • here is an example of what the command could look like: java -jar gtfs-validator-cli.jar -u https://www.abc.com/gtfs.zip -o output

More detailed instructions with all the parameters that exists are available on our "Usage" page.

Visualize the results

In the output directory, the reports will be created as described here.

Run the app using Docker

Setup

  1. Download and install Docker
  2. To obtain a validator Docker container image, you have two options:
    • Pull a published Docker container image from GitHub. For example, to pull the latest build of the master branch:

      docker pull ghcr.io/mobilitydata/gtfs-validator:latest
    • Build a Docker container image locally from any branch or working tree:

      docker build . -t ghcr.io/mobilitydata/gtfs-validator:latest

Run it

For Mac and Linux

To verify you can run the Docker image in a new container and see the help text:

docker run --rm ghcr.io/mobilitydata/gtfs-validator:latest --help

In order to pass files in and out of the validator, you'll need to use a volume mount to share a directory between your host computer and the Docker container:

docker run --rm -v /myDirectory:/work ghcr.io/mobilitydata/gtfs-validator:latest -i /work/gtfs.zip -o /work/output

where:

  • -v /myDirectory:/work: syntax to share directories and data between the container and the host (your computer). With the above command, any files that you place in /myDirectory on the host will show up in /work inside the container and vice versa.

NOTE: On Windows, you must provide the local volume (e.g., c:) as well:

... c:/myDirectory:/work ...

The validator can then be executed via bash commands. See the preceeding instructions for command line usage.

Visualize the results

In the output directory, the reports will be created as described here.

Validation rules

Have a suggestion for a new rule? Open an issue. You can see the complete process for adding new rules on the "Adding new rules" page.

Previous Releases, Snapshot Builds, and Documentation

  • If you'd like to run the bleeding-edge pre-release Snapshot of the application, see the access instructions.
  • If you are looking for older releases, see the Releases page.
  • If you'd like to view documentation for past releases of the project, see:

Build the code

We suggest using IntelliJ to import, build, and run this project.

Instructions to build the project from the command-line using Gradle are available in our Build documentation.

Architecture

The architecture of the gtfs-validator is described on our Architecture page.

Acceptance tests

In order to avoid sudden changes in the validation output that might declare previously valid datasets invalid, all code changes in pull requests are tested against GTFS datasets in the MobilityDatabase. The acceptance test process is described in ACCEPTANCE_TESTS.md.

Projects based on this validator

CalTrans California Integrated Travel Project (Cal-ITP) GTFS Validator API - A thin wrapper around MobilityData/gtfs-validator.

License

Code licensed under the Apache 2.0 License.

Contributing

We welcome contributions to the project! Please check out our Contribution guidelines for details.

gtfs-validator's People

Contributors

lionel-nj avatar aababilov avatar barbeau avatar bdferris-v2 avatar isabelle-dr avatar maximearmstrong avatar kclough avatar briandonahue avatar themightychris avatar dependabot[bot] avatar f8full avatar ed-g avatar fredericsimard avatar nickaein avatar asvechnikov2 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.