Giter VIP home page Giter VIP logo

canvas-scraper's Introduction

Canvas-Scraper

Canvas Scraper is a Selenium-driven tool for students that will automatically go through each of the your courses and download all attached files.

Setup

Must have Python version 3 installed, and the correct version of chromedriver downloaded.

Installation

First, clone the repository.

git clone

Create a new venv to run the script in, and activate it.

python3 -m venv canvas-scraper
cd canvas-scraper
source bin/activate

Use the package manager pip to install dependencies.

pip install -r requirements.txt

Configuration

Edit the file settings.conf to include your canvas login information, the path to chromedriver, as well as the desired output location for the course data.

login:
    username: eid1234
    passwd: pw123

save_location: /path/to/output/folder/

chromedriver_location: /path/to/chromedriver

Usage

Now you are ready to run the scraper.

python scraper.py

When the script is finished beginning the downloads, it will prompt you to wait until the downloads are finished to close out the script. Be patient.

After Downloads Complete:

You can now run the separate script rename_folders.py in order to automatically rename the downloaded zip files to accurately represent the course they contain the files for.

python rename-folders.py

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

License

MIT

canvas-scraper's People

Watchers

James Cloos avatar Colby Janecka avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.