Light

aboueleyes / cms-downloader Goto Github PK

View Code? Open in Web Editor NEW

13.0 1.0 0.0 1.16 MB

A CLI python script that downloads the material of any course hosted on the cms website

License: GNU General Public License v3.0

Python 100.00%

guc automation university cms-downloader cli-python-script cms-website

cms-downloader's Introduction

CMS-downloader

A CLI python script that automates downloading the material of any course hosted on the cms website. also organizes the content in weeks.

Installation

Clone the repo and install dependencies with python package manger pip

git clone https://github.com/aboueleyes/cms-downloader.git
cd cms-downloader/
sudo pip3 install -r requirements.txt

For Windows

pip install -r  requirements.txt

Usage

For GIU students run this command first

sed -i 's/^# //' src/constants.py

Run in interactive mode

python3 main.py

For help

python3 main.py -h

Download all PDF files for all courses

./main.py -p

Download every single file including videos for all courses

./main.py -a

Run in interactive mode but display only new items

./main.py -f

Display all announcements for all courses

./main.py -n

Features

Parallel downloading
In interactive mode you can use regular expressions in search
Select more than option by Pressing <tab>

Contribution

For any feedback or issues, feel free to open an issue, make sure to keep it as detailed as possible.

If you would like to contribute, feel free to fork the repo, and open a PR. However, please create an issue first with the feature/bug-fix you would like to implement, since it might be in-work already.

DISCLAIMER

This script is not official, It is simply a personal script shared for educational purposes only.

cms-downloader's People

Contributors

Stargazers

Watchers

cms-downloader's Issues

Check if two files are the same

checking if file exists was by checking their name which was the not the best approach since the filename can be changed?
Maybe The file-size, name and comparing first chunk of bits would be okay?

Announcement are not scraped

The Announcement need to be scraped correctly, in case it is not paragraph tag I guess?

Improving selected items to download

Mark downloded items as downloded or remove them from options

Add "return option"

Add a return option to return after accessing a certain course to be able to access other courses instead of rerunning the script.

config file

add config file for user freedom and easy customization

Improve progress bar

The progress bar is not perfect since the multi threading

Add Announcements section

scrape announcements for each course to be shown.

Fix file extension isuue

Not all files extensions are 3 chars

The extension is what after .

Solve The non-existing video problem

use cms-scraper method when it fails to download

Organize by weeks

organize files by weeks

Support GIU

add patch or option or something to support cms of GIU, it needs slight changes

GIU TEST

I am not sure of the GIU regex can GIUian help me?

Threading

specify the number of threads

ugly code

We need OOP!

multi-thread download

using multiple threads. Each thread run simultaneously (in parallel), grabbing a specific part of the file.

Support for Windows

The script needs some changes to support Windows systems. file separator for example?

old courses

show the option to access the old courses too.

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.