Giter VIP home page Giter VIP logo

vicedtools's Introduction

vicedtools

This is a collection of utility tools for working with school data in Victorian schools.

The utilities have been designed to be state-less. Where tools have been created to export data then they have been designed to work with the native export formats provided by the relevant sites so that processing functions also integrate with existing data stores.

Currently includes tools for:

  • automating the exporting of data from Compass, ACER's OARS site, the VCAA data service (NAPLAN) and VASS (VCE results).
  • tools for working with ACER's OARS site, such as working with PAT data
  • extracting NAPLAN data from the SSSR data.js file
  • uploading data to Google Cloud storage and BigQuery for use with Looker Studio

The core export functions are provided by the CompassSession, OARSSession, VASSSession and DataServiceSession classes.

Getting started

Installation

Install from pip

pip3 install vicedtools

To use the bundled scripts for performing exports and aggregating exported data, make a copy of 'config-sample.toml', update it with your credentials, and then set the VICEDTOOLS_CONFIG environment variable to point to the config file.

Usage

Exporting from VASS

Create a session and select a year.

from vicedtools import VASSSession
grid_password = [('1', '1'), ('8', '1'), ('4', '5'), ('5', '5'), ('1', '8'), 
                 ('8', '8')]
s = VASSSession(username=username,
            password=password,
            grid_password=grid_password)
year = "2021"
s.change_year("year")

Exports from the main VASS interface.

s.personal_details_summary(f"personal details summary {year}.csv")
s.school_program_summary(f"school program summary {year}.csv")
s.gat_summary(f"gat scores {year}.csv")
s.school_scores(f"school scores {year}.csv")
s.external_results(f"external scores {year}.csv")
s.moderated_coursework_scores(f"moderated coursework scores {year}.csv")

Some data is only available once the VCE data service is updated.

s.predicted_scores(f"predicted scores {year}.csv")

Exporting from OARS

Create a session.

from vicedtools import OARSSession, OARSBasicAuthenaticator
oars_authenticator = OARSBasicAuthenaticator(oars_username, oars_password)
s = OARSSession(oars_school_code, oars_authenticator)

Exporting student details.

candidates = s.get_candidates()
with open("oars_candidates.json", 'w') as f:
    json.dump(candidates, f)

Export staff details.

s.get_staff_xlsx("oars_staff.xlsx")

Export test results.

sittings = s.get_all_pat_sittings("01=01-2020", "31-12-2021")
with open("sittings 01-01-2020 31-12-2021.json", 'w') as f:
    json.dump(sittings, f)

Exporting NAPLAN results from the VCAA data service

Create a session.

from vicedtools.naplan import DataserviceSession, DataServiceBasicAuthenticator
dataservice_authenticator = DataServiceBasicAuthenticator(
    dataservice_username, dataservice_password)
s = DataserviceSession(dataservice_authenticator)

Export outcome Excel files.

s.export_naplan("2021, "./naplan results/")

Export the SSSR.

s.export_sssr("2021, "./naplan sssr/")

Bundled command-line utilities

The following command-line utilities are bundled with the package.

  • compassreportstobq
  • compassstudentdetailstobq
  • compassstudentenrolmenttobq
  • createcompassreportssummaries
  • createcompasssubjectsmetadatacsv
  • createnaplansummary
  • createoarsstudentimports
  • createpatparentlettertable
  • ewritescorestobq
  • ewritesittingstoscores
  • exportcompassacademicgroups
  • exportcompassclasses
  • exportcompassenrolments
  • exportcompasslearningtask
  • exportcompasslearningtasks
  • exportcompassprogressreport
  • exportcompassprogressreportcycles
  • exportcompassprogressreports
  • exportcompassreport
  • exportcompassreportcycles
  • exportcompassreports
  • exportcompasssds
  • exportcompassstudenthouseholdinformation
  • exportcompassstudents
  • exportcompasssubjectmetadata
  • exportnaplanoutcomes
  • exportnaplansssr
  • exportoarsmetadata
  • exportoarssittings
  • exportoarsstaff
  • exportoarsstudents
  • exportvassexternalscores
  • exportvassgatscores
  • exportvassmoderatedscores
  • exportvasspredictedscores
  • exportvassschoolprogram
  • exportvassschoolscores
  • exportvassstudentdetails
  • naplanoutcomestobq
  • patmostrecentobq
  • patscorestobq
  • patscorestomostrecent
  • patsittingstoscores

vicedtools's People

Contributors

gregbreese avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

Forkers

sbelluzzo

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.