Giter VIP home page Giter VIP logo

toastystats's Introduction

toastystats

Scripts for scraping Archive of Our Own (AO3), Tumblr, Fanfiction.net (FFN), and Wattpad to gather fandom data.

These are all python scripts that will output CSV files containing data about fanworks (plus some helper functions). Anyone is welcome to use them, for any purpose. I encourage sharing of major improvements/additions with the community.

For details on how to use AO3 scripts, see AO3/AO3_README. These scripts include:

  • CASE 1: FINDING THE BIGGEST FANDOMS ON AO3
  • CASE 2: GETTING SUMMARY STATS FOR AO3 TAGS
  • CASE 3: TRACKING AO3 TAG ACTIVITY OVER TIME
  • CASE 4: TRACKING OVERALL AO3 ACTIVITY OVER TIME
  • CASE 5: FIND TOP SHIPS AND FANDOMS FOR A TAG

For details on how to sample random fanworks from AO3, FFN, or Wattpad, see Sampler/README.

For details on how to use Tumblr scripts, see Tumblr/TAGSTATS_README.

toastystats's People

Contributors

destinationtoast avatar ecjoseph42 avatar annathecrow avatar

Stargazers

Luke Russell avatar avatar avatar rogafe avatar QIXIN LIN avatar avatar Joanne Chang avatar lozzie mozzie avatar jlds avatar Anaïs Ahmed avatar avatar florina avatar Annabel Q avatar Eric Brichetto avatar ani toyotas avatar Kiren Srinivasan avatar avatar Yamini avatar avatar Andy avatar avatar avatar avatar Daniel Phan avatar Jojogeek avatar avatar avatar avatar avatar avatar Dolani avatar Owen V. Hayes avatar Veena S Kumar avatar avatar avatar avatar avatar tg-z avatar avatar Edith avatar avatar avatar avatar Macarena Roel avatar avatar Hannah avatar avatar Federico Pianzola avatar Mo Ollenburger avatar avatar Quinn Dombrowski avatar avatar Rebecca Sanjabi avatar

Watchers

Quinn Dombrowski avatar James Cloos avatar avatar Sydney Kessler avatar avatar

Forkers

camillaesme ionadoug ecjoseph42 celegant athenarara gentunn phthallo timefortea42 virtualsatai briepowell

toastystats's Issues

Python 3

I'm using it with Python 3 and, given the errors it has gave me, I assume this is for Python 2.

I list here the changes I had to make so if someone has the same problems (and don't want to change version), could do it faster:

  • print must be a function like print('whatever')
  • module sys diferes from python 2
    • reload() method doesn't exist, not in "sys" module, but in "imp" module
  • library urlparse is now urllib.parse

I might edit this and add more as I use it.

Thanks!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.