Giter VIP home page Giter VIP logo

map-of-reddit's Introduction

Map of reddit

This code renders a map of reddit. Each dot on the map is subreddit. Two dots within the same cluster are usually close to each other if multiple users frequently leave comments on both subreddits.

map of reddit

How is it made?

I processed 176,178,986 comments that redditors left in years 2020 - 2021 and computed Jaccard Similarity between subreddits.

Then I treated relationships between subreddits as a graph clustering problem. Once clusters are computed, I treated them as a graph layout problem and created an SVG file. Once SVG file was created I treated it as a dual problem of WebGL rendering and streaming SVG parsing, and created my own webgl renderer and streaming svg parser.

Along the way I strived for simplicity. I wanted to let people edit the SVG file, correct it, and contribute to the development of the map. And I'm happy to say that it is possible to edit the map via anvaka/map-of-reddit-data.

There is a lot of things that I'd love to improve. But I want to know that this effort is not in vain. If you enjoy the work - please consider supporting it on patreon or github. Please share your suggestions and comments with me on twitter.

Some notes

  • There is no single "right" way to cluster reddit. Communities are very rich and they interact with each other on multiple dimensions. Please don't treat proximity of some countries or even subreddits within the same country as a strong proof of relationship - they could be just an artifact of my clustering/layout algorithm.
  • It was very hard to develop the website, as frequently I got side-tracked by all the amazing content people produce on reddit.
  • The algorithm decided to group multi-millionaire subreddits in one cluster. One possible way to de-noise such clusters is to click on "Show Related" from the sidebar. This give focused view on the first and second degree connections.

Running code locally

First - you need to clone/fork this repository and then:

npm install

Now you are ready to serve the website locally:

npm start

To compile a production build:

npm run build

Customize vue configuration

See Configuration Reference.

License

The code in this repository is licensed under MIT license.

map-of-reddit's People

Contributors

anvaka avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.