datatogether Goto Github PK

repos: 36.0 gists: 0.0

Name: Data Together

Type: Organization

Bio: Data Together seeks to build a better future for data.

Blog: https://datatogether.org/

Data Together

Data Together empowers people to create a decentralized civic layer for the web, leveraging community, trust, and shared interest to steward data they care about.

Find out about who we are, what we do, and how to get involved at https://datatogether.org/)!

Organizational structure

We maintain pretty light governance but commit to an annual in-person meeting and quarterly calls:

Quarterly Calls

Quarterly calls are held four times annually, for everyone, but especially Data Together partners to sync up on ongoing projects, what is going on in their organizations, and more.

📅 Once per quarter
▶️ Call Playlist: youtube.com/playlist?list=PLtsP3g9LafVul1gCctMYGm9sz5FUWr5bu

Working Openly

We have developed guidelines for working as an open project, these are all contained in this repo:

License

Data Together Documentation Materials are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Data Together's Projects

api

Serves the Data Together JSON API

archivers_slackin

Public Slack organizations made easy

archivertools

Python package for scraping websites into the Data Together pipeline via morph.io

artwork

Open-licensed artwork related to Data Together

cdxj

Golang package implementing the CDXJ file format used by OpenWayback 3.0.0+ to index web archive contents

config

Hassle-free config struct setting from env variables in go

content

Service for serving archived content stored on amazon S3.

core

Core Archive Model Definitions

coverage

Project for visualizing the status of digital data archiving efforts across various data repositories

dataset_registries

Tracking the design and implementation of the metadata registries we will use to track rescued datasets

datatogether

:checkered_flag: Start here! Discussion for Data Together: Building a better future for data

datatogether_superset

Heroku-backed Superset instance for visualizing live project data.

dt

command line tool for storing data together on the distributed web

extract_href

Command line tool for extracting urls from a HTML web page using a jquery-style selector

ffi

Golang package for making sensible guesses about file formats from Url strings

identity

User & Identity Management server

learning

Learning materials for Data Together

linked_data

Golang package for working with linked data structures, an implementation of the W3C Data Catalog Vocabulary (DCAT)

memgator

A Memento Aggregator CLI and Server in Go

os_deployment

patchbay

Websockets-based API backend for our react and redux webapp.

pdf

Library that extracts xmp metadata from a PDF document.

reading_datatogether

📚 Monthly reading group for Data Together

research

📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity

resources

extract urls of dependant files for displaying a web page

rewrite

modify the contents of web-related content types for archival purposes

roadmap

Coordinating technical work & roadmapping additional services

sentry

Parallelized web crawler written in Golang

sql_datastore

Experimental Golang implementation of the ipfs datastore interface for sql databases.