Comments (3)
Having static endpoint for latest data is a great idea! Just two notes here:
- When trying to download any of files published using Filebase gateway which is linked on Github Pages link I am being served
This gateway only serves content pinned by Filebase
string instead of file contents.
Simple workaround for me is to fetch the same content from another gateway like cloudflare-gateway but I am just curious why Filebase does not seem to recognize they are the ones pinning.
- In previous version I really enjoyed simplicitly of being able to download single
.duckdb
file with pre-loaded tables. Now I am able to cherry-pick tables and load those myself, but a way to get everything in single fetch with batteries included would be nice.
from gitcoin-grants-data-portal.
but I am just curious why Filebase does not seem to recognize they are the ones pinning
Sounds like a bug! IPNS is tricky. Will reach out to Filebase and let them know. Meanwhile, we can rely on the IPFS CID file.
In previous version I really enjoyed simplicitly of being able to download single .duckdb file with pre-loaded tables. Now I am able to cherry-pick tables and load those myself, but a way to get everything in single fetch with batteries included would be nice.
You're right! In fact, it doesn't cost much to also push the duckdb database to GitHub releases as I was doing. Might be helpful for (1) people that want one file with everything and (2) as a backup in case IPFS is slow or the CID breaks for some reason.
from gitcoin-grants-data-portal.
Closing this one as the Parquet files are now being pushed to IPFS.
Will work on #8.
from gitcoin-grants-data-portal.
Related Issues (20)
- Make sure CI runs on correct branch HOT 2
- DNS-setup for portal short-name HOT 2
- Retry with Dagster asset retrying
- Document how to run `publish & deploy` from fork
- Unify CI files
- Fix `/data` in website
- CI step to find broken links
- Optimize Parquet files HOT 1
- Draw diagrams to improve docs HOT 1
- Attestations from Karma GAP
- Handling for static/historic datasets
- Add external datasets (snapshot / tally) HOT 1
- Sort final files
- Publish datasets to BigQuery
- Add contributor guides
- Add known users / impact section
- Iterate dbt schema
- Disable GitHub Pages HOT 1
- Get Passport Scores from new endpoint HOT 1
- Create a Colab Notebook with all datasets preloaded
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gitcoin-grants-data-portal.