Comments (3)
Thanks for reaching out!
For those sorts of large-scale policy decisions, we moved away from trying to surface the necessary data in the UI and now mainly rely on Bigquery. It allows for a SQL-based interface to generate metrics like "The certs with the most unique binaries detected on the fleet" or "The hosts with the most number of unique block events".
While these sorts of statistics aren't impossible to do with Datastore, they don't scale as well as we would like. Bigquery, on the other hand, doesn't even blink at that sort of scale.
If you'd like to do the same, we have instructions to set up Bigquery streaming here.
Thanks again!
from upvote_py2.
Cool, that'll work to some extent.
We might even disable all of upvote's UI since we really just want a data ingest backend for santa to help us make the rules - at the scale of our deployment and lockdown needs having this social voting feature isn't really as interesting to us as being able to monitor and create rules
from upvote_py2.
I've implemented this in: #24
from upvote_py2.
Related Issues (20)
- bazel issue when deploying to app engine HOT 4
- unexpected keyword 'overwrite_appengine_config' error while deploying the app to app engine HOT 5
- missing package.json HOT 3
- Unable to deploy single service with latest release HOT 2
- transient errors HOT 7
- clean full sync error HOT 1
- UI: searching by host ID broken HOT 4
- logupload endpoint missing HOT 9
- bazel issue when trying to deploy to app engine HOT 9
- Error running bezel with the init script HOT 8
- Error Running init_project.sh HOT 1
- DeadlineExceededError
- Error in npm
- init script deploy error HOT 3
- no such package '@com_google_javascript_closure_compiler//'
- Is this project still alive? HOT 1
- change 'whitelist' to 'allowlist' HOT 5
- Transitive / Compiler Rule Support HOT 1
- 500 server error from /_ah/queue/deferred? HOT 1
- Actively Maintained or Abandoned? HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from upvote_py2.