Comments (1)
Glad you got this resolved @nirmesika ... that's an impressive number of projects!
Steampipe will create schemas for connection (project) the first time you run. Future runs will not need to do that.
Some tips to help performance here:
- Use
steampipe service
so they are loaded once in a central service. - Set
import_schema
todisabled
if you don't need them, see https://steampipe.io/docs/reference/config-files/connection#supported-options - Consider using Datatank in Turbot Pipes for datasets this large - https://turbot.com/pipes/blog/2023/10/datatank-launch
Please hit us up on Slack (or GitHub) if you have any questions or need any help as you scale Steampipe. Keen to learn from your experience.
from steampipe.
Related Issues (20)
- HomeDirectoryModfileCheck returning false positive error
- Variables not being reloaded after file watch event
- Modfile left invalid after mod uninstall
- Make Charts Interactive (with links)
- Add `plugin_version` column to `steampipe_plugin` table
- Remove support for `options "connection"`
- Remove support of `max_parallel` in general options
- Queries fail to complete when trying to retrieve a large number of rows and caching is enabled
- Support PIPES_INSTALL_DIR HOT 1
- Deprecate `cloud-host`, `cloud-token` and its related env vars in favor of `pipes-host` and `pipes-token` HOT 1
- Add `version` to `steampipe_plugin` table
- Race condition between service startup and service status
- when querying a connection for which no plugin is installed, the error is `Error: connection 'xxxx' does not exist in connection config (SQLSTATE HV000)`
- Add tests to verify deprecation of `cloud-host` and `cloud-token` env vars and args
- question: How to use own certificates? HOT 1
- Growing memory usage following file watching events when running dashboard server
- Multiple steampipe cli executions share environment information HOT 2
- When installing a mod, ensure there is a valid modfile.
- Database option `search_path_prefix` does not alert search path
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from steampipe.