Comments (4)
What actually happened on the server? Was the service killed by OOM killer or panicked?
However, it's quite interesting and puzzling...
from backend-next.
My opinion would be to check the pg_stat_activity
first. If there are more idle than active connections, pgBouncer or similar tools can be a big benefit.
from backend-next.
Seems that when there's too many (we are saying actually just 10-ish) connections to the Postgres DB, due to the fact that database/sql.DB
is pooled by default, the connections are persisted and reused by the pool and each connection could elapse for an indefinite of time.
This created an issue on Postgres but the actual root cause is still unknown, as it sounds just not right to persist transaction data in the whole connection lifetime rather than just throw it away after the transaction completed. More investigation required.
A workaround (ada2b92) has been implemented as it limits the connection pool size on the backend side to reduce the connection amount been put on Postgres, but the root cause is still remain to be solved.
PS: A server-sided connection pool might be used but due to the pool itself is still elapsing a long time I doubt this would be the solution.
from backend-next.
Fixed with SetConnMaxLifetime
to a definite time instead of the unlimited default.
from backend-next.
Related Issues (20)
- Dependency Dashboard
- Drop Matrix and Trend Calc Job Optimization
- LiveHouse Implementation
- Arkplanner returns with only "Operation Barrenland Supplies" HOT 3
- The Adoption of T-test Instead of Z-test Might Improve the Accuracy HOT 1
- `/PenguinStats/api/v2/recognition/defects/report/init` 可能需要改善 HOT 2
- Purge CDN Cache on Admin API Purge Cache called
- Failed to do advanced query if `interval` is specified and `endTime` is not specified HOT 2
- Add Recognition WASM & Assets Version Report Support HOT 1
- Data Inconsistency & Unexpected Structure Monitoring
- Shorten Cache TTL
- Improve GitHub Community Experience
- Compose `CONTRIBUTING.md`
- `/PenguinStats/api/v2/result/advanced` not overriding response `startTime`
- Use more precise annotations on reliability != 0 situations
- Ignore items that are not presenting in DB rather than throwing an error
- Cronjob-based Automatic Report Rejections based on Dynamic Rules
- Report Verifier should not Short Circuit on Looping Reports HOT 1
- SemVerPrefixed Validation Rule should be Enforced to Always Prefixed
- Change Snowflake to Actual Node ID HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from backend-next.