Comments (3)
The easiest way I see to avoid this edge case would be to check if the last successful mirror sync
< ScanInterval
then enable the mirror without prior checking (like it does now), else wait for a successful scan before re-enabling the mirror.
What do you think?
The problem that can arise is that if mirrorbits was stopped or the server looses its connectivity for quite some time (basically > ScanInterval
), it will be unable to serve files at full capacity right away when the connectivity gets back because it needs to wait for a scan of all mirrors. But this new edge case can be mitigated with mirrorbits cluster as long as the other node is able to access and scan the mirrors.
from mirrorbits.
I think there could be potential issues with a mirror being enabled out of sync.
Without a cluster, i can see the need for mirrorbits to enable everything upon connectivity being restored.
If a server is offline for X amount of time, i think MB should force a rescan before it enables. Especially if the server had some sort of an outage, it could be way out of sync. Kodi has some 22,000 + files.
If someone used MB for a repo like ubuntu there's a huge amount of files constantly changing.
I know a lot of mirrors are really slow to sync so it may cause a delay for those servers being enabled.
only a suggestion. : ]
from mirrorbits.
Why closing it? It's definitely on my radar.
from mirrorbits.
Related Issues (20)
- Rotation of logs (logrotate) and releasing the rotated inode log file HOT 3
- New downloads "Service Unavailable" HOT 1
- Scan through HTTP/HTTPS possible? HOT 2
- Cannot edit a mirror when its ID is a substring of another HOT 2
- Consider bundling static files HOT 1
- Is this project still maintained? HOT 15
- OSMC still uses MirrorBits HOT 1
- Feature request: support S3 protocol for scanning mirrors
- Mirrorbits stats pile up forever, there should be a way to delete old stats HOT 1
- Unbounded MULTI transactions cause big latency spikes in Redis
- Feature Request: also build for arm64 architecture HOT 3
- Health-Check might check for non-existing files, marking mirror down by mistake. Could be improved HOT 3
- Line-wrapping in YAML output makes life difficult HOT 2
- Support dual HTTP/HTTPS for a mirror
- Consider open data alternative to Geoip db HOT 2
- Redirect to a mirror that is unreachable due to local/remote rules HOT 2
- feature: Support mirror "alias" in addition to name HOT 1
- Feature Request: Trigger scan via changing/monitoring a special file
- Master fails to build with undefined: grpc.ClientConnInterface HOT 17
- Feature Request: Support rsync-ssl for mirrors
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mirrorbits.