Comments (4)
A question: should there be a separate setting for max queued crawls as well as max concurrent crawls?
Without the latter, the user can still set an unlimited number of crawls to be waiting in the queue, even if only 1 or 2 may run at a time. With this limit, we could also limit how many crawls can be in waiting state (beyond that, it would be an error). Relatedly, this could apply to how many crawls could be set to be scheduled (though not necessarily run) at once.
This would then have further limits of:
- number of concurrent crawls that can run at once
- number of crawls that could be queued at once
- number of crawls that could be scheduled at once (should be <= queued count?)
Or is this perhaps too complicated at this stage?
from browsertrix.
UI support tracked via #867
from browsertrix.
Should we see if we want to limit max queued crawls first? Overall not a bad idea, I imagine this would disable certian options in the workflow actions & config screens, so there would be front end impacts, but would be nice to see what average usage is like before we set more restrictions?
from browsertrix.
This is also done! 🎉
from browsertrix.
Related Issues (20)
- [Feature]: search collection items by tags
- [Feature]: Improve UX of prefix search or switch to fulltext search HOT 2
- [Feature]: QA should include certain workflow settings
- [Feature]: Org Billing Page
- [Change]: Graph non-HTML page QA results as a discrete bar HOT 2
- Use first seed for workflows with no name in browser profile detail workflows list
- Shoelace progress rings always display at 100% completion in Chrome HOT 1
- Shoelace button groups don't appear correctly HOT 2
- [Bug]: Profiles are cut off at the bottom HOT 1
- [Bug]: Profile VNC connection fails while profile browser is still running (was: Profile ping returning success after expired) HOT 1
- [Feature]: Allow setting scale for QA runs in helm chart
- [Bug]: The copy-field label is inside the field
- [Feature]: Show and update the QA results bar graph while analysis is running
- [Change]: Update column sorting for all tables HOT 1
- Indicate pages with significant failures/unable to be analyzed separately from "No data" in QA meter HOT 1
- Use rounded border radius on QA meter bars
- [Bug]: QA analysis fails all the time for "pol frontpage with all context" HOT 1
- Add button to QA crawl in Watch Crawl tab when crawl completes
- QA: Show number of files and errored pages separately from QA meter HOT 1
- [Bug]: Ensure the qa configmap updated for long running QA runs
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from browsertrix.