Comments (3)
From another (closed issue on this project)
The index refreshing is not related with write performance. It is the min time between Lucene IndexReader reloads. The IndexReader is reused and not opened in each query in order to speed up queries.
I assume that this might play into any answer provided?
from cassandra-lucene-index.
Hi,
Index refreshing means that, given an index with a refresh time n
, any writer client must wait at least n
before it could see its own writes. In practice, this wait time is a little bit greater because of the time required by the refresh operation. And this is certainly not related with write performance.
Asynchronous indexing is a different concept that is closely related to write performance. Synchronous writes means that if an index write operation fails, then the whole Cassandra operation will fail. This is obviously a desirable behavior, the problem is that it doesn't fully exploit the parallelism of the processor. In the other hand, asynchronous indexing has a greater performance because of the use of indexing queues. Thus, the problem with async writes is that some kind of indexing errors will not be reported to the clients. Furthermore, there is no way to know when an async index write has been performed. The time spent in queues is usually lower than a second.
I sounds like if your use case requires an quick succession of reads and writes over the same indexed data, then Lucene based solutions are not suitable for you. Most search engines provide near real time search and, if I understand correctly, it's a pure real time use case, unless you can deal with a relatively large delay between writes and reads, maybe a couple of seconds.
I hope it helps.
from cassandra-lucene-index.
I was suspecting as much, but needed a more experienced interpretation. Thank you for the quick reply and for your work. We will still make good use of this plugin even without this particular scenario.
from cassandra-lucene-index.
Related Issues (20)
- Altering UDTs cause ArrayIndexOutOfBoundsException in ColumnsMapper HOT 14
- Unable to find custom indexer in Cassandra 3.11.2 HOT 1
- Support cassandra-3.11.3
- When a column from the index is used in a predicate cassandra always returns 0 records.
- ArrayIndexOutOfBounds with collections of UDTs HOT 2
- Request timeout error while retrieving data using Stratio-cassandra-lucene-index
- Can't retrieve Many records and count(*)
- Indexing Status
- Index text field as JSON HOT 2
- cassandra search - Returning the score of each result HOT 1
- Query maps where value is case_sensitive=false
- Support for Cassandra 4
- Custom Query
- Exception encountered during startup
- Upgrade to JTS 1.16.1
- Lucene Index Empty after upgrade
- Lucene Index with Cassandra SSL
- Another CQL "date" type: No results
- JVM segfault in ~StubRoutines::updateBytesCRC32 during commit() HOT 1
- Cassandra secondary lucene index rebuild is very slowly
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cassandra-lucene-index.