Comments (11)
Happy to work on #48 and this issue if you want @krasserm
from akka-persistence-cassandra.
You've seen https://github.com/comeara/pillar ?
Looks good from my point of view.
from akka-persistence-cassandra.
@chbatey this would be fantastic. Thanks for offering help and looking forward to see PRs :-)
@matlockx thanks for the hint, will take a closer look soon.
from akka-persistence-cassandra.
I use pillar on my project, but is not well maintained. I have a fork here https://github.com/smr-co-uk/pillar/tree/patch with merged pull requests, a couple of improvements and improved documentation.
from akka-persistence-cassandra.
@PeterLappo thanks for sharing!
from akka-persistence-cassandra.
I've been getting some questions from people trying to migrate their systems from 0.3 to 0.4. As far as I can tell, the schema changes are:
- Rename the
processor_id
column topersistence_id
- Drop the
marker
(clustering key) column. - Add the static
used
column.
However 0.3 creates tables with the compact storage
option. This means, amongst other things, that marker
column can't be dropped, nor can the used
column be added.
This leads me to ask:
- Has anyone ever actually tried migrating a table? (A large one?)
- How is this tool supposed to work?
Right now it looks like there's no simple migration path for people with data, and that any eventual path will involve a stop-the-world process during which a new table is created and the data copied into it.
Have I missed something?
from akka-persistence-cassandra.
@asnare copying data into the new schema can be made parallel to a running old application. When the initial data migration is finished, the old application needs to be stopped and the remaining small fraction of old data needs to be migrated in a second step. This should keep the downtime at a minimum.
from akka-persistence-cassandra.
I've removed old data so far. I plan to write a small spark job to migrate old data in the future.
from akka-persistence-cassandra.
Another schema change I would like to do at some point is to not store the PersistentRepr
as a serialized blob, but add additional columns and only only store the event as a blob. I think that can be done in a backwards compatible way, but wanted to mention it here also.
from akka-persistence-cassandra.
@patriknw would be a big improvement.
from akka-persistence-cassandra.
Continued here: akka/akka-persistence-cassandra#11
from akka-persistence-cassandra.
Related Issues (20)
- Very slow replay message request seems to prevent message write to complete HOT 4
- Using different tables of Cassandra for sharding coordinator HOT 7
- Config constructor parameter HOT 7
- Add support for Cassandra 3.0 HOT 2
- Remove schema creation from CassandraJournal and CassandraSnapshotStore HOT 5
- SSLOptions for Cassandra 3.x? HOT 1
- Can't connect to Cassandra 3.0 HOT 2
- Rename artifact for Cassandra 3 from ...dra3 to ...dra_3 HOT 2
- Deleting message generates batches of single delete HOT 4
- Update to Akka 2.4.1 HOT 1
- avoid blocking Cassandra API calls HOT 1
- avoid throwing exception when plugin actors are started HOT 1
- cold_reads_to_omit parameter is not C* 2.2.x compatible HOT 2
- Potential race on keyspace initialization HOT 2
- CassandraReadJournal doesn't create metadata table HOT 4
- Using eventsByTag gives Exception HOT 6
- I think the persistence query streams should work even if schema doesn't exist HOT 2
- Is there any documentation or examples how do i use this lib HOT 1
- Install multi DC cassandra on two separate Openshift Origin clusters to get HA and DR
- Writing tags has failed ... Batch too large.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from akka-persistence-cassandra.