Comments (8)
I'm not sure what you are suggesting here. Please be more specific? It's not making sense to me.
What part do you want to "initialize", and how?
To my mind, first "initialize" is done by initial transfer. It's the first call to the remote side if I recall.
The zfs send/receive pair?
So "initial transfer", is "initialize dataset", in my perspective.
from zrep.
I'd like to skip remote part completely or stay with zfs create
only when initializing new dataset to avoid waiting for sync to be done when I am on SSH console. Yes, I mean zfs send/recv
part.
from zrep.
It's been a while since I've dug deeply into this part of my code, so.. correct me if I'm missing something here, but...
you're requesting a code change... to a part of the code that you will never use again, once I get around to implementing your OTHER request to use recv -u.
Right?
:-D
convenience link: issue #38
from zrep.
Hmm.. you make reference to an odd thing, "SSH console".
And I smell potential reference to other things you havent mentioned.
So, maybe the part you left out is that you have some special plan or framework to manually do zfs send/receive outside of zrep?
Maybe you should tell me more about that. The more I know, the better a potential solution will be.
from zrep.
Maybe workflow I am trying to implement will tell you more.
On server I want to backup:
- I join to server using SSH
- I call
zrep init <dataset> ...
- no send/recv here, because it will take lot of time - Cron will do initial send/recv when
zrep sync all
is called
I simply don't want to do initial data transfer, it takes huge amount of time on my servers and it can easily break when my connection with server is interrupted. It has nothing to do with -u
flag.
Hope it is clearer now.
from zrep.
that is not a valid workflow.
Yes, the initial sync takes time. That's unavoidable, because you have to copy the entire dataset over!
"zrep sync all", can only work, AFTER a full send has been done. "sync" is incremental-only.
Incrementals can only work, after you have done a FULL send, aka "init".
I'm .. surprised.. that you find use of cron, more favourable than use of command line. But thats okay, there's a solution for people like you ;)
Look into the "at" command. Its just like cron, except one-time use. So, create an 'at' job, for the
"zrep init"?
you can do something like
"at now zrep init blah blah blah"
then drop your ssh connection, but the system will run the init in the background just like a cronjob would.
OTHER people, might instead do
# nohup zrep init blahblah &
# exit
which under most shells will accomplish pretty much the same thing.
from zrep.
Never mind, looks liek we don't understand each other.
And thanks for the at
tip, didn't know that.
from zrep.
PS: there's also other solutions for "my network sucks".
Run a terminal multiplexor like "screen".
There are lots of fun tricks you can do with screen, but the most basic is protecting your shell session from dumb network problems.
It goes like this.
When you ssh into a box, start up "screen". It then gives you a virtualized session.
ssh remotehost
screen
bash-4.1$ while true; do date; sleep 5 ; done
Mon Feb 27 15:13:48 PST 2017
Mon Feb 27 15:13:53 PST 2017
Mon Feb 27 15:13:58 PST 2017
Mon Feb 27 15:14:03 PST 2017
(kill ssh with ~ .)
ssh remotehost
screen -r
### reconnects to your saved session, and scrolls the output that you missed
### the command has continued running uninterrupted...
Mon Feb 27 15:14:03 PST 2017
Mon Feb 27 15:14:08 PST 2017
Mon Feb 27 15:14:13 PST 2017
Mon Feb 27 15:14:18 PST 2017
Mon Feb 27 15:14:23 PST 2017
Mon Feb 27 15:14:28 PST 2017
...
from zrep.
Related Issues (20)
- Include ZREP_RESUME in user tunable section HOT 3
- delete non existing datasets on destination HOT 5
- don't sync on split brain HOT 25
- don't zrep_errquit in zrep_sync() while loop when using "all" HOT 2
- don't sync if not master HOT 7
- add check-for-remote parameter HOT 1
- fix code for #178 HOT 1
- possibility to add additional rcve parameters HOT 14
- zrep not updating/setting src-host / dest-host on the receiving side HOT 17
- don't destroy local fs if init is used wrong HOT 4
- zrep2 (bash) not working via cronjob HOT 1
- Is there an issue with zrep sync filesystem@snapshot? HOT 3
- Possibly missing `-s` to `zfs recv` when using `zrep refresh` HOT 3
- [enhancement] Add support of netcat for initial replication HOT 1
- large_blocks error HOT 6
- ZREP_SKIP_EXPIRE should also affect remote expiration of snapshots
- ZREP_INC_FLAG="-I" not used with custom zrep tag HOT 3
- ZREP - Filesystem will not be mounted HOT 1
- After connection problems: cannot receive incremental stream: destination ... has been modified HOT 12
- Changeconfig -d not working HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zrep.