Comments (2)
Digging a bit deeper
Strace in zfs host. I executed this strace -p ${PID} -t
. Where processes in PID var are:
nc -w ${IP} ${PORT}
process:
08:41:36 read(0, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = 8192ec=0}) = 1 (in [0], left {tv_sec=2, tv_usec=999996
08:41:36 write(3, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = -1 ECONNRESET (Connection reset by peer)\312\254\24\304f\261V`\216qDq\21ke\267\306Q"..., 8
08:41:36 write(3, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = -1 EPIPE (Broken pipe)
...
08:41:38 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=23401, si_uid=0} ---
08:41:38 write(3, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = -1 EPIPE (Broken pipe)
08:41:38 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=23401, si_uid=0} ---
08:41:38 close(3) = 0
08:41:38 exit_group(1) = ?
08:41:38 +++ exited with 1 +++
/bin/sh /sbin/zfs send XXXX@YYYY
(in/sbin/zfs send XXXX@YYYY
I receive aexit 1
error instantly when executed):
strace: Process ${PID} attached
06:57:42 wait4(-1, [{WIFSIGNALED(s) && WTERMSIG(s) == SIGPIPE}], 0, NULL) = 23402
08:41:38 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_KILLED, si_pid=23402, si_uid=0, si_status=SIGPIPE, si_utime=0, si_stime=12737} ---
08:41:38 rt_sigreturn({mask=[]}) = 23402
08:41:38 read(10, "", 8192) = 0
08:41:38 exit_group(141) = ?
08:41:38 +++ exited with 141 +++
from zfs-localpv.
From the logs:
time="2024-03-12T11:23:48Z" level=warning msg="Failed to close file interface : blob (code=Unknown): MultipartUpload: upload multipart failed\n\tupload id: ZjVkOWZjNTQtYzcwMi00OTJiLWIzYzctZGQ0ZDUwNTk2NzRlLjM1MDU3NmFiLWQyM2ItNGY1MC1iNjU0LTljYzA3ZjhmMWZhMg\ncaused by: TotalPartsExceeded: exceeded total allowed configured MaxUploadParts (10000). Adjust PartSize to fit in this limit" backup=velero/ZZZZ-YYYY cmd=/plugins/velero-blockstore-openebs logSource="/go/src/github.com/openebs/velero-plugin/pkg/clouduploader/conn.go:322" pluginName=velero-blockstore-openebs
Default is set to 5Mi in AWS: https://github.com/openebs/velero-plugin/blob/cea57783e3ed887d2b7b0e7bafc436ff26bd9a7b/pkg/clouduploader/conn.go#L110
Default MaxUploadParts: 10000
Max default size: 5Mi * 10000 = 50Gi
Another alternative is to change to 0 and use calculated size:
https://github.com/openebs/velero-plugin/blob/cea57783e3ed887d2b7b0e7bafc436ff26bd9a7b/pkg/clouduploader/operation.go#L54
This was a thing related with velero-plugin but I copy paste here the solution and just close the ticket. Sorry for the noise.
from zfs-localpv.
Related Issues (20)
- Driver fail to list datasets under certain circumstances HOT 1
- "Device already mounted at /var/lib/kubelet/pods" with a shared=yes ZFS dataset
- ZFS mount point configuration HOT 1
- Cross-Node Pod Access to ZFS Pool in a Multi-Node Cluster HOT 4
- Support zstd-fast compression options HOT 1
- feature: zvol as block volume without attaching to a pod HOT 7
- Erroneous release v2.4.1 HOT 4
- Default values are of the wrong type
- Volumes are not removed after PV is deleted with Delete reclaimPolicy HOT 7
- velero plugin maintenance HOT 5
- URGENT: Helm chart for 2.5.0 deletes VolumeSnapshot CRDs - including all snapshots HOT 12
- Feature request: human-readeable names of volumes (with namespacing) HOT 2
- Latest operator yaml installs version 2.4.0 instead of the latest one HOT 7
- error generating accessibility requirements HOT 4
- Not working with k0s HOT 4
- [Clone from Snapshot] CloneCommand never send HOT 34
- Block mode volumes created as filesystems HOT 1
- Avoid pushing an image to the container registries, when a branch is created on this repo
- Refactor the zfs localpv product logging and error propagation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zfs-localpv.