Giter VIP home page Giter VIP logo

Comments (2)

pando85 avatar pando85 commented on August 19, 2024

Digging a bit deeper

Strace in zfs host. I executed this strace -p ${PID} -t. Where processes in PID var are:

  • nc -w ${IP} ${PORT} process:
08:41:36 read(0, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = 8192ec=0}) = 1 (in [0], left {tv_sec=2, tv_usec=999996
08:41:36 write(3, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = -1 ECONNRESET (Connection reset by peer)\312\254\24\304f\261V`\216qDq\21ke\267\306Q"..., 8
08:41:36 write(3, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = -1 EPIPE (Broken pipe)
...
08:41:38 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=23401, si_uid=0} ---
08:41:38 write(3, "8\250aE<\374^\235T\244\201\314\367x\230%e\23\377H$\276K\373\255h\205\33\310!*I"..., 8192) = -1 EPIPE (Broken pipe)
08:41:38 --- SIGPIPE {si_signo=SIGPIPE, si_code=SI_USER, si_pid=23401, si_uid=0} ---
08:41:38 close(3)                       = 0
08:41:38 exit_group(1)                  = ?
08:41:38 +++ exited with 1 +++
  • /bin/sh /sbin/zfs send XXXX@YYYY (in /sbin/zfs send XXXX@YYYY I receive a exit 1 error instantly when executed):
strace: Process ${PID} attached
06:57:42 wait4(-1, [{WIFSIGNALED(s) && WTERMSIG(s) == SIGPIPE}], 0, NULL) = 23402
08:41:38 --- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_KILLED, si_pid=23402, si_uid=0, si_status=SIGPIPE, si_utime=0, si_stime=12737} ---
08:41:38 rt_sigreturn({mask=[]})        = 23402
08:41:38 read(10, "", 8192)             = 0
08:41:38 exit_group(141)                = ?
08:41:38 +++ exited with 141 +++

from zfs-localpv.

pando85 avatar pando85 commented on August 19, 2024

From the logs:

time="2024-03-12T11:23:48Z" level=warning msg="Failed to close file interface : blob (code=Unknown): MultipartUpload: upload multipart failed\n\tupload id: ZjVkOWZjNTQtYzcwMi00OTJiLWIzYzctZGQ0ZDUwNTk2NzRlLjM1MDU3NmFiLWQyM2ItNGY1MC1iNjU0LTljYzA3ZjhmMWZhMg\ncaused by: TotalPartsExceeded: exceeded total allowed configured MaxUploadParts (10000). Adjust PartSize to fit in this limit" backup=velero/ZZZZ-YYYY cmd=/plugins/velero-blockstore-openebs logSource="/go/src/github.com/openebs/velero-plugin/pkg/clouduploader/conn.go:322" pluginName=velero-blockstore-openebs

Default is set to 5Mi in AWS: https://github.com/openebs/velero-plugin/blob/cea57783e3ed887d2b7b0e7bafc436ff26bd9a7b/pkg/clouduploader/conn.go#L110
Default MaxUploadParts: 10000
Max default size: 5Mi * 10000 = 50Gi
Another alternative is to change to 0 and use calculated size:
https://github.com/openebs/velero-plugin/blob/cea57783e3ed887d2b7b0e7bafc436ff26bd9a7b/pkg/clouduploader/operation.go#L54

This was a thing related with velero-plugin but I copy paste here the solution and just close the ticket. Sorry for the noise.

from zfs-localpv.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.