Comments (1)
fcorbelli
commented on September 17, 2024
Well... in fact... no
No, because zpaqfranz does more "background things" than 7.15 (calc CRC-32 and one hash, xxhash64 for default compatibility with 32bit-version)
The key is here
Integrity check type: XXHASH64+CRC-32 + CRC-32 by fragments
More details on this topic
(https://encode.su/threads/3658-How-big-can-the-hash-slowdown-in-an-archiver-be-tolerable)
This will detect (not fix) SHA-1 collisions, and made much faster the v (verify) command against the filesystem, that can be run in multithreaded mode (-all)
In other words, in real life NVMe scenarios, verify data @2GB/s sustained
It is also possible to use safer-level hashes (BLAKE3, SHA-2 and even SHA-3) which give certainty in storage (SHA-2-256 is a legal standard in Europe)
Short version: zpaqfranz is developed to increase security in copies, check and verify, not for speed (a typical execution takes tens of minutes or even hours)
The difference in philosophy is
- mr. Mahoney (the initial developer) is a highly skilled compression-code programmer (so for him the minimum size, maximum speed etc is very important)
- I am a disaster recovery manager: for me the reliability is everything => a "not tested" backup is just... nothing. If there was a software more suited to my needs I would have used it, instead of developing zpaq (not very smart to reinvent the wheel). But I don't know any
The matter is moot (as in the forum thread): what is your opinion?
Here some data
C:\zpaqfranz\release\54_9>zpaqfranz a z:\uno j:\Image2.nrg
zpaqfranz v54.9-experimental (HW BLAKE3), SFX64 v52.15, compiled Nov 4 2021
Integrity check type: XXHASH64+CRC-32 + CRC-32 by fragments
Creating z:/uno.zpaq at offset 0 + 0
Adding 4.291.166.334 (4.00 GB) in 1 files at 2021-12-08 12:42:13
94.65% 00:00:00 ( 3.78 GB) -> ( 3.76 GB) of ( 4.00 GB) 227.84 MB/sec
1 +added, 0 -removed.
0 + (4.291.166.334 -> 4.289.765.038 -> 4.288.313.145) = 4.288.313.145
19.328 seconds (000:00:19) (all OK)
You can disable zpaqfranz's extension, running just like 7.15
C:\zpaqfranz\release\54_9>zpaqfranz a z:\uno j:\Image2.nrg -715
zpaqfranz v54.9-experimental (HW BLAKE3), SFX64 v52.15, compiled Nov 4 2021
franz:mode -715 activated
**** Activated V7.15 mode ****
T forcezfs,donotforcexls,forcewindows; F crc32,checksum,filelist,xxhash,xxh3,fixeml,fix255,utf,flat
Integrity check type: NOTHING (LIKE 7.15)
Creating z:/uno.zpaq at offset 0 + 0
Adding 4.291.166.334 (4.00 GB) in 1 files at 2021-12-08 12:43:41
93.86% 00:00:00 ( 3.75 GB) -> ( 3.73 GB) of ( 4.00 GB) 256.08 MB/sec
1 +added, 0 -removed.
0 + (4.291.166.334 -> 4.289.765.038 -> 4.288.313.109) = 4.288.313.109
16.937 seconds (000:00:16) (all OK)
As you can see "zpaqfranz 7.15" is faster (just a bit) than the original 7.15
C:\zpaqfranz\release\54_9>c:\zpaqfranz\715 a z:\uno j:\Image2.nrg -summary 1
zpaq v7.15 journaling archiver, compiled Aug 21 2020
Creating z:/uno.zpaq at offset 0 + 0
Adding 4291.166334 MB in 1 files -method 14 -threads 32 at 2021-12-08 12:44:44.
1 +added, 0 -removed.
0.000000 + (4291.166334 -> 4289.765038 -> 4288.313109) = 4288.313109 MB
18.500 seconds (all OK)
Or you can retain some of zpaqfranz enhancements, but without -nochecksums
C:\zpaqfranz\release\54_9>zpaqfranz a z:\uno j:\Image2.nrg -nochecksum
zpaqfranz v54.9-experimental (HW BLAKE3), SFX64 v52.15, compiled Nov 4 2021
franz:NO checksum (-nochecksum)
Integrity check type: NOTHING (LIKE 7.15)
Creating z:/uno.zpaq at offset 0 + 0
Adding 4.291.166.334 (4.00 GB) in 1 files at 2021-12-08 13:00:58
94.25% 00:00:00 ( 3.77 GB) -> ( 3.75 GB) of ( 4.00 GB) 257.14 MB/sec
1 +added, 0 -removed.
0 + (4.291.166.334 -> 4.289.765.038 -> 4.288.313.109) = 4.288.313.109
17.078 seconds (000:00:17) (all OK)
from zpaqfranz.
Related Issues (20)
- windows VSS and verify issue HOT 13
- integrating with other software HOT 3
- Memory consumption HOT 14
- Found Unix attributes on Windows => checking for collision HOT 5
- buffer overflow after compiling with FORTIFY_SOURCE=3 HOT 3
- Trim command not working on multi part archive? HOT 3
- Respect NO_COLOR HOT 4
- Backup command index path HOT 17
- Problem in exporting and viewing HOT 5
- bug with -all HOT 27
- Backup with -test fails when -replace or -to is used HOT 46
- v60 build for linux? HOT 12
- Silly but nice request.....Automation for all users. HOT 2
- Ran a command, program suddenly stop (crash I think, its leave 0 byte zpaq file) without any notice HOT 9
- Illegal instruction error on aarch64 while decompressing with JIT HOT 7
- Disabling the display of files in the "sum" HOT 4
- -verify commandline argument for command a (add) overlaps with -test -> both trigger a filesystem based hash check HOT 8
- Feature request: 2-pass/block-based archive mode. HOT 10
- Machine-parseable output (`-terse` ?) and failure to restore a file HOT 31
- Ctrl+C Error on Synology HOT 16
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zpaqfranz.