zfsonlinux / zfsonlinux.github.com Goto Github PK
View Code? Open in Web Editor NEWThe Official ZFS on Linux Website
Home Page: https://zfsonlinux.org
The Official ZFS on Linux Website
Home Page: https://zfsonlinux.org
I recently upgraded to v,2.2.0 on my workstation. Since this upgrade, I noticed my load average has increased +3 from what it was before. Since Linux includes uninterruptible tasks in the load calculation, I am pretty sure this is it, as I have three (new) uninterruptible sleep threads:
[jnyilas@photon:~] > uptime
16:12:25 up 5:20, 3 users, load average: 3.29, 3.32, 3.19
[jnyilas@photon:~] 2 > ps aux | grep -w D\<
root 880 0.0 0.0 0 0 ? D< 10:52 0:00 [vdev_autotrim]
root 978 0.0 0.0 0 0 ? D< 10:52 0:00 [vdev_autotrim]
root 979 0.0 0.0 0 0 ? D< 10:52 0:00 [vdev_autotrim]
Any ideas with what changed on the autotrim code path? I have been using this feature for quite a long time.
I am not seeing any abnormal latency issues nor excessive autotrim ops on my two zpools, and performance remains good despite the increased load average.
[jnyilas@photon:~] > zpool iostat -w
photon total_wait disk_wait syncq_wait asyncq_wait
latency read write read write read write read write scrub trim rebuild
---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----
1ns 0 0 0 0 0 0 0 0 0 0 0
3ns 0 0 0 0 0 0 0 0 0 0 0
7ns 0 0 0 0 0 0 0 0 0 0 0
15ns 0 0 0 0 0 0 0 0 0 0 0
31ns 0 0 0 0 0 0 0 0 0 0 0
63ns 0 0 0 0 0 0 0 0 0 0 0
127ns 0 0 0 0 0 0 0 0 0 0 0
255ns 0 0 0 0 168 2.47K 37 1.65K 2 17 0
511ns 0 0 0 0 2.90K 10.2K 603 11.3K 74 666 0
1us 0 0 0 0 2.57K 5.27K 500 18.5K 137 134 0
2us 0 0 0 0 411 2.09K 52 5.39K 33 87 0
4us 0 0 0 0 54 350 1 4.40K 8 5 0
8us 0 0 0 0 5 6 9 8.51K 7 0 0
16us 2 18.7K 26 82.0K 3 15 16 19.7K 24 2 0
32us 2 42.1K 141 104K 27 9 20 25.9K 48 0 0
65us 114 52.8K 2.25K 44.2K 58 7 52 35.8K 73 0 0
131us 4.92K 62.1K 57.2K 20.0K 51 18 115 48.9K 143 0 0
262us 2.63K 37.2K 402K 7.14K 61 26 158 22.9K 352 0 0
524us 1.14K 2.99K 38.8K 785 23 30 165 1.88K 608 352 0
1ms 1.41K 3.00K 617 1.73K 2 50 126 2.25K 1.03K 0 0
2ms 1.76K 2.29K 36 247 1 60 33 2.00K 1.61K 335 0
4ms 2.47K 1.76K 6 46 0 114 49 1.56K 2.40K 699 0
8ms 3.77K 44.4K 127 8.29K 0 596 49 35.6K 3.52K 19.3K 0
16ms 414K 1.40K 0 0 0 485 0 757 417K 822 0
33ms 59.5K 5 0 0 0 0 0 5 56.3K 2 0
67ms 5.19K 0 0 0 0 0 0 0 5.17K 0 0
134ms 3.89K 0 0 0 0 0 0 0 3.89K 0 0
268ms 227 0 0 0 0 0 0 0 224 0 0
536ms 0 0 0 0 0 0 0 0 0 0 0
1s 0 0 0 0 0 0 0 0 0 0 0
2s 0 0 0 0 0 0 0 0 0 0 0
4s 0 0 0 0 0 0 0 0 0 0 0
8s 0 0 0 0 0 0 0 0 0 0 0
17s 0 0 0 0 0 0 0 0 0 0 0
34s 0 0 0 0 0 0 0 0 0 0 0
68s 0 0 0 0 0 0 0 0 0 0 0
137s 0 0 0 0 0 0 0 0 0 0 0
---------------------------------------------------------------------------------------
photon-dr total_wait disk_wait syncq_wait asyncq_wait
latency read write read write read write read write scrub trim rebuild
---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----
1ns 0 0 0 0 0 0 0 0 0 0 0
3ns 0 0 0 0 0 0 0 0 0 0 0
7ns 0 0 0 0 0 0 0 0 0 0 0
15ns 0 0 0 0 0 0 0 0 0 0 0
31ns 0 0 0 0 0 0 0 0 0 0 0
63ns 0 0 0 0 0 0 0 0 0 0 0
127ns 0 0 0 0 0 0 0 0 0 0 0
255ns 0 0 0 0 11 132 0 0 3 0 0
511ns 0 0 0 0 73 851 1 354 182 0 0
1us 0 0 0 0 298 607 4 2.18K 731 0 0
2us 0 0 0 0 37 286 0 395 463 0 0
4us 0 0 0 0 0 26 0 28 31 0 0
8us 0 0 0 0 0 0 0 39 0 0 0
16us 0 5 0 5 0 6 0 76 16 0 0
32us 1 8 1 8 0 0 0 186 3 0 0
65us 36 12 79 35 0 0 0 442 6 0 0
131us 187 1.55K 378 9.54K 0 0 0 1.37K 26 0 0
262us 172 3.48K 309 10.4K 0 0 0 2.07K 59 0 0
524us 196 5.19K 393 3.79K 0 0 0 4.29K 161 0 0
1ms 12 8.09K 674 458 0 0 1 7.37K 10 0 0
2ms 26 4.90K 3.86K 16 0 0 0 2.95K 33 0 0
4ms 191 282 11.4K 37 0 0 0 178 184 0 0
8ms 608 374 25.2K 83 0 0 0 299 485 0 0
16ms 1.39K 360 41.5K 79 0 0 1 263 1.16K 0 0
33ms 1.11K 239 307K 28 0 0 7 203 1.04K 0 0
67ms 2.51K 0 1.79K 0 2 0 18 0 2.79K 0 0
134ms 307K 64 638 50 1 0 0 14 313K 0 0
268ms 29.9K 6 50 6 0 0 0 0 23.7K 0 0
536ms 14.8K 0 20 0 0 0 0 0 14.1K 0 0
1s 10.1K 0 11 0 0 0 0 0 9.92K 0 0
2s 8.38K 0 11 0 0 0 0 0 8.28K 0 0
4s 11.0K 0 0 0 0 0 0 0 11.0K 0 0
8s 4.85K 0 0 0 0 0 0 0 4.82K 0 0
17s 974 0 0 0 0 0 0 0 968 0 0
34s 0 0 0 0 0 0 0 0 0 0 0
68s 0 0 0 0 0 0 0 0 0 0 0
137s 0 0 0 0 0 0 0 0 0 0 0
---------------------------------------------------------------------------------------
[jnyilas@photon:~] > zpool iostat -l 5
capacity operations bandwidth total_wait disk_wait syncq_wait asyncq_wait scrub trim rebuild
pool alloc free read write read write read write read write read write read write wait wait wait
---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----
photon 45.2G 411G 26 14 2.43M 234K 14ms 1ms 202us 236us 5us 464us 365us 1ms 15ms 6ms -
photon-dr 313G 615G 20 1 16.6M 15.1K 365ms 1ms 21ms 539us 477us 739ns 34ms 1ms 361ms - -
---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----
photon 45.2G 411G 0 22 0 534K - 1ms - 155us - 336ns - 1ms - - -
photon-dr 313G 615G 0 0 0 0 - - - - - - - - - - -
---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----
[jnyilas@photon:~] > zpool iostat -q
capacity operations bandwidth syncq_read syncq_write asyncq_read asyncq_write scrubq_read trimq_write rebuildq_write
pool alloc free read write read write pend activ pend activ pend activ pend activ pend activ pend activ pend activ
---------- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- ----- -----
photon 45.2G 411G 26 14 2.41M 234K 0 0 0 0 0 0 0 0 0 0 0 0 0 0
photon-dr 313G 615G 20 1 16.4M 15.0K 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Distribution Name | Debian
Distribution Version | Buster
Kernel Version | 4.19.0-18
Architecture | amd64
ZFS Version | 2.0.3-9~bpo10+1
HARDWARE: On-Premise AMD Athlon-II X3 460, 4 GB RAM + 4GB swap, SATA-II motherboard, SATA3 60 GB SSD as ext4 on (/), SATA3 1 TB HDD as ZFS. I/O speed is limited to 3 GBs due to motherboard.
(/) resides on ext4 SSD while ZFS mounts to /home and Zpool is ashift=12
I install (Debian Buster based) Yunohost on the SSD, then mount ZFS. I then begin installing Apps from YNH and they fail mostly with permission problems (ie not allowed). If I do a clean install and do not mount the ZFS dataset, Apps installations complete normally.
Install Apps w/o ZFS mounted vs install Apps with ZFS mounted
I don't have these
Could the error be due to aclmode/aclinherit? The ZFS dataset properties (redacted):
quota none default
reservation none default
recordsize 128K default
mountpoint /home local
sharenfs off default
checksum on default
compression lz4 inherited from tank0
atime on default
devices on default
exec on default
setuid on default
readonly off default
zoned off default
snapdir hidden default
aclmode discard default
aclinherit restricted default
xattr on default
version 5 -
utf8only off -
normalization none -
casesensitivity sensitive -
vscan off default
nbmand off default
sharesmb off default
refquota none default
refreservation none default
refcompressratio 1.49x -
acltype off default
context none default
fscontext none default
defcontext none default
rootcontext none default
relatime off default
redundant_metadata all default
overlay on default
encryption off default```
The Official ZFS on Linux Website http://zfsonlinux.org
http://zfsonlinux.org redirects to https://zfsonlinux.org
After an initrd.img rebuild failed for lack of space on the boot pool the partition size was 277MB. After removing one of three kernels, the partition size reported was down to 200MB. After removing one of the two remaining kernels the partition roported is only 122MB. Needless to say rebuilding initrd.img has not succeeded.
A scrub of the pool comes up clean.
Does anyone have any ideas?
Hello!
I was wondering, should commit 5e6bd35 be rolled back? I ask because, even though @behlendorf pulled 0.7.7 from the CentOS and RPM repos (in openzfs/zfs#7401), the release is still being pushed as the latest version on zfsonlinux.org
Apologies if this isn't filed in the right place!
Will 2.2.3 RPMs for EPEL get added to the repo at any point in time? Right now the latest is the 2.1.x branch on http://download.zfsonlinux.org/epel/9.3/x86_64/
Hi the Team!
This is a kind reminder that Fedora 39 is here and it would be nice to have ZFS support on it.
Have a good day!
Is there no repo for Fedora 40?
Regards
Hi the Team!
This is a kind reminder that Fedora 38 is there and would be nice to share RPMs for it.
Have a good day!
Hello,
you guys are not offering your repository via ipv6.
tested: https://zfsonlinux.org/epel/zfs-release-2-2.el9.noarch.rpm
Not all message IDs printed by zpool(8)
was available on the website. For example:
pool: test-pool
id: 14353959861126743093
state: UNAVAIL
status: The pool is formatted using an incompatible version.
action: The pool cannot be imported. Access the pool on a system running newer
software, or recreate the pool from backup.
see: http://zfsonlinux.org/msg/ZFS-8000-A5
config:
...
A 404 error was given when trying to access this page http://zfsonlinux.org/msg/ZFS-8000-A5
Could you make a 8.7 EPEL rpm package available? With RHEL and others like AlmaLinux being at version 8.7, I'm hoping to see ZFS support of the same. Though, for EPEL rpm packages released here, I see 8.6 is still the latest.
I'm not sure if this is the right place to ask this. If there is a more appropriate workflow for a release request, please let me know. Thank you and I truly appreciate the value you provide the community.
Currently only version 2.1.11 is available in the EL8 repository.
Steps to reproduce:
sudo dnf install https://zfsonlinux.org/epel/zfs-release-2-3$(rpm --eval "%{dist}").noarch.rpm
sudo dnf install -y zfs-2.1.9*
ZFS on Linux for EL8 - dkms 3.6 kB/s | 2.9 kB 00:00
ZFS on Linux for EL8 - dkms 37 kB/s | 57 kB 00:01
No match for argument: zfs-2.1.9*
Error: Unable to find a match: zfs-2.1.9*
The only package listed is version 2.1.11:
sudo dnf list --showduplicates zfs
Docker CE Stable - x86_64 358 kB/s | 45 kB 00:00
Ksplice Uptrack for Oracle Linux 3.9 kB/s | 5.0 kB 00:01
Oracle Linux 8 EPEL Packages for Development (x86_64) 80 MB/s | 46 MB 00:00
Oracle Linux 8 EPEL Modular Packages for Development (x86_64) 3.6 MB/s | 322 kB 00:00
Oracle Linux 8 BaseOS Latest (x86_64) 95 MB/s | 58 MB 00:00
Oracle Linux 8 Application Stream (x86_64) 108 MB/s | 45 MB 00:00
Oracle Linux 8 Addons (x86_64) 46 MB/s | 6.9 MB 00:00
packages-microsoft-com-prod 60 MB/s | 7.2 MB 00:00
Latest Unbreakable Enterprise Kernel Release 7 for Oracle Linux 8 (x86_64) 85 MB/s | 15 MB 00:00
ZFS on Linux for EL8 - dkms 37 kB/s | 57 kB 00:01
Available Packages
zfs.x86_64 2.1.11-2.el8 zfs
Some of the msg pages use an irregular html layout from being imported from opensolaris/illumos, as well as using illumos drive names and possibly other references like man page categories. Should also make a template for new msg pages. I'll try to work on these after the holidays.
It seems as though that Fedora 39 has moved to a 6.7 kernel, but the ZFS packages only support up to 6.6.
When I try and build the following Containerfile, I get the accompanying result.
https://github.com/benradey/silverblue-images/blob/main/f38-server/Containerfile
[2/2] STEP 6/11: RUN rpm-ostree install zfs && dkms autoinstall -k $(rpm -qa kernel --queryformat '%{VERSION}-%{RELEASE}.%{ARCH}') && rm -vrf /var && ostree container commit
Enabled rpm-md repositories: zfs fedora updates fedora-cisco-openh264 updates-archive
Updating metadata for 'zfs'...done
Updating metadata for 'fedora'...done
Updating metadata for 'updates'...done
Updating metadata for 'fedora-cisco-openh264'...done
Updating metadata for 'updates-archive'...done
Importing rpm-md...done
rpm-md repo 'zfs'; generated: 2023-12-01T01:01:53Z solvables: 34
rpm-md repo 'fedora'; generated: 2023-11-01T00:12:39Z solvables: 70825
rpm-md repo 'updates'; generated: 2024-02-16T01:33:31Z solvables: 22404
rpm-md repo 'fedora-cisco-openh264'; generated: 2023-03-14T10:57:01Z solvables: 4
rpm-md repo 'updates-archive'; generated: 2024-02-16T02:00:01Z solvables: 30428
Resolving dependencies...done
error: Could not depsolve transaction; 1 problem detected:
Problem: conflicting requests
- package zfs-2.2.1-1.fc39.x86_64 from zfs requires zfs-kmod = 2.2.1, but none of the providers can be installed
- package zfs-2.2.2-1.fc39.x86_64 from zfs requires zfs-kmod = 2.2.2, but none of the providers can be installed
- package zfs-dkms-2.2.1-1.fc39.noarch from zfs requires kernel-devel <= 6.6.999, but none of the providers can be installed
- package zfs-dkms-2.2.2-1.fc39.noarch from zfs requires kernel-devel <= 6.6.999, but none of the providers can be installed
- cannot install both kernel-devel-6.5.6-300.fc39.x86_64 from fedora and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.5.10-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.5.11-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.5.12-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.5.9-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.11-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.12-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.13-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.14-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.2-201.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.3-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.4-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.6-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.7-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.8-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
- cannot install both kernel-devel-6.6.9-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
Error: building at STEP "RUN rpm-ostree install zfs && dkms autoinstall -k $(rpm -qa kernel --queryformat '%{VERSION}-%{RELEASE}.%{ARCH}') && rm -vrf /var && ostree container commit": while running runtime: exit status 1
Is it possible to generate ZFS packages that support kernel 6.7?
archive.zfsonlinux.org currently points to
archive.zfsonlinux.org. 3588 IN CNAME archive.zfsonlinux.org.s3.amazonaws.com.
s3.amazonaws.com is a legacy name for the us-east-1 endpoint, see http://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region . IPv6-enabled (dualstack, IPv4+IPv6) endpoints are now available for all regions, see http://docs.aws.amazon.com/AmazonS3/latest/dev/dual-stack-endpoints.html as well.
Please update the archive.zfsonlinux.org CNAME to archive.zfsonlinux.org.s3.dualstack.us-east-1.amazonaws.com to allow native access from IPv6 clients
You can test the download before using http://archive.zfsonlinux.org.s3.dualstack.us-east-1.amazonaws.com/downloads/zfsonlinux/zfs/zfs-0.6.5.7.tar.gz
now that zfs can build and run on 5.19
could you make a release for fedora37 ?
pretty please?
It's seems like ZFS 2.2.x is not available on EL9 platforms. On Rocky 9.3 the latest available version is 2.1.14-2.el9
.
Could the newer versions be released for EL9?
When trying to install on Centos7 got:
failure: repodata/repomd.xml from zfs: [Errno 256] No more mirrors to try.
http://download.zfsonlinux.org/epel/7/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: download.zfsonlinux.org; Unknown error"
Following this guide, when I run yum update
after
yum install https://zfsonlinux.org/epel/zfs-release-2-2$(rpm --eval "%{dist}").noarch.rpm
We have about 4TB of data on a 1TB SSD EBS volume on AWS using Amazon Linux 2.
Everything is working great, except for random lockups every couple of days. Would love to be able to post some stack traces, but can't seem to figure out how to get them.
Linux myserver 4.14.262-200.489.amzn2.x86_64 #1 SMP Fri Feb 4 20:34:30 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.