Giter VIP home page Giter VIP logo

zfsonlinux.github.com's Issues

Shrinking boot pool

After an initrd.img rebuild failed for lack of space on the boot pool the partition size was 277MB. After removing one of three kernels, the partition size reported was down to 200MB. After removing one of the two remaining kernels the partition roported is only 122MB. Needless to say rebuilding initrd.img has not succeeded.
A scrub of the pool comes up clean.
Does anyone have any ideas?

Fedora 39

Hi the Team!

This is a kind reminder that Fedora 39 is here and it would be nice to have ZFS support on it.

Have a good day!

Linux load average increased since 2.2.0

I recently upgraded to v,2.2.0 on my workstation. Since this upgrade, I noticed my load average has increased +3 from what it was before. Since Linux includes uninterruptible tasks in the load calculation, I am pretty sure this is it, as I have three (new) uninterruptible sleep threads:

[jnyilas@photon:~]  > uptime
 16:12:25  up   5:20,  3 users,  load average: 3.29, 3.32, 3.19

[jnyilas@photon:~] 2 > ps aux | grep -w D\<
root       880  0.0  0.0      0     0 ?        D<   10:52   0:00 [vdev_autotrim]
root       978  0.0  0.0      0     0 ?        D<   10:52   0:00 [vdev_autotrim]
root       979  0.0  0.0      0     0 ?        D<   10:52   0:00 [vdev_autotrim]

Any ideas with what changed on the autotrim code path? I have been using this feature for quite a long time.
I am not seeing any abnormal latency issues nor excessive autotrim ops on my two zpools, and performance remains good despite the increased load average.

[jnyilas@photon:~] > zpool iostat -w

photon       total_wait     disk_wait    syncq_wait    asyncq_wait
latency      read  write   read  write   read  write   read  write  scrub   trim  rebuild
----------  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----
1ns             0      0      0      0      0      0      0      0      0      0      0
3ns             0      0      0      0      0      0      0      0      0      0      0
7ns             0      0      0      0      0      0      0      0      0      0      0
15ns            0      0      0      0      0      0      0      0      0      0      0
31ns            0      0      0      0      0      0      0      0      0      0      0
63ns            0      0      0      0      0      0      0      0      0      0      0
127ns           0      0      0      0      0      0      0      0      0      0      0
255ns           0      0      0      0    168  2.47K     37  1.65K      2     17      0
511ns           0      0      0      0  2.90K  10.2K    603  11.3K     74    666      0
1us             0      0      0      0  2.57K  5.27K    500  18.5K    137    134      0
2us             0      0      0      0    411  2.09K     52  5.39K     33     87      0
4us             0      0      0      0     54    350      1  4.40K      8      5      0
8us             0      0      0      0      5      6      9  8.51K      7      0      0
16us            2  18.7K     26  82.0K      3     15     16  19.7K     24      2      0
32us            2  42.1K    141   104K     27      9     20  25.9K     48      0      0
65us          114  52.8K  2.25K  44.2K     58      7     52  35.8K     73      0      0
131us       4.92K  62.1K  57.2K  20.0K     51     18    115  48.9K    143      0      0
262us       2.63K  37.2K   402K  7.14K     61     26    158  22.9K    352      0      0
524us       1.14K  2.99K  38.8K    785     23     30    165  1.88K    608    352      0
1ms         1.41K  3.00K    617  1.73K      2     50    126  2.25K  1.03K      0      0
2ms         1.76K  2.29K     36    247      1     60     33  2.00K  1.61K    335      0
4ms         2.47K  1.76K      6     46      0    114     49  1.56K  2.40K    699      0
8ms         3.77K  44.4K    127  8.29K      0    596     49  35.6K  3.52K  19.3K      0
16ms         414K  1.40K      0      0      0    485      0    757   417K    822      0
33ms        59.5K      5      0      0      0      0      0      5  56.3K      2      0
67ms        5.19K      0      0      0      0      0      0      0  5.17K      0      0
134ms       3.89K      0      0      0      0      0      0      0  3.89K      0      0
268ms         227      0      0      0      0      0      0      0    224      0      0
536ms           0      0      0      0      0      0      0      0      0      0      0
1s              0      0      0      0      0      0      0      0      0      0      0
2s              0      0      0      0      0      0      0      0      0      0      0
4s              0      0      0      0      0      0      0      0      0      0      0
8s              0      0      0      0      0      0      0      0      0      0      0
17s             0      0      0      0      0      0      0      0      0      0      0
34s             0      0      0      0      0      0      0      0      0      0      0
68s             0      0      0      0      0      0      0      0      0      0      0
137s            0      0      0      0      0      0      0      0      0      0      0
---------------------------------------------------------------------------------------

photon-dr    total_wait     disk_wait    syncq_wait    asyncq_wait
latency      read  write   read  write   read  write   read  write  scrub   trim  rebuild
----------  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----
1ns             0      0      0      0      0      0      0      0      0      0      0
3ns             0      0      0      0      0      0      0      0      0      0      0
7ns             0      0      0      0      0      0      0      0      0      0      0
15ns            0      0      0      0      0      0      0      0      0      0      0
31ns            0      0      0      0      0      0      0      0      0      0      0
63ns            0      0      0      0      0      0      0      0      0      0      0
127ns           0      0      0      0      0      0      0      0      0      0      0
255ns           0      0      0      0     11    132      0      0      3      0      0
511ns           0      0      0      0     73    851      1    354    182      0      0
1us             0      0      0      0    298    607      4  2.18K    731      0      0
2us             0      0      0      0     37    286      0    395    463      0      0
4us             0      0      0      0      0     26      0     28     31      0      0
8us             0      0      0      0      0      0      0     39      0      0      0
16us            0      5      0      5      0      6      0     76     16      0      0
32us            1      8      1      8      0      0      0    186      3      0      0
65us           36     12     79     35      0      0      0    442      6      0      0
131us         187  1.55K    378  9.54K      0      0      0  1.37K     26      0      0
262us         172  3.48K    309  10.4K      0      0      0  2.07K     59      0      0
524us         196  5.19K    393  3.79K      0      0      0  4.29K    161      0      0
1ms            12  8.09K    674    458      0      0      1  7.37K     10      0      0
2ms            26  4.90K  3.86K     16      0      0      0  2.95K     33      0      0
4ms           191    282  11.4K     37      0      0      0    178    184      0      0
8ms           608    374  25.2K     83      0      0      0    299    485      0      0
16ms        1.39K    360  41.5K     79      0      0      1    263  1.16K      0      0
33ms        1.11K    239   307K     28      0      0      7    203  1.04K      0      0
67ms        2.51K      0  1.79K      0      2      0     18      0  2.79K      0      0
134ms        307K     64    638     50      1      0      0     14   313K      0      0
268ms       29.9K      6     50      6      0      0      0      0  23.7K      0      0
536ms       14.8K      0     20      0      0      0      0      0  14.1K      0      0
1s          10.1K      0     11      0      0      0      0      0  9.92K      0      0
2s          8.38K      0     11      0      0      0      0      0  8.28K      0      0
4s          11.0K      0      0      0      0      0      0      0  11.0K      0      0
8s          4.85K      0      0      0      0      0      0      0  4.82K      0      0
17s           974      0      0      0      0      0      0      0    968      0      0
34s             0      0      0      0      0      0      0      0      0      0      0
68s             0      0      0      0      0      0      0      0      0      0      0
137s            0      0      0      0      0      0      0      0      0      0      0
---------------------------------------------------------------------------------------
[jnyilas@photon:~] > zpool iostat -l 5
              capacity     operations     bandwidth    total_wait     disk_wait    syncq_wait    asyncq_wait  scrub   trim  rebuild
pool        alloc   free   read  write   read  write   read  write   read  write   read  write   read  write   wait   wait   wait
----------  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----
photon      45.2G   411G     26     14  2.43M   234K   14ms    1ms  202us  236us    5us  464us  365us    1ms   15ms    6ms      -
photon-dr    313G   615G     20      1  16.6M  15.1K  365ms    1ms   21ms  539us  477us  739ns   34ms    1ms  361ms      -      -
----------  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----
photon      45.2G   411G      0     22      0   534K      -    1ms      -  155us      -  336ns      -    1ms      -      -      -
photon-dr    313G   615G      0      0      0      0      -      -      -      -      -      -      -      -      -      -      -
----------  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----

[jnyilas@photon:~] > zpool iostat -q
              capacity     operations     bandwidth    syncq_read    syncq_write   asyncq_read  asyncq_write   scrubq_read   trimq_write  rebuildq_write
pool        alloc   free   read  write   read  write   pend  activ   pend  activ   pend  activ   pend  activ   pend  activ   pend  activ   pend  activ
----------  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----  -----
photon      45.2G   411G     26     14  2.41M   234K      0      0      0      0      0      0      0      0      0      0      0      0      0      0
photon-dr    313G   615G     20      1  16.4M  15.0K      0      0      0      0      0      0      0      0      0      0      0      0      0      0

Is download.zfsonlinux.org offline?

When trying to install on Centos7 got:

failure: repodata/repomd.xml from zfs: [Errno 256] No more mirrors to try.
http://download.zfsonlinux.org/epel/7/x86_64/repodata/repomd.xml: [Errno 14] curl#6 - "Could not resolve host: download.zfsonlinux.org; Unknown error"

Following this guide, when I run yum update after
yum install https://zfsonlinux.org/epel/zfs-release-2-2$(rpm --eval "%{dist}").noarch.rpm

Instability on AL2

We have about 4TB of data on a 1TB SSD EBS volume on AWS using Amazon Linux 2.

Everything is working great, except for random lockups every couple of days. Would love to be able to post some stack traces, but can't seem to figure out how to get them.

Linux myserver 4.14.262-200.489.amzn2.x86_64 #1 SMP Fri Feb 4 20:34:30 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

SSD blocksize

Here we say the blocksize of the Samsung 840 is 8192 however here joyent say it is 4096. Which is correct, how important is this and what is the process to determine the physical blocksize? Since NTFS defaults to 4k clusters in this size range won't all hardware be optimised for 4K I/O?

Please point archive.zfsonlinux.org to Dualstack S3 endpoint

archive.zfsonlinux.org currently points to

archive.zfsonlinux.org. 3588 IN CNAME archive.zfsonlinux.org.s3.amazonaws.com.

s3.amazonaws.com is a legacy name for the us-east-1 endpoint, see http://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region . IPv6-enabled (dualstack, IPv4+IPv6) endpoints are now available for all regions, see http://docs.aws.amazon.com/AmazonS3/latest/dev/dual-stack-endpoints.html as well.

Please update the archive.zfsonlinux.org CNAME to archive.zfsonlinux.org.s3.dualstack.us-east-1.amazonaws.com to allow native access from IPv6 clients

You can test the download before using http://archive.zfsonlinux.org.s3.dualstack.us-east-1.amazonaws.com/downloads/zfsonlinux/zfs/zfs-0.6.5.7.tar.gz

msg pages should be linuxisized and use the same page layout

Some of the msg pages use an irregular html layout from being imported from opensolaris/illumos, as well as using illumos drive names and possibly other references like man page categories. Should also make a template for new msg pages. I'll try to work on these after the holidays.

Release request for EPEL 8.7

Could you make a 8.7 EPEL rpm package available? With RHEL and others like AlmaLinux being at version 8.7, I'm hoping to see ZFS support of the same. Though, for EPEL rpm packages released here, I see 8.6 is still the latest.

I'm not sure if this is the right place to ask this. If there is a more appropriate workflow for a release request, please let me know. Thank you and I truly appreciate the value you provide the community.

Fedora 38

Hi the Team!

This is a kind reminder that Fedora 38 is there and would be nice to share RPMs for it.

Have a good day!

ZFS 2.2 fails to install in Fedora 39 Silverblue with 6.7 kernel

It seems as though that Fedora 39 has moved to a 6.7 kernel, but the ZFS packages only support up to 6.6.

When I try and build the following Containerfile, I get the accompanying result.
https://github.com/benradey/silverblue-images/blob/main/f38-server/Containerfile

[2/2] STEP 6/11: RUN rpm-ostree install zfs &&     dkms autoinstall -k $(rpm -qa kernel --queryformat '%{VERSION}-%{RELEASE}.%{ARCH}') &&     rm -vrf /var &&     ostree container commit
Enabled rpm-md repositories: zfs fedora updates fedora-cisco-openh264 updates-archive
Updating metadata for 'zfs'...done
Updating metadata for 'fedora'...done
Updating metadata for 'updates'...done
Updating metadata for 'fedora-cisco-openh264'...done
Updating metadata for 'updates-archive'...done
Importing rpm-md...done
rpm-md repo 'zfs'; generated: 2023-12-01T01:01:53Z solvables: 34
rpm-md repo 'fedora'; generated: 2023-11-01T00:12:39Z solvables: 70825
rpm-md repo 'updates'; generated: 2024-02-16T01:33:31Z solvables: 22404
rpm-md repo 'fedora-cisco-openh264'; generated: 2023-03-14T10:57:01Z solvables: 4
rpm-md repo 'updates-archive'; generated: 2024-02-16T02:00:01Z solvables: 30428
Resolving dependencies...done
error: Could not depsolve transaction; 1 problem detected:
 Problem: conflicting requests
  - package zfs-2.2.1-1.fc39.x86_64 from zfs requires zfs-kmod = 2.2.1, but none of the providers can be installed
  - package zfs-2.2.2-1.fc39.x86_64 from zfs requires zfs-kmod = 2.2.2, but none of the providers can be installed
  - package zfs-dkms-2.2.1-1.fc39.noarch from zfs requires kernel-devel <= 6.6.999, but none of the providers can be installed
  - package zfs-dkms-2.2.2-1.fc39.noarch from zfs requires kernel-devel <= 6.6.999, but none of the providers can be installed
  - cannot install both kernel-devel-6.5.6-300.fc39.x86_64 from fedora and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.5.10-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.5.11-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.5.12-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.5.9-300.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.11-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.12-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.13-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.14-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.2-201.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.3-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.4-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.6-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.7-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.8-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
  - cannot install both kernel-devel-6.6.9-200.fc39.x86_64 from updates-archive and kernel-devel-6.7.4-200.fc39.x86_64 from @System
Error: building at STEP "RUN rpm-ostree install zfs &&     dkms autoinstall -k $(rpm -qa kernel --queryformat '%{VERSION}-%{RELEASE}.%{ARCH}') &&     rm -vrf /var &&     ostree container commit": while running runtime: exit status 1

Is it possible to generate ZFS packages that support kernel 6.7?

Fedora 40

Is there no repo for Fedora 40?

Regards

ZFS Breaks Install Scripts with Permission Error (Root on EXT4)

System information

Distribution Name | Debian
Distribution Version | Buster
Kernel Version | 4.19.0-18
Architecture | amd64
ZFS Version | 2.0.3-9~bpo10+1

Describe the problem you're observing

HARDWARE: On-Premise AMD Athlon-II X3 460, 4 GB RAM + 4GB swap, SATA-II motherboard, SATA3 60 GB SSD as ext4 on (/), SATA3 1 TB HDD as ZFS. I/O speed is limited to 3 GBs due to motherboard.

(/) resides on ext4 SSD while ZFS mounts to /home and Zpool is ashift=12

I install (Debian Buster based) Yunohost on the SSD, then mount ZFS. I then begin installing Apps from YNH and they fail mostly with permission problems (ie not allowed). If I do a clean install and do not mount the ZFS dataset, Apps installations complete normally.

Describe how to reproduce the problem

Install Apps w/o ZFS mounted vs install Apps with ZFS mounted

Include any warning/errors/backtraces from the system logs

I don't have these

Could the error be due to aclmode/aclinherit? The ZFS dataset properties (redacted):

quota                 none                   default
reservation           none                   default
recordsize            128K                   default
mountpoint            /home                  local
sharenfs              off                    default
checksum              on                     default
compression           lz4                    inherited from tank0
atime                 on                     default
devices               on                     default
exec                  on                     default
setuid                on                     default
readonly              off                    default
zoned                 off                    default
snapdir               hidden                 default
aclmode               discard                default
aclinherit            restricted             default
xattr                 on                     default
version               5                      -
utf8only              off                    -
normalization         none                   -
casesensitivity       sensitive              -
vscan                 off                    default
nbmand                off                    default
sharesmb              off                    default
refquota              none                   default
refreservation        none                   default
refcompressratio      1.49x                  -
acltype               off                    default
context               none                   default
fscontext             none                   default
defcontext            none                   default
rootcontext           none                   default
relatime              off                    default
redundant_metadata    all                    default
overlay               on                     default
encryption            off                    default```

Missing message ID

Not all message IDs printed by zpool(8) was available on the website. For example:

pool: test-pool
id: 14353959861126743093
state: UNAVAIL
status: The pool is formatted using an incompatible version.
action: The pool cannot be imported. Access the pool on a system running newer
software, or recreate the pool from backup.
see: http://zfsonlinux.org/msg/ZFS-8000-A5
config:
...

A 404 error was given when trying to access this page http://zfsonlinux.org/msg/ZFS-8000-A5

Release ZFS 2.2 for EL9

It's seems like ZFS 2.2.x is not available on EL9 platforms. On Rocky 9.3 the latest available version is 2.1.14-2.el9.

Could the newer versions be released for EL9?

fedora37 release?

now that zfs can build and run on 5.19
could you make a release for fedora37 ?

pretty please?

EL8 packages missing

Currently only version 2.1.11 is available in the EL8 repository.

Steps to reproduce:

sudo dnf install https://zfsonlinux.org/epel/zfs-release-2-3$(rpm --eval "%{dist}").noarch.rpm

sudo dnf install -y zfs-2.1.9*
ZFS on Linux for EL8 - dkms                                                           3.6 kB/s | 2.9 kB     00:00
ZFS on Linux for EL8 - dkms                                                            37 kB/s |  57 kB     00:01
No match for argument: zfs-2.1.9*
Error: Unable to find a match: zfs-2.1.9*

The only package listed is version 2.1.11:

sudo dnf list --showduplicates zfs                                                                      
Docker CE Stable - x86_64                                                             358 kB/s |  45 kB     00:00
Ksplice Uptrack for Oracle Linux                                                      3.9 kB/s | 5.0 kB     00:01
Oracle Linux 8 EPEL Packages for Development (x86_64)                                  80 MB/s |  46 MB     00:00
Oracle Linux 8 EPEL Modular Packages for Development (x86_64)                         3.6 MB/s | 322 kB     00:00
Oracle Linux 8 BaseOS Latest (x86_64)                                                  95 MB/s |  58 MB     00:00
Oracle Linux 8 Application Stream (x86_64)                                            108 MB/s |  45 MB     00:00
Oracle Linux 8 Addons (x86_64)                                                         46 MB/s | 6.9 MB     00:00
packages-microsoft-com-prod                                                            60 MB/s | 7.2 MB     00:00
Latest Unbreakable Enterprise Kernel Release 7 for Oracle Linux 8 (x86_64)             85 MB/s |  15 MB     00:00
ZFS on Linux for EL8 - dkms                                                            37 kB/s |  57 kB     00:01
Available Packages
zfs.x86_64                                              2.1.11-2.el8                                               zfs

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.