koverstreet / bcachefs Goto Github PK
View Code? Open in Web Editor NEWLicense: Other
bcachefs's People
Stargazers
Watchers
Forkers
narayan-iyengar modelrockettier hyperfekt zhenshuitieniu javigon chiiruno nicman23 marcin-github smuenzel nadalle blamkiwi minmfang wubo009 yshui godofdream infra223 doytsujin spotlesscoder jdgoncalves stintel jpsollie dlrobertson holmanb raof nckx lchx08 bhzhu203 ihavec yellowonion alkkkj firestack wsldankers samp20 bergwolf bcachefs hardfalcon gelma pinkdiamond1 leijurv leptopoda mrnerdhair fougner wuyeliang sonicrules1234 ojab jasonyangshadow joshua-ashton baughn tux3 openglfreak m561247 free13145 damenly n-harzallah akshayshilwant g2p heinsm hello71 dikay900 lrflew bertschingert boomshroom aniplcc 5l1v3r1 xbjfk qubitnano mmmpxbcachefs's Issues
Question: alternative hashing/error correction
Hi.
Is there plans for alternative hashing algorithms, e.g. xxhash, being added to bcachefs? Crc32 is not an option for us due to collisions and dependency on cpu instruction set...
Or, do you have some guidelines for implementing alternative hash algorithms in your FS? Actually, we have something in mind, and afaik, one can face an issue only if crc_combine is used, since most of contemporary hash algorithms do not support such function.
As I understood from docs, you have no support for error correction for now... I am reading about solutions you mentioned. But, I can only hope that Reed-Solomon with it's high cpu demand wont be the only option (I beleive I've seen it's being mentioned somewhere in bugtracker).
Very long filename limitation
In some setups there are need to increase NAME_MAX (see e.g. https://www.spinics.net/lists/linux-ext4/msg10172.html or openzfs/zfs#2344).
Is it safe with Bcachefs? What is the maximal limit of NAME_MAX?
Let's test.
- Increase value in the kernel (include/uapi/linux/limits.h):
#define NAME_MAX 1023 /* # chars in a file name */
- Start primitive test:
i=1; n="1"; while touch $n 2> /dev/null; do n="1$n"; i=$(($i + 1)); done; echo $i
=> 1035
(Looks OK, but 1024 expected.)
And log's chunk:
May 30 17:44:53 localhost kernel: [ 843.197180] bcachefs (sdd2): invalid key in journal: dirent name too big
May 30 17:44:53 localhost kernel: [ 843.197180] u64s 39 type 128 4096:8591153449688515752 snap 0 len 0 ver 0: 1111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111, exiting
May 30 17:44:53 localhost kernel: [ 843.197182] bcachefs (sdd2): Unable to continue, halting
May 30 17:44:53 localhost kernel: [ 843.197189] bcachefs (sdd2): emergency read only
BTW, mount command shows /dev/sdd2 on /mnt/mnt type bcachefs (rw,relatime) i.e. read-write status.
compression leads to filesystem hangs
When I create a filesystem with bcachefs format --compression=zstd --background_compression=zstd --foreground_target=/dev/sda1 --background_target=/dev/sdb1 --promote_target=/dev/sda1 --encrypted --label=nixos --force /dev/sdb1 --discard /dev/sda1 and attempt to install NixOS on it the install hangs on an fdatasync syscall with 100% CPU usage on one core not attributed to any process in top.
Here is the strace -f log, with anything from line 76676 onwards trigged by sending SIGINT, which does not stop the hang.
__bch2_trans_get_iter kernel BUG
Stumbled upon this in my journal:
Feb 19 23:50:00 bismuth kernel: ------------[ cut here ]------------
Feb 19 23:50:01 bismuth kernel: kernel BUG at ../fs/bcachefs/btree_iter.c:1789!
Feb 19 23:50:01 bismuth kernel: invalid opcode: 0000 [#1] SMP PTI
Feb 19 23:50:01 bismuth kernel: CPU: 2 PID: 6849 Comm: git Not tainted 4.20.0 #1-NixOS
Feb 19 23:50:01 bismuth kernel: Hardware name: Dell Inc. Latitude E5470/0C8FKJ, BIOS 1.19.3 08/20/2018
Feb 19 23:50:01 bismuth kernel: RIP: 0010:__btree_trans_get_iter+0x24e/0x290 [bcachefs]
Feb 19 23:50:01 bismuth kernel: Code: c0 44 39 f0 75 26 0f b6 55 1c 41 31 d5 41 83 e5 03 75 1b 5b 48 89 e8 5d 41 5c 41 5d 41 5e c3 48 8b 6b 28 e9 4e fe ff ff 0f 0b <0f> 0b 0f 0b 0f 0b 31 ed 31 c9 e9 34 ff ff ff 0f 0b e8 fc a9 ff ff
Feb 19 23:50:01 bismuth kernel: RSP: 0018:ffffbd39d1ec7898 EFLAGS: 00010207
Feb 19 23:50:01 bismuth kernel: RAX: 0000000000000007 RBX: ffffbd39d1ec7bc8 RCX: 0000000000000001
Feb 19 23:50:01 bismuth kernel: RDX: 0000000000000007 RSI: 0000000000000003 RDI: 0000000000000003
Feb 19 23:50:01 bismuth kernel: RBP: ffffa105e48190b0 R08: 0000000000000003 R09: ffffbd39d1ec7ad0
Feb 19 23:50:01 bismuth kernel: R10: ffffbd39d1ec79c8 R11: 0000000100010012 R12: c033eaa4c033e500
Feb 19 23:50:01 bismuth kernel: R13: 0000000000000005 R14: 0000000000000003 R15: 0000000000000003
Feb 19 23:50:01 bismuth kernel: FS: 00007f68d0283740(0000) GS:ffffa106edb00000(0000) knlGS:0000000000000000
Feb 19 23:50:01 bismuth kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 19 23:50:01 bismuth kernel: CR2: 0000000000b59058 CR3: 000000072bed2005 CR4: 00000000003606e0
Feb 19 23:50:01 bismuth kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 19 23:50:01 bismuth kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Feb 19 23:50:01 bismuth kernel: Call Trace:
Feb 19 23:50:01 bismuth kernel: __bch2_trans_get_iter+0xb/0x50 [bcachefs]
Feb 19 23:50:01 bismuth kernel: __bch2_hash_set.isra.9.constprop.12+0xa7/0x290 [bcachefs]
Feb 19 23:50:01 bismuth kernel: ? bch2_acc_percpu_u64s+0xb0/0xb0 [bcachefs]
Feb 19 23:50:01 bismuth kernel: ? _cond_resched+0x15/0x40
Feb 19 23:50:01 bismuth kernel: bch2_set_acl_trans+0x84/0x4a0 [bcachefs]
Feb 19 23:50:01 bismuth kernel: ? _cond_resched+0x15/0x40
Feb 19 23:50:01 bismuth kernel: ? kmem_cache_alloc+0x158/0x1b0
Feb 19 23:50:01 bismuth kernel: ? inode_init_always+0x120/0x1d0
Feb 19 23:50:01 bismuth kernel: __bch2_create+0x31f/0x590 [bcachefs]
Feb 19 23:50:01 bismuth kernel: ? atime_needs_update+0x75/0xe0
Feb 19 23:50:01 bismuth kernel: ? generic_file_buffered_read+0x728/0xba0
Feb 19 23:50:01 bismuth kernel: ? lookup_fast+0xc8/0x2c0
Feb 19 23:50:01 bismuth kernel: ? walk_component+0x48/0x340
Feb 19 23:50:01 bismuth kernel: ? inode_permission+0x31/0x180
Feb 19 23:50:01 bismuth kernel: ? link_path_walk.part.35+0x68/0x510
Feb 19 23:50:01 bismuth kernel: ? legitimize_path.isra.32+0x28/0x50
Feb 19 23:50:01 bismuth kernel: ? filename_parentat+0x10b/0x190
Feb 19 23:50:01 bismuth kernel: ? d_lookup+0x2b/0x40
Feb 19 23:50:01 bismuth kernel: ? bch2_mkdir+0x19/0x30 [bcachefs]
Feb 19 23:50:01 bismuth kernel: bch2_mkdir+0x19/0x30 [bcachefs]
Feb 19 23:50:01 bismuth kernel: vfs_mkdir+0x101/0x1b0
Feb 19 23:50:01 bismuth kernel: do_mkdirat+0xec/0x120
Feb 19 23:50:01 bismuth kernel: do_syscall_64+0x4e/0x100
Feb 19 23:50:01 bismuth kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Feb 19 23:50:01 bismuth kernel: RIP: 0033:0x7f68cf2bae67
Feb 19 23:50:01 bismuth kernel: Code: 1f 40 00 48 8b 05 19 a0 2c 00 64 c7 00 5f 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 b8 53 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d e9 9f 2c 00 f7 d8 64 89 01 48
Feb 19 23:50:01 bismuth kernel: RSP: 002b:00007ffd0d4292b8 EFLAGS: 00000212 ORIG_RAX: 0000000000000053
Feb 19 23:50:01 bismuth kernel: RAX: ffffffffffffffda RBX: 0000000000b58ad0 RCX: 00007f68cf2bae67
Feb 19 23:50:01 bismuth kernel: RDX: 000000000000000f RSI: 00000000000001ff RDI: 0000000000b58570
Feb 19 23:50:01 bismuth kernel: RBP: 0000000000000010 R08: 00007ffd0d5ba0a0 R09: 00007ffd0d5ba080
Feb 19 23:50:01 bismuth kernel: R10: 0000000000000124 R11: 0000000000000212 R12: 0000000000b58520
Feb 19 23:50:01 bismuth kernel: R13: 0000000000887410 R14: 00007f68d02836c0 R15: 00007ffd0d42ad80
Feb 19 23:50:01 bismuth kernel: Modules linked in: cmac lz4 zram zsmalloc bnep cpufreq_powersave ctr ccm af_packet msr snd_hda_codec_hdmi nls_iso8859_1 nls_cp437 vfat fat snd_hda_codec_realtek snd_hda_codec_generic joydev mousedev iTCO_wdt intel_wmi_thunderbolt dell_wmi sparse_keymap wmi_bmof ppdev mei_wdt dell_laptop arc4 dell_smbios intel_pmc_core dell_wmi_descriptor x86_pkg_temp_thermal intel_powerclamp coretemp dcdbas dell_smm_hwmon crct10dif_pclmul crc32_pclmul ghash_clmulni_intel i915 uvcvideo iwlmvm mac80211 aesni_intel videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 aes_x86_64 crypto_simd cryptd glue_helper kvmgt intel_cstate vfio_mdev intel_uncore mdev vfio_iommu_type1 btusb vfio intel_rapl_perf cec videobuf2_common btrtl btbcm drm_kms_helper btintel evdev psmouse input_leds iwlwifi led_class videodev drm mac_hid bluetooth deflate efi_pstore pstore intel_gtt iptable_nat agpgart i2c_i801 media i2c_algo_bit fb_sys_fops syscopyarea sysfillrect sysimgblt i2c_core serio_raw tpm_tis tpm_tis_core battery
Feb 19 23:50:01 bismuth kernel: thermal uas e1000e efivars cfg80211 ptp rtsx_pci_ms memstick pps_core ecdh_generic crc16 tpm rng_core wmi nf_nat_ipv4 nf_nat snd_hda_intel snd_hda_codec xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 snd_hda_core parport_pc snd_hwdep ip6t_rpfilter parport snd_pcm ipt_rpfilter dell_rbtn dell_smo8800 ip6table_raw snd_timer iptable_raw rfkill mei_me processor_thermal_device snd video xt_pkttype mei int3403_thermal int3400_thermal 8250_pci acpi_thermal_rel intel_soc_dts_iosf soundcore int340x_thermal_zone intel_pch_thermal ac acpi_pad nf_log_ipv6 button nf_log_ipv4 nf_log_common pcc_cpufreq xt_LOG xt_tcpudp ip6table_filter ip6_tables iptable_filter loop kvm_intel kvm irqbypass efivarfs ip_tables x_tables ipv6 crc_ccitt autofs4 poly1305_x86_64 poly1305_generic chacha20_x86_64 chacha20_generic bcachefs zstd_compress lz4_compress zstd_decompress xxhash crc64 libcrc32c crc32c_generic xor raid6_pq sd_mod usb_storage rtsx_pci_sdmmc mmc_core atkbd xhci_pci libps2 xhci_hcd ahci
Feb 19 23:50:01 bismuth kernel: libahci libata usbcore crc32c_intel scsi_mod rtsx_pci usb_common i8042 rtc_cmos serio dm_mod
Feb 19 23:50:01 bismuth kernel: ---[ end trace a24e8c44f6784342 ]---
Feb 19 23:50:02 bismuth kernel: RIP: 0010:__btree_trans_get_iter+0x24e/0x290 [bcachefs]
Feb 19 23:50:02 bismuth kernel: Code: c0 44 39 f0 75 26 0f b6 55 1c 41 31 d5 41 83 e5 03 75 1b 5b 48 89 e8 5d 41 5c 41 5d 41 5e c3 48 8b 6b 28 e9 4e fe ff ff 0f 0b <0f> 0b 0f 0b 0f 0b 31 ed 31 c9 e9 34 ff ff ff 0f 0b e8 fc a9 ff ff
Feb 19 23:50:02 bismuth kernel: RSP: 0018:ffffbd39d1ec7898 EFLAGS: 00010207
Feb 19 23:50:02 bismuth kernel: RAX: 0000000000000007 RBX: ffffbd39d1ec7bc8 RCX: 0000000000000001
Feb 19 23:50:02 bismuth kernel: RDX: 0000000000000007 RSI: 0000000000000003 RDI: 0000000000000003
Feb 19 23:50:02 bismuth kernel: RBP: ffffa105e48190b0 R08: 0000000000000003 R09: ffffbd39d1ec7ad0
Feb 19 23:50:02 bismuth kernel: R10: ffffbd39d1ec79c8 R11: 0000000100010012 R12: c033eaa4c033e500
Feb 19 23:50:02 bismuth kernel: R13: 0000000000000005 R14: 0000000000000003 R15: 0000000000000003
Feb 19 23:50:02 bismuth kernel: FS: 00007f68d0283740(0000) GS:ffffa106edb00000(0000) knlGS:0000000000000000
Feb 19 23:50:02 bismuth kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Feb 19 23:50:02 bismuth kernel: CR2: 0000555f50f2f4a8 CR3: 000000072bed2006 CR4: 00000000003606e0
Feb 19 23:50:02 bismuth kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 19 23:50:02 bismuth kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
kernel BUG at fs/bcachefs/movinggc.c:284!
Due to a hardware issue I had to migrate my 4 HDD + 2 SSD bcachefs to another device. As one of the SSDs was mSATA and I had no other hardware that supports mSATA, I couldn't use one of the SSDs anymore and had to mount the filesystem with -o degraded. I then removed the missing SSD device, which worked fine. As I was running with replicas=2, the single SSD wouldn't be used afaiu, so I decided to remove the last SSD as well. When I tried to do this I hit the following kernel BUG:
[ 780.527523] bcachefs (sdf3): Cannot remove without losing data
[ 780.527568] ------------[ cut here ]------------
[ 780.527572] kernel BUG at fs/bcachefs/movinggc.c:284!
[ 780.527586] invalid opcode: 0000 [#1] SMP NOPTI
[ 780.527704] CPU: 1 PID: 3111 Comm: bcachefs Tainted: G T 4.20.0-30547-gffe09df1065d #1
[ 780.527860] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./To be filled by O.E.M., BIOS 080016 03/25/2010
[ 780.528087] RIP: 0010:bch2_copygc_start+0x7e/0x80 [bcachefs]
[ 780.528190] Code: ff 76 09 8d 28 5b 89 e8 5d 41 5c c3 f0 ff 80 68 01 00 00 48 89 83 b8 04 00 00 48 8d 38 e8 5a 87 aa d3 5b 8d 45 00 5d 41 5c c3 <0f> 0b 0f 1f 44 00 00 53 48 8d 1f 48 89 df 48 81 c7 d8 04 00 00 e8
[ 780.528493] RSP: 0018:fffface267383a50 EFLAGS: 00010282
[ 780.528587] RAX: 0000000000000000 RBX: ffff9167f2609000 RCX: ffff9167d8b84800
[ 780.528716] RDX: ffffffffc060fd40 RSI: ffff9167f2609000 RDI: ffff9167e2a00000
[ 780.528851] RBP: ffff9167e2a00000 R08: 0000000000000200 R09: 00000000000b0700
[ 780.528974] R10: 0000000000000000 R11: 0000000000000001 R12: ffff9167e2a00000
[ 780.529096] R13: 000000000000001c R14: ffff9167e2a00188 R15: 00000000ffffffea
[ 780.529219] FS: 00007fda01effb00(0000) GS:ffff9167fba80000(0000) knlGS:0000000000000000
[ 780.529357] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 780.529458] CR2: 000055a9a641d8c0 CR3: 00000000a58b8000 CR4: 00000000000006e0
[ 780.529487] Call Trace:
[ 780.529487] __bch2_dev_read_write+0x50/0x70 [bcachefs]
[ 780.529487] bch2_dev_remove+0x307/0x330 [bcachefs]
[ 780.529487] ? security_capable+0x43/0x60
[ 780.529487] bch2_fs_ioctl+0x9d6/0xb10 [bcachefs]
[ 780.529487] bch2_fs_file_ioctl+0x162/0x7e0 [bcachefs]
[ 780.529487] do_vfs_ioctl+0xb7/0x6f0
[ 780.529487] ksys_ioctl+0x6b/0xa0
[ 780.529487] __x64_sys_ioctl+0x1a/0x20
[ 780.529487] do_syscall_64+0x67/0x2fe
[ 780.529487] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 780.529487] RIP: 0033:0x7fda01f3cc93
[ 780.529487] Code: 8d 44 24 60 48 89 54 24 30 48 89 44 24 10 c7 44 24 08 10 00 00 00 48 63 f6 48 8d 44 24 20 48 89 44 24 18 b8 10 00 00 00 0f 05 <48> 89 c7 e8 45 34 fe ff 48 8d 64 24 58 c3 66 2e 0f 1f 84 00 00 00
[ 780.529487] RSP: 002b:00007ffd2c5712c0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 780.529487] RAX: ffffffffffffffda RBX: 000000000000001c RCX: 00007fda01f3cc93
[ 780.529487] RDX: 00007ffd2c571320 RSI: 000000004010bc05 RDI: 0000000000000003
[ 780.529487] RBP: 0000000000000001 R08: 00000000ffffffd0 R09: 0000000000000000
[ 780.529487] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffd2c57246f
[ 780.529487] R13: 00007ffd2c572469 R14: 00007ffd2c571588 R15: 0000000000000000
[ 780.529487] Modules linked in: bcachefs lz4_compress crc64 uas usb_storage joydev hid_generic usbhid hid i915 iTCO_wdt video iTCO_vendor_support intel_gtt evdev i2c_algo_bit coretemp snd_hda_codec_realtek hwmon drm_kms_helper snd_hda_codec_generic cfbfillrect snd_hda_intel cfbimgblt uhci_hcd cfbcopyarea snd_hda_codec drm realtek ehci_pci psmouse r8169 snd_hda_core lpc_ich ehci_hcd i2c_i801 libphy snd_hwdep usbcore mfd_core usb_common snd_pcm drm_panel_orientation_quirks snd_timer syscopyarea sysfillrect button snd sysimgblt fb_sys_fops soundcore
[ 780.532644] ---[ end trace c72a4abf34110163 ]---
[ 780.532819] RIP: 0010:bch2_copygc_start+0x7e/0x80 [bcachefs]
[ 780.537704] Code: ff 76 09 8d 28 5b 89 e8 5d 41 5c c3 f0 ff 80 68 01 00 00 48 89 83 b8 04 00 00 48 8d 38 e8 5a 87 aa d3 5b 8d 45 00 5d 41 5c c3 <0f> 0b 0f 1f 44 00 00 53 48 8d 1f 48 89 df 48 81 c7 d8 04 00 00 e8
[ 780.547477] RSP: 0018:fffface267383a50 EFLAGS: 00010282
[ 780.552370] RAX: 0000000000000000 RBX: ffff9167f2609000 RCX: ffff9167d8b84800
[ 780.557263] RDX: ffffffffc060fd40 RSI: ffff9167f2609000 RDI: ffff9167e2a00000
[ 780.562095] RBP: ffff9167e2a00000 R08: 0000000000000200 R09: 00000000000b0700
[ 780.566834] R10: 0000000000000000 R11: 0000000000000001 R12: ffff9167e2a00000
[ 780.571500] R13: 000000000000001c R14: ffff9167e2a00188 R15: 00000000ffffffea
[ 780.576006] FS: 00007fda01effb00(0000) GS:ffff9167fba80000(0000) knlGS:0000000000000000
[ 780.580415] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 780.584790] CR2: 000055a9a641d8c0 CR3: 00000000a58b8000 CR4: 00000000000006e0
Kconfig.debug compiler does not like paths without "
diff --git a/lib/Kconfig.debug b/lib/Kconfig.debug
index 49af4a9bafcb..42cef5984c2b 100644
--- a/lib/Kconfig.debug
+++ b/lib/Kconfig.debug
@@ -439,7 +439,7 @@ config DEBUG_KERNEL
menu "Memory Debugging"
-source mm/Kconfig.debug
+source "mm/Kconfig.debug"
config DEBUG_OBJECTS
bool "Debug object operations"
@@ -1623,7 +1623,7 @@ config DYNAMIC_FAULT
default n
depends on DEBUG_FS
-source kernel/trace/Kconfig
+source "kernel/trace/Kconfig"
config PROVIDE_OHCI1394_DMA_INIT
bool "Remote debugging over FireWire early on boot"
fsck continues even if array is mounted
before fsck there was an issue with a corrupt inode and some bucket sizes on the devices (which there are still there).
mount fails and with fix_errors it produces:
https://pastebin.com/S37exMXW
sda1 and sdb1 are (2.7 TB) background drives, nvme0n1p2 is cache (~500GB) only (irrc, it might be foreground too), everything is replicated x2, no compression or encryption.
before fsck the array mounted normally, fsck was done ~5 mins after a successful boot
journal checksum bad can't be fixed
2019-04-16T10:51:01.990834+02:00 jowisz kernel: [ 1596.907243] bcachefs (dm-12): journal checksum bad, sector 147427, exiting
2019-04-16T10:51:01.990858+02:00 jowisz kernel: [ 1596.907251] bcachefs (dm-12): Unable to continue, halting
2019-04-16T10:51:01.990859+02:00 jowisz kernel: [ 1596.907325] bcachefs: bch2_fs_recovery() Error in recovery: cannot allocate memory (1)
2019-04-16T10:51:01.990861+02:00 jowisz kernel: [ 1596.907337] bcachefs (dm-12): filesystem contains errors: please report this to the developers
2019-04-16T10:51:01.990876+02:00 jowisz kernel: [ 1596.907338] mount with -o fix_errors to repair
2019-04-16T10:51:01.990878+02:00 jowisz kernel: [ 1596.907340] bcachefs: bch2_fs_open() bch_fs_open err opening /dev/mapper/crypted-dane--bcache: fsck error
fsck can't fix it:
jowisz ~ # bcachefs fsck -y /dev/mapper/crypted-dane--bcache
recovering from clean shutdown, journal seq 171241
journal checksum bad, sector 147427, fixing
journal read done, 0 keys in 1 entries, seq 171241
jowisz ~ # bcachefs fsck -y /dev/mapper/crypted-dane--bcache
recovering from clean shutdown, journal seq 171245
journal checksum bad, sector 147427, fixing
journal read done, 0 keys in 1 entries, seq 171245
mount with fix_errors also can't fix it:
2019-04-16T10:57:32.720960+02:00 jowisz kernel: [ 1987.639077] bcachefs (dm-12): recovering from clean shutdown, journal seq 171249
2019-04-16T10:57:34.444517+02:00 jowisz kernel: [ 1989.366825] bcachefs (dm-12): journal checksum bad, sector 147427, fixing
2019-04-16T10:57:35.070845+02:00 jowisz kernel: [ 1989.988846] bcachefs (dm-12): journal read done, 0 keys in 1 entries, seq 171249
2019-04-16T10:57:45.990829+02:00 jowisz kernel: [ 2000.905747] bcachefs (dm-12): recovering from clean shutdown, journal seq 171253
2019-04-16T10:57:46.945676+02:00 jowisz kernel: [ 2001.867947] bcachefs (dm-12): journal checksum bad, sector 147427, fixing
2019-04-16T10:57:48.050829+02:00 jowisz kernel: [ 2002.972392] bcachefs (dm-12): journal read done, 0 keys in 1 entries, seq 171253
different types of data in the same bucket: data, btree
Filesystem created with bcachefs format --compression=lz4 --background_compression=zstd --foreground_target=/dev/sda1 --background_target=/dev/sdb2 --promote_target=/dev/sda1 --encrypted --label=nixos --force /dev/sdb2 /dev/sda1 from commit ea43593.
Boot fails with different types of data in the same bucket: data, btree.
Output of bcachefs fsck (even repeatedly) is this:
journal checksum bad, sector 857600: fix? (y,n) y
journal read done, 1255070 keys in 1672 entries, seq 1370513
different types of data in same bucket: data, btree
emergency read only
error invalidating buckets: -30
error invalidating buckets: -30
journal replay: error -5 while replaying key
bcachefs: bch2_fs_recovery() Error in recovery: journal replay failed (-5)
bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sda1: IO error
error writing out alloc info -30
error opening /dev/sda1: Invalid argument
bcachefs dump also fails, with
journal checksum bad, sector 857600, exiting
Unable to continue, halting
bcachefs: bch2_fs_recovery() Error in recovery: cannot allocate memory (1)
filesystem contains errors: please report this to the developers
mount with -o fix_errors to repair
bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sda1: fsck error
error opening /dev/sda1: Invalid argume
I tried both of those commands with both the original commit and 97d1478.
bcachefs-tools format target options are broken
The koverstreet/bcachefs-tools@0e98225 commit broke the --foreground_target, --background_target, and --promote_target arguments to bcachefs format.
Here's the simple script I used to bisect the issue:
#!/bin/bash
set -e
make -j3 clean &>/dev/null || make -j3 clean
make -j3 &>/dev/null || make -j3
rm -f test.img
truncate -s 8M test.img
out=$(./bcachefs format test.img --foreground_target=test.img --background_target=test.img --promote_target=test.img)
set +e
out=$(grep -ie foreground -e background -e promote <<<"$out")
echo "$out" # Print the targets (optional)
grep -qv 'none$' <<<"$out"
exit $?
Sample output:
$ git checkout 0e98225 # The commit which broke it
$ ./test.sh
Foreground write target: none
Background write target: none
Promote target: none
$ git checkout HEAD^ # The last working commit
$ ./test.sh
Foreground write target: Device 0 (b4bca271-32e5-48cb-bc43-6ac615e74f9b)
Background write target: Device 0 (b4bca271-32e5-48cb-bc43-6ac615e74f9b)
Promote target: Device 0 (b4bca271-32e5-48cb-bc43-6ac615e74f9b)
Auto-merge conflict ~ stable 5.1.16 patch conflicts with bcachefs master
Relevent error output:
CONFLICT (content): Merge conflict in fs/inode.c
BUG: workqueue lockup - pool cpus=2 node=0 flags=0x0 nice=-20 stuck for 58s!
commit 990250b (but it appears also on earlier commits)
2019-04-24T11:34:00.514575+02:00 jowisz kernel: [ 752.907614] BUG: workqueue lockup - pool cpus=2 node=0 flags=0x0 nice=-20 stuck for 58s!
2019-04-24T11:34:00.514655+02:00 jowisz kernel: [ 752.914030] Showing busy workqueues and worker pools:
2019-04-24T11:34:00.514659+02:00 jowisz kernel: [ 752.914034] workqueue events_highpri: flags=0x10
2019-04-24T11:34:00.514661+02:00 jowisz kernel: [ 752.914036] pwq 5: cpus=2 node=0 flags=0x0 nice=-20 active=2/256
2019-04-24T11:34:00.514668+02:00 jowisz kernel: [ 752.914042] pending: journal_write_done [bcachefs], bch2_journal_write [bcachefs]
2019-04-24T11:34:00.514677+02:00 jowisz kernel: [ 752.914131] workqueue writeback: flags=0x4e
2019-04-24T11:34:00.514680+02:00 jowisz kernel: [ 752.914132] pwq 8: cpus=0-3 flags=0x4 nice=0 active=3/256
2019-04-24T11:34:00.514681+02:00 jowisz kernel: [ 752.914135] in-flight: 11518:wb_workfn, 1705:wb_workfn
2019-04-24T11:34:00.515382+02:00 jowisz kernel: [ 752.914188] pending: wb_workfn
2019-04-24T11:34:00.515387+02:00 jowisz kernel: [ 752.914191] workqueue kblockd: flags=0x18
2019-04-24T11:34:00.515388+02:00 jowisz kernel: [ 752.914192] pwq 1: cpus=0 node=0 flags=0x0 nice=-20 active=1/256
2019-04-24T11:34:00.515389+02:00 jowisz kernel: [ 752.914195] pending: blk_mq_timeout_work
2019-04-24T11:34:00.515391+02:00 jowisz kernel: [ 752.914241] workqueue bcachefs: flags=0x1c
2019-04-24T11:34:00.515392+02:00 jowisz kernel: [ 752.914242] pwq 5: cpus=2 node=0 flags=0x0 nice=-20 active=1/1
2019-04-24T11:34:00.515393+02:00 jowisz kernel: [ 752.914244] in-flight: 95:bch2_write_index [bcachefs]
2019-04-24T11:34:00.515394+02:00 jowisz kernel: [ 752.914258] delayed: bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs],
bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs]
2019-04-24T11:34:00.515415+02:00 jowisz kernel: [ 752.914635] , bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs]
[...]
2019-04-24T11:34:00.515843+02:00 jowisz kernel: [ 752.931174] , bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs]
2019-04-24T11:34:00.515847+02:00 jowisz kernel: [ 752.931559] , bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs], bch2_write_index [bcachefs]
2019-04-24T11:34:00.515860+02:00 jowisz kernel: [ 752.931712] workqueue bcache_journal: flags=0x1c
2019-04-24T11:34:00.515865+02:00 jowisz kernel: [ 752.931714] pwq 5: cpus=2 node=0 flags=0x0 nice=-20 active=1/1
2019-04-24T11:34:00.515867+02:00 jowisz kernel: [ 752.931718] pending: bch2_journal_reclaim_work [bcachefs]
2019-04-24T11:34:00.515877+02:00 jowisz kernel: [ 752.931749] workqueue kcryptd/253:5: flags=0x3a
2019-04-24T11:34:00.515881+02:00 jowisz kernel: [ 752.931750] pwq 9: cpus=0-3 flags=0x4 nice=-20 active=2/4
2019-04-24T11:34:00.515883+02:00 jowisz kernel: [ 752.931753] pending: kcryptd_crypt [dm_crypt], kcryptd_crypt [dm_crypt]
2019-04-24T11:34:00.515886+02:00 jowisz kernel: [ 752.931827] pool 5: cpus=2 node=0 flags=0x0 nice=-20 hung=58s workers=4 idle: 16426 13865 23
2019-04-24T11:34:00.515888+02:00 jowisz kernel: [ 752.931845] pool 8: cpus=0-3 flags=0x4 nice=0 hung=0s workers=4 idle: 367 2988
tasks blocked in kernel fs layer
Whenever I try to use nix-build, it will with high probability stop making progress. Sometimes waiting for a long time will have it continue, but I am unsure if this is because the blocked task is killed or because it eventually unblocks. The kernel log reveals the following:
Apr 08 09:01:36 nixos kernel: INFO: task nix-build:2457 blocked for more than 120 seconds.
Apr 08 09:01:36 nixos kernel: Not tainted 5.0.0 #1-NixOS
Apr 08 09:01:36 nixos kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Apr 08 09:01:36 nixos kernel: nix-build D 0 2457 2240 0x00000004
Apr 08 09:01:36 nixos kernel: Call Trace:
Apr 08 09:01:36 nixos kernel: ? __schedule+0x1d3/0x6f0
Apr 08 09:01:36 nixos kernel: ? bdi_split_work_to_wbs+0x17b/0x2f0
Apr 08 09:01:36 nixos kernel: schedule+0x28/0x70
Apr 08 09:01:36 nixos kernel: wb_wait_for_completion+0x5e/0x90
Apr 08 09:01:36 nixos kernel: ? wait_woken+0x80/0x80
Apr 08 09:01:36 nixos kernel: sync_inodes_sb+0xd8/0x290
Apr 08 09:01:36 nixos kernel: ? default_file_splice_write+0x20/0x20
Apr 08 09:01:36 nixos kernel: iterate_supers+0x98/0x100
Apr 08 09:01:36 nixos kernel: ksys_sync+0x40/0xb0
Apr 08 09:01:36 nixos kernel: __ia32_sys_sync+0xa/0x10
Apr 08 09:01:36 nixos kernel: do_syscall_64+0x4e/0x100
Apr 08 09:01:36 nixos kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Apr 08 09:01:36 nixos kernel: RIP: 0033:0x7f16421066c7
Apr 08 09:01:36 nixos kernel: Code: Bad RIP value.
Apr 08 09:01:36 nixos kernel: RSP: 002b:00007fff56d5ef58 EFLAGS: 00000202 ORIG_RAX: 00000000000000a2
Apr 08 09:01:36 nixos kernel: RAX: ffffffffffffffda RBX: 00007fff56d5f308 RCX: 00007f16421066c7
Apr 08 09:01:36 nixos kernel: RDX: 00007fff56d5f308 RSI: 00007fff56d5f920 RDI: 00000000022e4f70
Apr 08 09:01:36 nixos kernel: RBP: 0000000017c6a450 R08: 0000000000000006 R09: 000000000000004a
Apr 08 09:01:36 nixos kernel: R10: 0000000000000000 R11: 0000000000000202 R12: 0000000017d710f0
Apr 08 09:01:36 nixos kernel: R13: 00007fff56d5f308 R14: 00007fff56d5f920 R15: 0000000017f249c0
Commit is 1f34297.
I'll try and get some simple reproduction steps.
hard shutdown corrupted filesystem
Hi,
A month+ I switched to bcachefs, but recently experienced a filesystem corruption with it after I did a hard shutdown at a moment my system appeared unresponsive -- at this point I find it hard to tell if it was unresponsive because of an existing filesystem issue, or if the filesystem issue was caused by the hard shutdown.
The output I'm getting on boot now is as follows:
[...]
loading module fbcon...
modprobe: FATAL: Module fbcon not found in directory /lib/modules/4.18.0
loading module dm_mod...
running udev...
starting device mapper and LVM...
waiting for device /dev/sda1:/dev/sdb1 to appear.......................
Timed out waiting for device /dev/sda1:/dev/sdb1, trying to mount anyway.
mounting /dev/sda1:/dev/sdb1 on /...
[ 47.793230] bcachefs (3b21c798-491a-4b12-8692-e798f0856c47): unreachable directory found (inum 12553850), exiting
[ 47.793387] bcachefs (3b21c798-491a-4b12-8692-e798f0856c47): Unable to continue, halting
[ 47.794841] bcachefs (3b21c798-491a-4b12-8692-e798f0856c47): filesystem contains errors: please report this to the developers
[ 47.794999] bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sda1: fsck error
mount: mounting /dev/sda1:/dev/sdb1 on /mnt-root/ failed: Invalid argument
An error occurred in stage 1 of the boot process, which must mount the root filesystem on '/mnt-root' and then start stage 2. Press one of the following keys:
r) to reboot immediately
*) to ignore the error and continue
*
[...]
[ 1508.919495] RSP: 0018:ffffa300818c3e18 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
[ 1508.919646] RAX: 0000000000000056 RBX: ffff9c709d110000 RCX: ffffffff8924a688
[ 1508.919745] RDX: 0000000000000000 RSI: 0000000000000082 RDI: 0000000000000046
[ 1508.919844] RBP: ffffa300818c3e90 R08: 00000000000002ee R09: 000000000000000f
[ 1508.919844] R10: ffffffff8930c8a0 R11: ffffffff8974c88d R12: 0000000000000000
[ 1508.920043] R13: 0000000000000000 R14: ffff9c709a1f8000 R15: ffff9c709a1f8070
[ 1508.920144] ? panic+0x1ed/0x242
[ 1508.920237] do_exit+0xae0/0xae0
[ 1508.920331] ? handle_mm_fault+0xdc/0x210
[ 1508.920426] do_group_exit+0x3a/0xa0
[ 1508.920519] __x64_sys_exit_group+0x14/0x20
[ 1508.920615] do_syscall_64+0x4e/0x100
[ 1508.920709] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1508.920805] RIP: 0033:0x7fa356f35676
[ 1508.920899] Code: Bad RIP value.
[ 1508.920992] RSP: 002b:00007ffcc3b43978 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7
[ 1508.921144] RAX: ffffffffffffffffda RBX: 00007fa35721e5a0 RCX: 00007fa356f35676
[ 1508.921243] RDX: 0000000000000001 RSI: 000000000000003c RDI: 000000000000000001
[ 1508.921243] RBP: 0000000000000001 R08: 00000000000000e7 R09: fffffffffffffff80
[ 1508.921442] R10: 00007fa356fa1c60 R11: 0000000000000246 R12: 00007fa35721e5a0
[ 1508.921541] R13: 0000000000000001 R14: 00007fa357227488 R15: 000000000000000000
[ 1508.921541] ---[ end trace b6012f2977fcf68a ]---
I have no idea if any of this is helpful -- I can't make much out of it myself.
Would you perhaps have some tips on how to deal with a situation like this?
I didn't actually have much of interest stored on it, but to me the unreachable directory found sounds like the rest of it should be salvageable -- it'd be cool if there were a way to find out what directory was affected, and perhaps tell it to forget about that one, and just proceed with the rest.
This is the first time I'm using a fancy filesystem, so forgive my inexperience here -- I hadn't given much thought to how actions like this might affect the filesystem. From my Windows days, fwiw, I'd been used to any potential disk errors leading to a repair process salvaging what remained.
The above log is what fit onto my screen. I imagine there would have been more, though I'm not sure how I might find it. Not having a useable filesystem probably wasn't helping for saving logs.
Add information about commit
It would be nice to have possibility to check on which commit bcachefs is used. Maybe info in dmesg or something under /sys/module/bcachefs/...
general protection fault: 0000 [#1] SMP PTI: RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
Running commit d541578 with 5.1.21 merged:
[24648.145554] general protection fault: 0000 [#1] SMP PTI
[24648.150782] CPU: 7 PID: 73 Comm: kswapd0 Tainted: G T 5.1.21-00130-g314717a42d72 #1
[24648.159733] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[24648.169632] RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
[24648.174336] Code: 0f 84 ae 00 00 00 4c 89 f3 48 89 df 48 89 ee 88 54 24 07 e8 74 13 ee ff 0f b6 54 24 07 48 85 c0 48 89 c3 74 43 48 39 e8 74 06 <f6> 40 7c 01 74 42 4d 85 ed 74 2e 4c 89 f0 f0 49 0f b1 1f 4d 85 f6
[24648.193074] RSP: 0018:ffffb50541b53cf8 EFLAGS: 00010207
[24648.198299] RAX: 0000ffff0032ffc0 RBX: 0000ffff0032ffc0 RCX: ffff9caae595b058
[24648.205423] RDX: 0000000000000000 RSI: ffff9cad8f504000 RDI: ffff9caae595b000
[24648.212548] RBP: ffff9cad8f504000 R08: 0000000000000020 R09: 0000000000007895
[24648.219681] R10: ffffffff87044b20 R11: 0000000000000001 R12: 0000000000000000
[24648.226813] R13: ffffb50541b53d68 R14: ffff9caae595b000 R15: ffff9cad8f41a6e0
[24648.233937] FS: 0000000000000000(0000) GS:ffff9cad8fbc0000(0000) knlGS:0000000000000000
[24648.242024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[24648.247768] CR2: 00007ffddbf3a018 CR3: 0000000268010001 CR4: 00000000003606e0
[24648.254893] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[24648.262026] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[24648.269156] Call Trace:
[24648.271606] shrink_node+0xb2/0x4f0
[24648.275100] balance_pgdat+0x2d3/0x530
[24648.278852] kswapd+0x203/0x400
[24648.281995] ? wait_woken+0x80/0x80
[24648.285487] ? balance_pgdat+0x530/0x530
[24648.289403] kthread+0x114/0x130
[24648.292627] ? kthread_park+0x80/0x80
[24648.296293] ret_from_fork+0x35/0x40
[24648.299864] Modules linked in: nls_iso8859_1 nls_cp850 vfat fat xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ast ttm aesni_intel drm_kms_helper aes_x86_64 crypto_simd cryptd glue_helper drm intel_cstate iTCO_wdt evdev iTCO_vendor_support xhci_pci drm_panel_orientation_quirks intel_uncore efi_pstore syscopyarea mpt3sas xhci_hcd sysfillrect igb ehci_pci intel_rapl_perf raid_class efivars sysimgblt ehci_hcd scsi_transport_sas fb_sys_fops i2c_algo_bit thermal dca fan usbcore i2c_i801 acpi_pad
[24648.299886] lpc_ich button mei_me mfd_core usb_common efivarfs
[24648.392801] ---[ end trace d9cfcef524aab089 ]---
[24648.399511] RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
[24648.399513] Code: 0f 84 ae 00 00 00 4c 89 f3 48 89 df 48 89 ee 88 54 24 07 e8 74 13 ee ff 0f b6 54 24 07 48 85 c0 48 89 c3 74 43 48 39 e8 74 06 <f6> 40 7c 01 74 42 4d 85 ed 74 2e 4c 89 f0 f0 49 0f b1 1f 4d 85 f6
[24648.422977] RSP: 0018:ffffb50541b53cf8 EFLAGS: 00010207
[24648.422978] RAX: 0000ffff0032ffc0 RBX: 0000ffff0032ffc0 RCX: ffff9caae595b058
[24648.422978] RDX: 0000000000000000 RSI: ffff9cad8f504000 RDI: ffff9caae595b000
[24648.422978] RBP: ffff9cad8f504000 R08: 0000000000000020 R09: 0000000000007895
[24648.422979] R10: ffffffff87044b20 R11: 0000000000000001 R12: 0000000000000000
[24648.422979] R13: ffffb50541b53d68 R14: ffff9caae595b000 R15: ffff9cad8f41a6e0
[24648.422980] FS: 0000000000000000(0000) GS:ffff9cad8fbc0000(0000) knlGS:0000000000000000
[24648.422980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[24648.422981] CR2: 00007ffddbf3a018 CR3: 0000000268010001 CR4: 00000000003606e0
[24648.422981] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[24648.422981] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[24679.657865] BUG: unable to handle kernel NULL pointer dereference at 0000000000000034
[24679.665699] #PF error: [normal kernel read fault]
[24679.670404] PGD 0 P4D 0
[24679.672946] Oops: 0000 [#2] SMP PTI
[24679.676439] CPU: 4 PID: 59 Comm: khugepaged Tainted: G D T 5.1.21-00130-g314717a42d72 #1
[24679.685652] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[24679.695562] RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
[24679.700269] Code: 0f 84 ae 00 00 00 4c 89 f3 48 89 df 48 89 ee 88 54 24 07 e8 74 13 ee ff 0f b6 54 24 07 48 85 c0 48 89 c3 74 43 48 39 e8 74 06 <f6> 40 7c 01 74 42 4d 85 ed 74 2e 4c 89 f0 f0 49 0f b1 1f 4d 85 f6
[24679.719015] RSP: 0018:ffffb50541aefa70 EFLAGS: 00010206
[24679.724241] RAX: ffffffffffffffb8 RBX: ffffffffffffffb8 RCX: ffff9caae595b058
[24679.731375] RDX: 0000000000000000 RSI: ffff9cad8f504000 RDI: ffff9caae595b000
[24679.738507] RBP: ffff9cad8f504000 R08: 0000000000000080 R09: 0000000000000f85
[24679.745637] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000000
[24679.752764] R13: ffffb50541aefae0 R14: ffff9caae595b000 R15: ffff9cad8f41a6e0
[24679.759898] FS: 0000000000000000(0000) GS:ffff9cad8fb00000(0000) knlGS:0000000000000000
[24679.767983] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[24679.773725] CR2: 0000000000000034 CR3: 0000000268010004 CR4: 00000000003606e0
[24679.780861] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[24679.787998] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[24679.795134] Call Trace:
[24679.797596] shrink_node+0xb2/0x4f0
[24679.801091] do_try_to_free_pages+0xd2/0x380
[24679.805363] try_to_free_pages+0xbf/0x1d0
[24679.809376] __alloc_pages_nodemask+0x76d/0x1160
[24679.813994] ? __switch_to_asm+0x41/0x70
[24679.817927] ? _raw_spin_lock_irqsave+0x15/0x20
[24679.822465] khugepaged_alloc_page+0x22/0x60
[24679.826743] khugepaged+0xbb9/0x2000
[24679.830327] ? syscall_return_via_sysret+0x20/0xcf
[24679.835126] ? wait_woken+0x80/0x80
[24679.838617] ? khugepaged_scan_abort.part.2+0x50/0x50
[24679.843669] kthread+0x114/0x130
[24679.846904] ? kthread_park+0x80/0x80
[24679.850569] ret_from_fork+0x35/0x40
[24679.854145] Modules linked in: nls_iso8859_1 nls_cp850 vfat fat xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ast ttm aesni_intel drm_kms_helper aes_x86_64 crypto_simd cryptd glue_helper drm intel_cstate iTCO_wdt evdev iTCO_vendor_support xhci_pci drm_panel_orientation_quirks intel_uncore efi_pstore syscopyarea mpt3sas xhci_hcd sysfillrect igb ehci_pci intel_rapl_perf raid_class efivars sysimgblt ehci_hcd scsi_transport_sas fb_sys_fops i2c_algo_bit thermal dca fan usbcore i2c_i801 acpi_pad
[24679.854213] lpc_ich button mei_me mfd_core usb_common efivarfs
[24679.947105] CR2: 0000000000000034
[24679.950423] ---[ end trace d9cfcef524aab08a ]---
[24679.963104] RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
[24679.967811] Code: 0f 84 ae 00 00 00 4c 89 f3 48 89 df 48 89 ee 88 54 24 07 e8 74 13 ee ff 0f b6 54 24 07 48 85 c0 48 89 c3 74 43 48 39 e8 74 06 <f6> 40 7c 01 74 42 4d 85 ed 74 2e 4c 89 f0 f0 49 0f b1 1f 4d 85 f6
[24679.986562] RSP: 0018:ffffb50541b53cf8 EFLAGS: 00010207
[24679.991789] RAX: 0000ffff0032ffc0 RBX: 0000ffff0032ffc0 RCX: ffff9caae595b058
[24679.998921] RDX: 0000000000000000 RSI: ffff9cad8f504000 RDI: ffff9caae595b000
[24680.006053] RBP: ffff9cad8f504000 R08: 0000000000000020 R09: 0000000000007895
[24680.013186] R10: ffffffff87044b20 R11: 0000000000000001 R12: 0000000000000000
[24680.020320] R13: ffffb50541b53d68 R14: ffff9caae595b000 R15: ffff9cad8f41a6e0
[24680.027455] FS: 0000000000000000(0000) GS:ffff9cad8fb00000(0000) knlGS:0000000000000000
[24680.035540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[24680.041283] CR2: 0000000000000034 CR3: 0000000268010004 CR4: 00000000003606e0
[24680.048414] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[24680.055546] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[24680.208991] BUG: unable to handle kernel NULL pointer dereference at 0000000000000034
[24680.216818] #PF error: [normal kernel read fault]
[24680.221524] PGD 0 P4D 0
[24680.224062] Oops: 0000 [#3] SMP PTI
[24680.227545] CPU: 6 PID: 27045 Comm: kworker/6:1 Tainted: G D T 5.1.21-00130-g314717a42d72 #1
[24680.237096] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[24680.247006] Workqueue: bcachefs bch2_write_index [bcachefs]
[24680.252578] RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
[24680.257279] Code: 0f 84 ae 00 00 00 4c 89 f3 48 89 df 48 89 ee 88 54 24 07 e8 74 13 ee ff 0f b6 54 24 07 48 85 c0 48 89 c3 74 43 48 39 e8 74 06 <f6> 40 7c 01 74 42 4d 85 ed 74 2e 4c 89 f0 f0 49 0f b1 1f 4d 85 f6
[24680.276019] RSP: 0018:ffffb50560b8b158 EFLAGS: 00010206
[24680.281236] RAX: ffffffffffffffb8 RBX: ffffffffffffffb8 RCX: ffff9caae595b058
[24680.288360] RDX: 0000000000000000 RSI: ffff9cad8f504000 RDI: ffff9caae595b000
[24680.295484] RBP: ffff9cad8f504000 R08: 0000000000000080 R09: 0000000000000f85
[24680.302608] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000000
[24680.309729] R13: ffffb50560b8b1c8 R14: ffff9caae595b000 R15: ffff9cad8f41a6e0
[24680.316856] FS: 0000000000000000(0000) GS:ffff9cad8fb80000(0000) knlGS:0000000000000000
[24680.324931] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[24680.330670] CR2: 0000000000000034 CR3: 0000000268010003 CR4: 00000000003606e0
[24680.337794] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[24680.344926] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[24680.352058] Call Trace:
[24680.354510] shrink_node+0xb2/0x4f0
[24680.358009] do_try_to_free_pages+0xd2/0x380
[24680.362280] try_to_free_pages+0xbf/0x1d0
[24680.366296] __alloc_pages_nodemask+0x76d/0x1160
[24680.370925] __get_free_pages+0x17/0x40
[24680.374786] btree_node_data_alloc+0xb3/0x230 [bcachefs]
[24680.380110] bch2_btree_node_mem_alloc+0x1f7/0x3c0 [bcachefs]
[24680.385881] __bch2_btree_node_alloc.isra.7+0x1b5/0x310 [bcachefs]
[24680.392075] bch2_btree_update_start+0x26a/0x340 [bcachefs]
[24680.397669] bch2_btree_split_leaf+0x132/0x330 [bcachefs]
[24680.403092] bch2_trans_commit_error.isra.2+0xff/0x380 [bcachefs]
[24680.409199] bch2_trans_commit+0x473/0x16e0 [bcachefs]
[24680.414360] bch2_extent_update+0x3ef/0x930 [bcachefs]
[24680.419527] bchfs_write_index_update+0x1a5/0x280 [bcachefs]
[24680.425211] ? bchfs_write_index_update+0xc9/0x280 [bcachefs]
[24680.430987] __bch2_write_index+0x160/0x320 [bcachefs]
[24680.436154] bch2_write_index+0x16/0xa0 [bcachefs]
[24680.440947] process_one_work+0x198/0x390
[24680.444964] worker_thread+0x30/0x380
[24680.448633] ? process_one_work+0x390/0x390
[24680.452821] kthread+0x114/0x130
[24680.456059] ? kthread_park+0x80/0x80
[24680.459725] ret_from_fork+0x35/0x40
[24680.463305] Modules linked in: nls_iso8859_1 nls_cp850 vfat fat xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel ast ttm aesni_intel drm_kms_helper aes_x86_64 crypto_simd cryptd glue_helper drm intel_cstate iTCO_wdt evdev iTCO_vendor_support xhci_pci drm_panel_orientation_quirks intel_uncore efi_pstore syscopyarea mpt3sas xhci_hcd sysfillrect igb ehci_pci intel_rapl_perf raid_class efivars sysimgblt ehci_hcd scsi_transport_sas fb_sys_fops i2c_algo_bit thermal dca fan usbcore i2c_i801 acpi_pad
[24680.463355] lpc_ich button mei_me mfd_core usb_common efivarfs
[24680.556239] CR2: 0000000000000034
[24680.559558] ---[ end trace d9cfcef524aab08b ]---
[24680.570480] RIP: 0010:mem_cgroup_iter+0x11e/0x2a0
[24680.575191] Code: 0f 84 ae 00 00 00 4c 89 f3 48 89 df 48 89 ee 88 54 24 07 e8 74 13 ee ff 0f b6 54 24 07 48 85 c0 48 89 c3 74 43 48 39 e8 74 06 <f6> 40 7c 01 74 42 4d 85 ed 74 2e 4c 89 f0 f0 49 0f b1 1f 4d 85 f6
[24680.593937] RSP: 0018:ffffb50541b53cf8 EFLAGS: 00010207
[24680.599161] RAX: 0000ffff0032ffc0 RBX: 0000ffff0032ffc0 RCX: ffff9caae595b058
[24680.606287] RDX: 0000000000000000 RSI: ffff9cad8f504000 RDI: ffff9caae595b000
[24680.613420] RBP: ffff9cad8f504000 R08: 0000000000000020 R09: 0000000000007895
[24680.620553] R10: ffffffff87044b20 R11: 0000000000000001 R12: 0000000000000000
[24680.627685] R13: ffffb50541b53d68 R14: ffff9caae595b000 R15: ffff9cad8f41a6e0
[24680.634819] FS: 0000000000000000(0000) GS:ffff9cad8fb80000(0000) knlGS:0000000000000000
[24680.642903] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[24680.648648] CR2: 0000000000000034 CR3: 0000000268010003 CR4: 00000000003606e0
[24680.655774] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[24680.662904] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
BUG: kernel NULL pointer dereference (__bch2_btree_iter_traverse)
I'm running bcachefs 27c447e.
After some programs started freezing, I found the NULL deref shown below in dmesg.
Steps to repro (not attempted):
- Plugged in a 1TB internal WDC hard drive through a USB adapter (the USB Attached SCSI in the trace below).
- Reformatted the 1TB ext4 partition to bcachefs.
- Filled up the drive ~80% by copying from Dolphin file manager
- Several minutes after the copy was done, unplugged the USB adapter.
- Dolphin had a tab still open in this partition
# bcachefs format --metadata_checksum=crc32c --data_checksum=crc32c /dev/sdg1
/dev/sdg1 contains a ext4 filesystem
Proceed anyway? (y,n) y
External UUID: f18c044f-b6b2-4b7c-9355-52eccdf2f645
Internal UUID: e8a0f163-05b6-4814-aad7-91b3a0141117
Label:
Version: 10
Created: Mon Apr 22 19:10:50 2019
Block_size: 4.0K
Btree node size: 256.0K
Error action: remount-ro
Clean: 0
Metadata replicas: 1
Data replicas: 1
Metadata checksum type: crc32c (1)
Data checksum type: crc32c (1)
Compression type: none (0)
Foreground write target: none
Background write target: none
Promote target: none
String hash type: siphash (2)
32 bit inodes: 0
GC reserve percentage: 8%
Root reserve percentage: 0%
Devices: 1 live, 1 total
Sections: members
Superblock size: 816
Members (size 64):
Device 0:
UUID: 822421a8-8f2b-42d1-adcd-29504c1b00bd
Size: 931.5G
Bucket size: 512.0K
First bucket: 0
Buckets: 1907737
Last mount: (never)
State: readwrite
Group: (none)
Data allowed: journalbtree,data,
Has data: (none)
Replacement policy: lru
Discard: 0
initializing new filesystem
mounted with opts: (null)[21058.834417] scsi host22: uas
[21058.847059] scsi 22:0:0:0: Direct-Access WDC WD10 EZEX-08WN4A0 0 PQ: 0 ANSI: 6
[21058.847556] sd 22:0:0:0: Attached scsi generic sg6 type 0
[21058.847964] sd 22:0:0:0: [sdg] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[21058.847966] sd 22:0:0:0: [sdg] 4096-byte physical blocks
[21058.848045] sd 22:0:0:0: [sdg] Write Protect is off
[21058.848050] sd 22:0:0:0: [sdg] Mode Sense: 43 00 00 00
[21058.848205] sd 22:0:0:0: [sdg] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[21059.023461] sdg: sdg1
[21059.024589] sd 22:0:0:0: [sdg] Attached SCSI disk
[21121.752014] EXT4-fs (sdg1): mounted filesystem with ordered data mode. Opts: (null)
[21455.162937] bcachefs (sdg1): recovering from clean shutdown, journal seq 13
[21455.267572] bcachefs (sdg1): mounted with opts: (null)
[24895.634890] EXT4-fs (sda4): mounted filesystem with ordered data mode. Opts: (null)
[30469.148999] usb 2-4: USB disconnect, device number 3
[30469.217899] sd 22:0:0:0: [sdg] Synchronizing SCSI cache
[30469.468882] sd 22:0:0:0: [sdg] Synchronize Cache(10) failed: Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
[31830.105751] bcachefs (sdg1): IO error on sdg1 for btree read
[31830.105762] BUG: unable to handle kernel NULL pointer dereference at 0000000000000026
[31830.105763] #PF error: [normal kernel read fault]
[31830.105765] PGD 0 P4D 0
[31830.105768] Oops: 0000 [#1] SMP NOPTI
[31830.105770] CPU: 2 PID: 1607 Comm: dolphin Tainted: P OE 5.0.0-bcachefs #16
[31830.105772] Hardware name: Micro-Star International Co., Ltd. MS-7A34/B350 PC MATE (MS-7A34), BIOS A.D0 03/16/2018
[31830.105788] RIP: 0010:__btree_iter_traverse_all.isra.26+0x258/0x2d0 [bcachefs]
[31830.105790] Code: ff ff ff e9 2d fe ff ff 48 69 d2 b8 00 00 00 4c 8d 43 01 4c 01 da 0f 84 2c ff ff ff 4c 89 c3 e9 f8 fe ff ff 41 80 4c 24 43 02 <0f> b6 53 26 80 4b 24 20 83 e2 0f 48 8d 14 52 48 c7 44 d3 28 01 00
[31830.105791] RSP: 0018:ffffb90ac34a76a0 EFLAGS: 00010202
[31830.105793] RAX: 00000000fffffffb RBX: 0000000000000000 RCX: 0000000000000001
[31830.105794] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffb90ac34a77d0
[31830.105795] RBP: ffffb90ac34a77a8 R08: 0000000000000000 R09: ffffffffc1c6b9bf
[31830.105796] R10: 0000000000000000 R11: ffffb90ac34a7868 R12: ffffb90ac34a77d0
[31830.105797] R13: ffff96455d8f0aa0 R14: 0000000000000001 R15: ffffb90ac34a76b0
[31830.105798] FS: 00007f6ce294f840(0000) GS:ffff96458ea80000(0000) knlGS:0000000000000000
[31830.105799] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[31830.105800] CR2: 0000000000000026 CR3: 000000040b784000 CR4: 00000000003406e0
[31830.105801] Call Trace:
[31830.105818] ? __bch2_btree_iter_traverse+0x162/0x680 [bcachefs]
[31830.105832] bch2_btree_iter_peek_slot+0x9d/0x2e0 [bcachefs]
[31830.105845] ? __bch2_trans_get_iter+0x66/0x80 [bcachefs]
[31830.105859] bch2_dirent_lookup+0xea/0x1a0 [bcachefs]
[31830.105866] ? dequeue_entity+0x16b/0x8e0
[31830.105868] ? pick_next_task_fair+0x3c7/0x6e0
[31830.105870] ? dequeue_task_fair+0x3e/0x690
[31830.105873] ? __switch_to+0x16d/0x440
[31830.105876] ? timerqueue_del+0x1e/0x40
[31830.105878] ? __remove_hrtimer+0x35/0x70
[31830.105881] ? __flush_work+0x57/0x1b0
[31830.105884] ? schedule_hrtimeout_range_clock+0xc6/0x1a0
[31830.105887] ? free_unref_page_commit+0x8f/0x100
[31830.105890] ? poll_freewait+0x86/0xa0
[31830.105893] ? memcg_kmem_get_cache+0x57/0x1a0
[31830.105895] ? kmem_cache_alloc+0x150/0x1b0
[31830.105897] ? __d_alloc+0x11a/0x1c0
[31830.105899] ? d_alloc_parallel+0x99/0x480
[31830.105901] ? __follow_mount_rcu.isra.38.part.39+0x56/0xd0
[31830.105916] bch2_lookup+0x2c/0x60 [bcachefs]
[31830.105918] __lookup_slow+0x91/0x140
[31830.105921] lookup_slow+0x35/0x50
[31830.105922] walk_component+0x1b9/0x330
[31830.105925] ? poll_select_copy_remaining+0x1b0/0x1b0
[31830.105927] path_lookupat.isra.49+0x6d/0x220
[31830.105929] ? poll_select_copy_remaining+0x1b0/0x1b0
[31830.105931] filename_lookup.part.63+0xa0/0x170
[31830.105934] ? strncpy_from_user+0x4f/0x1b0
[31830.105935] ? getname_flags+0x6a/0x1e0
[31830.105939] user_statfs+0x43/0xa0
[31830.105941] __do_sys_statfs+0x20/0x50
[31830.105943] ? vfs_write+0x171/0x1a0
[31830.105945] ? ksys_write+0x9c/0xb0
[31830.105947] do_syscall_64+0x49/0xd0
[31830.105949] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[31830.105952] RIP: 0033:0x7f6cea2ac197
[31830.105953] Code: 44 00 00 48 8b 05 f9 0c 0d 00 64 c7 00 16 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 b8 89 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c9 0c 0d 00 f7 d8 64 89 01 48
[31830.105954] RSP: 002b:00007ffeb4f6f6b8 EFLAGS: 00000206 ORIG_RAX: 0000000000000089
[31830.105956] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f6cea2ac197
[31830.105957] RDX: 0000000000000000 RSI: 00007ffeb4f6f6d0 RDI: 000055e04fe02d28
[31830.105958] RBP: 00007ffeb4f6f760 R08: 00007f6cea37dc40 R09: 0000000000000026
[31830.105959] R10: 00007f6ce847f660 R11: 0000000000000206 R12: 00007ffeb4f6f7a8
[31830.105960] R13: 00007ffeb4f6f7d0 R14: 00007ffeb4f6f7a0 R15: 00007ffeb4f6f9f0
[31830.105961] Modules linked in: bcachefs(E) lz4_compress(E) crc64(E) zstd_compress(E) zstd_decompress(E) pci_stub(E) vboxpci(OE) vboxnetadp(OE) vboxnetflt(OE) vboxdrv(OE) snd_hda_codec_hdmi(E) cpufreq_conservative(E) cpufreq_userspace(E) cpufreq_powersave(E) edac_mce_amd(E) kvm_amd(E) kvm(E) binfmt_misc(E) irqbypass(E) nls_ascii(E) nls_cp437(E) vfat(E) fuse(E) fat(E) crct10dif_pclmul(E) crc32_pclmul(E) ghash_clmulni_intel(E) snd_hda_codec_realtek(E) snd_hda_codec_generic(E) ledtrig_audio(E) snd_hda_intel(E) snd_hda_codec(E) efi_pstore(E) snd_hda_core(E) aesni_intel(E) snd_hwdep(E) snd_pcm(E) aes_x86_64(E) crypto_simd(E) cryptd(E) snd_timer(E) ppdev(E) joydev(E) glue_helper(E) wmi_bmof(E) efivars(E) k10temp(E) ccp(E) snd(E) sp5100_tco(E) rng_core(E) soundcore(E) sg(E) parport_pc(E) parport(E) evdev(E) pcc_cpufreq(E) acpi_cpufreq(E) nvidia_drm(POE) drm_kms_helper(E) drm(E) fb_sys_fops(E) syscopyarea(E) sysfillrect(E) sysimgblt(E) nvidia_modeset(POE) nvidia(POE) ipmi_devintf(E)
[31830.105987] ipmi_msghandler(E) efivarfs(E) ip_tables(E) x_tables(E) autofs4(E) ext4(E) crc16(E) mbcache(E) jbd2(E) fscrypto(E) raid10(E) raid456(E) async_raid6_recov(E) async_memcpy(E) async_pq(E) async_xor(E) async_tx(E) libcrc32c(E) crc32c_generic(E) xor(E) raid6_pq(E) raid0(E) multipath(E) linear(E) hid_logitech_hidpp(E) hid_logitech_dj(E) raid1(E) hid_generic(E) md_mod(E) usbhid(E) hid(E) uas(E) usb_storage(E) sd_mod(E) ahci(E) xhci_pci(E) libahci(E) xhci_hcd(E) libata(E) crc32c_intel(E) r8169(E) realtek(E) scsi_mod(E) nvme(E) i2c_piix4(E) usbcore(E) libphy(E) nvme_core(E) wmi(E) gpio_amdpt(E) gpio_generic(E) button(E)
[31830.106009] CR2: 0000000000000026
[31830.106011] ---[ end trace dda446241a96cd93 ]---
[31832.650781] RIP: 0010:__btree_iter_traverse_all.isra.26+0x258/0x2d0 [bcachefs]
[31832.650785] Code: ff ff ff e9 2d fe ff ff 48 69 d2 b8 00 00 00 4c 8d 43 01 4c 01 da 0f 84 2c ff ff ff 4c 89 c3 e9 f8 fe ff ff 41 80 4c 24 43 02 <0f> b6 53 26 80 4b 24 20 83 e2 0f 48 8d 14 52 48 c7 44 d3 28 01 00
[31832.650786] RSP: 0018:ffffb90ac34a76a0 EFLAGS: 00010202
[31832.650788] RAX: 00000000fffffffb RBX: 0000000000000000 RCX: 0000000000000001
[31832.650789] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffb90ac34a77d0
[31832.650790] RBP: ffffb90ac34a77a8 R08: 0000000000000000 R09: ffffffffc1c6b9bf
[31832.650790] R10: 0000000000000000 R11: ffffb90ac34a7868 R12: ffffb90ac34a77d0
[31832.650791] R13: ffff96455d8f0aa0 R14: 0000000000000001 R15: ffffb90ac34a76b0
[31832.650792] FS: 00007f6ce294f840(0000) GS:ffff96458ea80000(0000) knlGS:0000000000000000
[31832.650793] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[31832.650794] CR2: 0000000000000026 CR3: 000000040b784000 CR4: 00000000003406e0
kernel bug at ../fs/bcachefs/btree_iter.c:802
Was wondering why a program I was running hung, found this in my journal:
Mar 29 02:25:19 nixos kernel: kernel BUG at ../fs/bcachefs/btree_iter.c:802!
Mar 29 02:25:19 nixos kernel: invalid opcode: 0000 [#1] SMP PTI
Mar 29 02:25:19 nixos kernel: CPU: 0 PID: 8876 Comm: nix Tainted: P O 4.20.0 #1-NixOS
Mar 29 02:25:19 nixos kernel: Hardware name: Dell Inc. Latitude E5470/0C8FKJ, BIOS 1.19.3 08/20/2018
Mar 29 02:25:19 nixos kernel: RIP: 0010:bch2_btree_iter_node_replace+0x482/0x4c0 [bcachefs]
Mar 29 02:25:19 nixos kernel: Code: 00 66 3b 45 02 0f 84 90 fe ff ff 49 8b 94 24 d8 00 00 00 80 7c c2 0a 01 76 d8 e9 7c fe ff ff 0f 88 2f fc ff ff e9 0a fd ff ff <0f> 0b 0f 88 5c fd ff ff e9 ed fd ff ff 0f 0b 8b 54 24 0c 85 d2 0f
Mar 29 02:25:19 nixos kernel: RSP: 0018:ffffa13746e537a8 EFLAGS: 00010203
Mar 29 02:25:19 nixos kernel: RAX: 0000000000000001 RBX: ffff95a3fb137e00 RCX: 0000000000000000
Mar 29 02:25:19 nixos kernel: RDX: ffff95a2823498c8 RSI: 0000000000000000 RDI: 0000000000000000
Mar 29 02:25:19 nixos kernel: RBP: ffff95a3fb137e08 R08: 00000000000000b8 R09: 0000000000000001
Mar 29 02:25:19 nixos kernel: R10: ffffa1374451d000 R11: ffff95a2c4b8ed80 R12: ffffa13746e53bc0
Mar 29 02:25:19 nixos kernel: R13: ffff95a2823498b8 R14: ffff95a3fb137e00 R15: 0000000000000001
Mar 29 02:25:19 nixos kernel: FS: 00007f93ab1bdc00(0000) GS:ffff95a42da00000(0000) knlGS:0000000000000000
Mar 29 02:25:19 nixos kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 29 02:25:19 nixos kernel: CR2: 0000000016943800 CR3: 0000000685436001 CR4: 00000000003606f0
Mar 29 02:25:19 nixos kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 29 02:25:19 nixos kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Mar 29 02:25:19 nixos kernel: Call Trace:
Mar 29 02:25:19 nixos kernel: ? __bch2_open_bucket_put+0x124/0x1c0 [bcachefs]
Mar 29 02:25:19 nixos kernel: ? __bch2_open_bucket_put+0x15d/0x1c0 [bcachefs]
Mar 29 02:25:19 nixos kernel: __bch2_foreground_maybe_merge+0x6db/0x980 [bcachefs]
Mar 29 02:25:19 nixos kernel: bch2_trans_commit+0x113a/0x16c0 [bcachefs]
Mar 29 02:25:19 nixos kernel: __bch2_create+0x34c/0x590 [bcachefs]
Mar 29 02:25:19 nixos kernel: ? d_lookup+0x2b/0x40
Mar 29 02:25:19 nixos kernel: ? lookup_dcache+0x17/0x60
Mar 29 02:25:19 nixos kernel: ? bch2_mkdir+0x19/0x30 [bcachefs]
Mar 29 02:25:19 nixos kernel: bch2_mkdir+0x19/0x30 [bcachefs]
Mar 29 02:25:19 nixos kernel: vfs_mkdir+0x101/0x1b0
Mar 29 02:25:19 nixos kernel: do_mkdirat+0xec/0x120
Mar 29 02:25:19 nixos kernel: do_syscall_64+0x4e/0x100
Mar 29 02:25:19 nixos kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Mar 29 02:25:19 nixos kernel: RIP: 0033:0x7f93a9242e67
Mar 29 02:25:19 nixos kernel: Code: 1f 40 00 48 8b 05 19 a0 2c 00 64 c7 00 5f 00 00 00 b8 ff ff ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 66 90 b8 53 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d e9 9f 2c 00 f7 d8 64 89 01 48
Mar 29 02:25:19 nixos kernel: RSP: 002b:00007f93a07b9298 EFLAGS: 00000202 ORIG_RAX: 0000000000000053
Mar 29 02:25:19 nixos kernel: RAX: ffffffffffffffda RBX: 00007f93a07b96d0 RCX: 00007f93a9242e67
Mar 29 02:25:19 nixos kernel: RDX: 00000000016da030 RSI: 00000000000001ff RDI: 00000000168deb50
Mar 29 02:25:19 nixos kernel: RBP: 00007f93a07b9e10 R08: 0000000000000035 R09: 0000000000000049
Mar 29 02:25:19 nixos kernel: R10: 0000000000005000 R11: 0000000000000202 R12: 00007f93a07b93a0
Mar 29 02:25:19 nixos kernel: R13: 00007f93a07b9430 R14: 00007f93a07b9510 R15: 0000000016807ff0
Mar 29 02:25:19 nixos kernel: Modules linked in: ctr ccm poly1305_x86_64 poly1305_generic chacha20_x86_64 chacha20_generic bcachefs lz4_compress crc64 zstd_compress xor raid6_pq af_packet iptable_nat nf_nat_ipv4 nf_nat xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c crc32c_generic xt_tcpudp ip6t_rpfilter ipt_rpfilter ip6table_raw iptable_raw xt_pkttype ip6table_filter ip6_tables iptable_filter snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic zfs(PO) joydev intel_pmc_core mousedev x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel arc4 dell_wmi wmi_bmof sparse_keymap rtsx_pci_ms rtsx_pci_sdmmc memstick mmc_core intel_wmi_thunderbolt ppdev mei_wdt crct10dif_pclmul iTCO_wdt crc32_pclmul dell_laptop ghash_clmulni_intel dell_smbios dell_wmi_descriptor dcdbas dell_smm_hwmon iwlmvm mac80211 uvcvideo videobuf2_vmalloc videobuf2_memops videobuf2_v4l2 videobuf2_common zunicode(PO) videodev zavl(PO) aesni_intel icp(PO) iwlwifi media aes_x86_64 crypto_simd cryptd deflate btusb
Mar 29 02:25:19 nixos kernel: evdev i915 glue_helper input_leds intel_cstate btrtl efi_pstore btbcm btintel pstore psmouse intel_uncore led_class bluetooth intel_rapl_perf mac_hid serio_raw cfg80211 kvmgt vfio_mdev mdev tpm_tis tpm_tis_core vfio_iommu_type1 efivars rtsx_pci vfio ecdh_generic tpm kvm crc16 zlua(PO) wmi thermal irqbypass rng_core cec drm_kms_helper battery drm intel_gtt agpgart i2c_algo_bit e1000e snd_hda_intel snd_hda_codec snd_hda_core fb_sys_fops syscopyarea sysfillrect sysimgblt snd_hwdep parport_pc snd_pcm parport snd_timer mei_me ptp snd i2c_i801 pps_core processor_thermal_device int3403_thermal dell_smo8800 dell_rbtn video int3400_thermal mei i2c_core 8250_pci int340x_thermal_zone acpi_thermal_rel intel_soc_dts_iosf intel_pch_thermal acpi_pad rfkill soundcore button ac pcc_cpufreq zcommon(PO) znvpair(PO) spl(O) efivarfs ip_tables x_tables ipv6 crc_ccitt autofs4 squashfs zstd_decompress xxhash isofs sd_mod uas usb_storage ahci libahci libata xhci_pci xhci_hcd atkbd libps2 scsi_mod
Mar 29 02:25:19 nixos kernel: usbcore crc32c_intel usb_common rtc_cmos i8042 serio dm_mod fuse nls_iso8859_1 nls_cp437 vfat fat loop
Mar 29 02:25:19 nixos kernel: ---[ end trace ada913c8b8a323bc ]---
Mar 29 02:25:20 nixos kernel: RIP: 0010:bch2_btree_iter_node_replace+0x482/0x4c0 [bcachefs]
Mar 29 02:25:20 nixos kernel: Code: 00 66 3b 45 02 0f 84 90 fe ff ff 49 8b 94 24 d8 00 00 00 80 7c c2 0a 01 76 d8 e9 7c fe ff ff 0f 88 2f fc ff ff e9 0a fd ff ff <0f> 0b 0f 88 5c fd ff ff e9 ed fd ff ff 0f 0b 8b 54 24 0c 85 d2 0f
Mar 29 02:25:20 nixos kernel: RSP: 0018:ffffa13746e537a8 EFLAGS: 00010203
Mar 29 02:25:20 nixos kernel: RAX: 0000000000000001 RBX: ffff95a3fb137e00 RCX: 0000000000000000
Mar 29 02:25:20 nixos kernel: RDX: ffff95a2823498c8 RSI: 0000000000000000 RDI: 0000000000000000
Mar 29 02:25:20 nixos kernel: RBP: ffff95a3fb137e08 R08: 00000000000000b8 R09: 0000000000000001
Mar 29 02:25:20 nixos kernel: R10: ffffa1374451d000 R11: ffff95a2c4b8ed80 R12: ffffa13746e53bc0
Mar 29 02:25:20 nixos kernel: R13: ffff95a2823498b8 R14: ffff95a3fb137e00 R15: 0000000000000001
Mar 29 02:25:20 nixos kernel: FS: 00007f93ab1bdc00(0000) GS:ffff95a42db80000(0000) knlGS:0000000000000000
Mar 29 02:25:20 nixos kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Mar 29 02:25:20 nixos kernel: CR2: 0000559e7a992648 CR3: 0000000685436004 CR4: 00000000003606e0
Mar 29 02:25:20 nixos kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 29 02:25:20 nixos kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Commit used is 4d5809b, and the filesystem was created using bcachefs format --compression=lz4 --background_compression=zstd --foreground_target=/dev/sda1 --background_target=/dev/sdb2 --promote_target=/dev/sda1 --encrypted --label=nixos --force /dev/sdb2 /dev/sda1.
`make modules` fails ~ "bio_iov_iter_get_pages" undefined
Error output:
ERROR: "bio_iov_iter_get_pages" [fs/bcachefs/bcachefs.ko] undefined!
make[1]: *** [scripts/Makefile.modpost:92: __modpost] Error 1
make: *** [Makefile:1264: modules] Error 2
[armv7] mm/filemap.c:2532:23: error: โpageโ undeclared (first use in this function)
On arm, gcc-5.3.1
CC mm/filemap.o
mm/filemap.c: In function โgeneric_file_buffered_readโ:
mm/filemap.c:2532:23: error: โpageโ undeclared (first use in this function)
flush_dcache_page(page);
^
mm/filemap.c:2532:23: note: each undeclared identifier is reported only once for each function it appears in
scripts/Makefile.build:275: recipe for target 'mm/filemap.o' failed
[bcachefs-tools] can't resize fs
# bcachefs device resize /dev/crypted/dane2
Doing offline resize of /dev/crypted/dane2
journal read done, 33 keys in 1 entries, seq 286244
starting metadata mark and sweep
starting mark and sweep
starting fsck
mounted with opts: compression=zstd
resizing /dev/crypted/dane2 to 163840 buckets
bcachefs: libbcachefs/journal.c:976: bch2_fs_journal_stop: Assertion `!(!bch2_journal_error(j) && test_bit(JOURNAL_NOT_EMPTY, &j->flags))' failed.
Aborted (core dumped)
# echo bt | gdb -q /sbin/bcachefs 'core-1557213154-0-6-!sbin!bcachefs-13787'
Reading symbols from /sbin/bcachefs...(no debugging symbols found)...done.
[New LWP 13787]
[New LWP 13788]
[New LWP 13794]
[New LWP 13789]
[New LWP 13797]
[New LWP 13791]
[New LWP 13812]
[New LWP 13796]
[New LWP 13793]
[New LWP 13795]
[New LWP 13790]
[New LWP 13792]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `bcachefs device resize /dev/crypted/dane2'.
Program terminated with signal SIGABRT, Aborted.
#0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
50 return ret;
[Current thread is 1 (Thread 0x7fc2b19aad80 (LWP 13787))]
(gdb) #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
#1 0x00007fc2affe27a5 in __GI_abort () at abort.c:79
#2 0x00007fc2affe267f in __assert_fail_base (fmt=<optimized out>, assertion=0x558957cce7bf "!(!bch2_journal_error(j) && test_bit(JOURNAL_NOT_EMPTY, &j->flags))",
file=0x558957cce5da "libbcachefs/journal.c", line=976, function=0x558957ccea70 "bch2_fs_journal_stop") at assert.c:92
#3 0x00007fc2afff0f22 in __GI___assert_fail (assertion=0x558957cce7bf "!(!bch2_journal_error(j) && test_bit(JOURNAL_NOT_EMPTY, &j->flags))", file=0x558957cce5da "libbcachefs/journal.c",
line=976, function=0x558957ccea70 "bch2_fs_journal_stop") at assert.c:101
#4 0x0000558957c87f5b in ?? ()
#5 0x0000558957c98060 in ?? ()
#6 0x0000558957c9844e in ?? ()
#7 0x0000558957c98864 in ?? ()
#8 0x0000558957cbb42a in ?? ()
#9 0x0000558957c49cd2 in ?? ()
#10 0x00007fc2affe469b in __libc_start_main (main=0x558957c49a70, argc=4, argv=0x7ffec0114b58, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7ffec0114b48)
at ../csu/libc-start.c:308
#11 0x0000558957c4a75a in ?? ()
(gdb) quit
Linux 5.0 build errors
removes current_kernel_time64 ZFS does fix this by:
also merging with upstream removes include/crypto/chacha20.h
5.1 rebase: general protection fault: 0000 [#1] SMP PTI Workqueue: events_highpri __bch2_read_endio [bcachefs] RIP: 0010:__crc32c_le_base+0x88/0x160
This appears after trying to mount my bchachefs fs. Filesystem appears to mount fine and seems usable.
Commit: a6470a6 with linux-stable/v5.1.8 merged.
[ 35.394306] general protection fault: 0000 [#1] SMP PTI
[ 35.399535] CPU: 0 PID: 1772 Comm: kworker/0:2H Tainted: G T 5.1.8-00445-g044f42625f44 #1
[ 35.409004] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 35.418920] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 35.425102] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 35.429804] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 35.448543] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 35.453758] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 35.460882] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 35.468008] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 35.475131] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 35.482254] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 35.489378] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 35.497457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 35.503192] CR2: 0000559697f12ff0 CR3: 0000000365fde001 CR4: 00000000000606f0
[ 35.510317] Call Trace:
[ 35.512767] chksum_update+0x19/0x30
[ 35.516342] crc32c+0x55/0x90
[ 35.519317] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 35.524459] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 35.530294] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 35.535182] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 35.540413] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 35.545463] process_one_work+0x172/0x310
[ 35.549466] ? process_one_work+0x310/0x310
[ 35.553642] worker_thread+0x2b/0x380
[ 35.557299] ? process_one_work+0x310/0x310
[ 35.561478] kthread+0x10a/0x120
[ 35.564701] ? kthread_park+0x80/0x80
[ 35.568359] ret_from_fork+0x35/0x40
[ 35.571930] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 35.656459] ---[ end trace 5899dd5ae1cf169a ]---
[ 35.662968] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 35.667677] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 35.686434] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 35.691666] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 35.691666] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 35.691667] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 35.691667] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 35.691668] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 35.691668] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 35.691669] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 35.691669] CR2: 0000559697f12ff0 CR3: 0000000365fde001 CR4: 00000000000606f0
[ 36.787001] general protection fault: 0000 [#2] SMP PTI
[ 36.792221] CPU: 0 PID: 1975 Comm: kworker/0:3H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 36.801683] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 36.811597] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 36.817781] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 36.822484] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 36.841222] RSP: 0000:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 36.846438] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 36.853564] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 36.860687] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 36.867810] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 36.874936] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 36.882059] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 36.890137] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 36.895875] CR2: 00007f92623a176e CR3: 0000000365cae002 CR4: 00000000000606f0
[ 36.902996] Call Trace:
[ 36.905445] chksum_update+0x19/0x30
[ 36.909022] crc32c+0x55/0x90
[ 36.911997] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 36.917139] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 36.922983] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 36.927869] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 36.933095] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 36.938142] process_one_work+0x172/0x310
[ 36.942144] ? process_one_work+0x310/0x310
[ 36.946321] worker_thread+0x2b/0x380
[ 36.949980] ? process_one_work+0x310/0x310
[ 36.954157] kthread+0x10a/0x120
[ 36.957381] ? kthread_park+0x80/0x80
[ 36.961038] ret_from_fork+0x35/0x40
[ 36.964611] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.049149] ---[ end trace 5899dd5ae1cf169b ]---
[ 37.055930] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.060654] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.079409] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.079411] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.079411] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.079412] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.079412] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.079412] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.079413] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.079414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.079414] CR2: 00007f92623a176e CR3: 0000000365cae002 CR4: 00000000000606f0
[ 37.081363] general protection fault: 0000 [#3] SMP PTI
[ 37.146430] CPU: 0 PID: 6 Comm: kworker/0:0H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.146431] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.146446] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.146450] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.146451] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.146452] RSP: 0018:ffffa4a8818ef8e0 EFLAGS: 00010206
[ 37.146452] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.146453] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.146453] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.146454] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.146454] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.146455] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.146456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.146456] CR2: 0000555b59727000 CR3: 0000000365fde003 CR4: 00000000000606f0
[ 37.146457] Call Trace:
[ 37.146460] chksum_update+0x19/0x30
[ 37.146462] crc32c+0x55/0x90
[ 37.146471] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.146480] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.146488] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.146496] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.146504] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.146506] process_one_work+0x172/0x310
[ 37.146507] worker_thread+0x2b/0x380
[ 37.146508] ? process_one_work+0x310/0x310
[ 37.146510] kthread+0x10a/0x120
[ 37.146511] ? kthread_park+0x80/0x80
[ 37.146513] ret_from_fork+0x35/0x40
[ 37.146514] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.146573] ---[ end trace 5899dd5ae1cf169c ]---
[ 37.148788] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.410795] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.410795] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.410797] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.410798] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.410798] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.410799] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.410800] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.410801] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.478509] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.478510] CR2: 0000555b59727000 CR3: 0000000365fde003 CR4: 00000000000606f0
[ 37.478621] general protection fault: 0000 [#4] SMP PTI
[ 37.496607] CPU: 0 PID: 128 Comm: kworker/0:1H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.496608] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.496624] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.522062] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.522063] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.545503] RSP: 0018:ffffa4a8825e78e0 EFLAGS: 00010206
[ 37.545504] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.545505] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.545505] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.545506] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.545507] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.545508] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.545508] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.545509] CR2: 0000555b59727000 CR3: 0000000365fde003 CR4: 00000000000606f0
[ 37.545510] Call Trace:
[ 37.545515] chksum_update+0x19/0x30
[ 37.545519] crc32c+0x55/0x90
[ 37.616296] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.616305] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.627272] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.627280] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.627288] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.642422] process_one_work+0x172/0x310
[ 37.642423] worker_thread+0x2b/0x380
[ 37.642424] ? process_one_work+0x310/0x310
[ 37.642426] kthread+0x10a/0x120
[ 37.642427] ? kthread_park+0x80/0x80
[ 37.642431] ret_from_fork+0x35/0x40
[ 37.642432] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.749237] ---[ end trace 5899dd5ae1cf169d ]---
[ 37.752011] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.761293] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.761294] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.761295] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.761296] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.761296] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.761296] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.761297] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.761299] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.829648] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.829648] CR2: 0000555b59727000 CR3: 0000000365fde003 CR4: 00000000000606f0
[ 37.845864] general protection fault: 0000 [#5] SMP PTI
[ 37.845866] CPU: 0 PID: 4073 Comm: kworker/0:4H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.845867] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.845883] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.845887] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.845888] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.845888] RSP: 0018:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 37.845889] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.845890] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.845890] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.845891] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.845891] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.845892] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.845893] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.845893] CR2: 00007f4cc1c35b00 CR3: 000000031f574006 CR4: 00000000000606f0
[ 37.845894] Call Trace:
[ 37.845897] chksum_update+0x19/0x30
[ 37.845899] crc32c+0x55/0x90
[ 37.845910] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.845919] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.845927] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.845935] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.845942] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.845945] process_one_work+0x172/0x310
[ 37.845946] worker_thread+0x2b/0x380
[ 37.845947] ? process_one_work+0x310/0x310
[ 37.845949] kthread+0x10a/0x120
[ 37.845951] ? kthread_park+0x80/0x80
[ 37.845953] ret_from_fork+0x35/0x40
[ 37.845954] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.845986] ---[ end trace 5899dd5ae1cf169e ]---
[ 37.848921] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.848922] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.848923] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.848924] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.848924] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.848925] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.848925] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.848926] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.848927] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.848927] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.848928] CR2: 00007f4cc1c35b00 CR3: 000000031f574006 CR4: 00000000000606f0
[ 37.858216] general protection fault: 0000 [#6] SMP PTI
[ 37.858219] CPU: 0 PID: 4094 Comm: kworker/0:5H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.858220] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.858235] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.858239] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.858240] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.858240] RSP: 0000:ffffa4a8825e78e0 EFLAGS: 00010206
[ 37.858241] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.858242] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.858243] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.858244] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.858244] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.858245] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.858246] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.858247] CR2: 000055d331a44188 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.858247] Call Trace:
[ 37.858251] chksum_update+0x19/0x30
[ 37.858253] crc32c+0x55/0x90
[ 37.858263] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.858271] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.858279] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.858287] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.858294] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.858297] process_one_work+0x172/0x310
[ 37.858298] worker_thread+0x2b/0x380
[ 37.858299] ? process_one_work+0x310/0x310
[ 37.858300] kthread+0x10a/0x120
[ 37.858302] ? kthread_park+0x80/0x80
[ 37.858304] ret_from_fork+0x35/0x40
[ 37.858305] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.858337] ---[ end trace 5899dd5ae1cf169f ]---
[ 37.861319] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.861320] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.861320] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.861321] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.861322] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.861322] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.861323] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.861323] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.861324] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.861324] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.861325] CR2: 000055d331a44188 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.867675] general protection fault: 0000 [#7] SMP PTI
[ 37.867677] CPU: 0 PID: 4100 Comm: kworker/0:6H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.867678] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.867693] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.867697] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.867698] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.867699] RSP: 0000:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 37.867700] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.867701] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.867702] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.867702] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.867703] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.867703] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.867704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.867705] CR2: 000055d330982370 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.867705] Call Trace:
[ 37.867710] chksum_update+0x19/0x30
[ 37.867712] crc32c+0x55/0x90
[ 37.867724] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.867732] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.867741] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.867749] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.867757] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.867760] process_one_work+0x172/0x310
[ 37.867761] worker_thread+0x2b/0x380
[ 37.867762] ? process_one_work+0x310/0x310
[ 37.867763] kthread+0x10a/0x120
[ 37.867764] ? kthread_park+0x80/0x80
[ 37.867766] ret_from_fork+0x35/0x40
[ 37.867767] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.867802] ---[ end trace 5899dd5ae1cf16a0 ]---
[ 37.870856] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.870857] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.870857] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.870858] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.870859] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.870859] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.870860] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.870860] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.870861] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.870862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.870862] CR2: 000055d330982370 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.881606] general protection fault: 0000 [#8] SMP PTI
[ 37.881608] CPU: 0 PID: 4104 Comm: kworker/0:7H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.881608] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.881623] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.881627] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.881628] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.881629] RSP: 0018:ffffa4a8825e78e0 EFLAGS: 00010206
[ 37.881630] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.881630] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.881631] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.881631] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.881632] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.881632] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.881633] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.881633] CR2: 0000564d94b58ff0 CR3: 000000037b656002 CR4: 00000000000606f0
[ 37.881634] Call Trace:
[ 37.881637] chksum_update+0x19/0x30
[ 37.881639] crc32c+0x55/0x90
[ 37.881650] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.881659] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.881667] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.881676] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.881683] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.881686] process_one_work+0x172/0x310
[ 37.881687] worker_thread+0x2b/0x380
[ 37.881688] ? process_one_work+0x310/0x310
[ 37.881689] kthread+0x10a/0x120
[ 37.881691] ? kthread_park+0x80/0x80
[ 37.881693] ret_from_fork+0x35/0x40
[ 37.881694] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.881727] ---[ end trace 5899dd5ae1cf16a1 ]---
[ 37.884798] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.884799] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.884800] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.884801] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.884801] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.884802] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.884802] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.884802] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.884803] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.884804] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.884804] CR2: 0000564d94b58ff0 CR3: 000000037b656002 CR4: 00000000000606f0
[ 37.884944] general protection fault: 0000 [#9] SMP PTI
[ 37.884946] CPU: 0 PID: 4116 Comm: kworker/0:8H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.884947] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.884958] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.884961] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.884962] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.884962] RSP: 0018:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 37.884963] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.884963] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.884964] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.884964] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.884965] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.884965] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.884966] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.884966] CR2: 000000c4201b6000 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.884967] Call Trace:
[ 37.884969] chksum_update+0x19/0x30
[ 37.884971] crc32c+0x55/0x90
[ 37.884980] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.884988] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.884995] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.885003] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.885010] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.885013] process_one_work+0x172/0x310
[ 37.885014] worker_thread+0x2b/0x380
[ 37.885015] ? process_one_work+0x310/0x310
[ 37.885016] kthread+0x10a/0x120
[ 37.885018] ? kthread_park+0x80/0x80
[ 37.885020] ret_from_fork+0x35/0x40
[ 37.885021] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.885051] ---[ end trace 5899dd5ae1cf16a2 ]---
[ 37.888171] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.888172] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.888173] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.888174] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.888174] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.888175] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.888175] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.888176] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.888177] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.888177] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.888178] CR2: 000000c4201b6000 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.898267] general protection fault: 0000 [#10] SMP PTI
[ 37.898269] CPU: 0 PID: 4117 Comm: kworker/0:9H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.898270] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.898285] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.898289] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.898290] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.898290] RSP: 0018:ffffa4a8825e78e0 EFLAGS: 00010206
[ 37.898291] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.898292] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.898292] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.898293] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.898294] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.898294] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.898295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.898296] CR2: 000000c4201b6000 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.898297] Call Trace:
[ 37.898301] chksum_update+0x19/0x30
[ 37.898302] crc32c+0x55/0x90
[ 37.898313] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.898322] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.898330] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.898338] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.898347] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.898350] process_one_work+0x172/0x310
[ 37.898351] worker_thread+0x2b/0x380
[ 37.898352] ? process_one_work+0x310/0x310
[ 37.898353] kthread+0x10a/0x120
[ 37.898355] ? kthread_park+0x80/0x80
[ 37.898357] ret_from_fork+0x35/0x40
[ 37.898359] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.898391] ---[ end trace 5899dd5ae1cf16a3 ]---
[ 37.902269] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.902270] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.902271] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.902272] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.902273] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.902273] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.902274] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.902274] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.902275] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.902275] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.902276] CR2: 000000c4201b6000 CR3: 00000003d79ee001 CR4: 00000000000606f0
[ 37.908540] general protection fault: 0000 [#11] SMP PTI
[ 37.908542] CPU: 0 PID: 4118 Comm: kworker/0:10H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.908543] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.908559] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.908563] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.908564] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.908564] RSP: 0018:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 37.908566] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.908566] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.908567] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.908567] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.908568] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.908569] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.908569] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.908570] CR2: 000000c4201b6000 CR3: 000000037b656002 CR4: 00000000000606f0
[ 37.908570] Call Trace:
[ 37.908574] chksum_update+0x19/0x30
[ 37.908576] crc32c+0x55/0x90
[ 37.908585] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.908592] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.908600] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.908609] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.908616] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.908619] process_one_work+0x172/0x310
[ 37.908620] worker_thread+0x2b/0x380
[ 37.908621] ? process_one_work+0x310/0x310
[ 37.908622] kthread+0x10a/0x120
[ 37.908624] ? kthread_park+0x80/0x80
[ 37.908626] ret_from_fork+0x35/0x40
[ 37.908627] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.908659] ---[ end trace 5899dd5ae1cf16a4 ]---
[ 37.912575] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.912576] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.912577] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 37.912578] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.912578] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.912579] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.912579] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.912580] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.912580] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.912581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.912581] CR2: 000000c4201b6000 CR3: 000000037b656002 CR4: 00000000000606f0
[ 37.917388] general protection fault: 0000 [#12] SMP PTI
[ 37.917390] CPU: 0 PID: 4121 Comm: kworker/0:11H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 37.917390] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 37.917404] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 37.917408] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 37.917409] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 37.917410] RSP: 0018:ffffa4a8825e78e0 EFLAGS: 00010206
[ 37.917410] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 37.917411] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 37.917411] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 37.917412] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 37.917412] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 37.917413] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 37.917413] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 37.917414] CR2: 000000c4201b6000 CR3: 000000037b656002 CR4: 00000000000606f0
[ 37.917414] Call Trace:
[ 37.917418] chksum_update+0x19/0x30
[ 37.917419] crc32c+0x55/0x90
[ 37.917427] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 37.917435] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 37.917443] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 37.917451] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.917458] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 37.917460] process_one_work+0x172/0x310
[ 37.917462] worker_thread+0x2b/0x380
[ 37.917462] ? process_one_work+0x310/0x310
[ 37.917464] kthread+0x10a/0x120
[ 37.917465] ? kthread_park+0x80/0x80
[ 37.917469] ret_from_fork+0x35/0x40
[ 37.917470] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 37.917501] ---[ end trace 5899dd5ae1cf16a5 ]---
[ 37.921321] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 40.584686] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 40.584687] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 40.584688] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 40.584688] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 40.584689] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 40.584689] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 40.584690] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 40.584690] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 40.584691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 40.584691] CR2: 000000c4201b6000 CR3: 000000037b656002 CR4: 00000000000606f0
[ 40.601034] general protection fault: 0000 [#13] SMP PTI
[ 40.670530] CPU: 0 PID: 4123 Comm: kworker/0:12H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 40.670531] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 40.670547] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 40.696182] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 40.696183] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 40.696184] RSP: 0018:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 40.696185] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 40.696185] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 40.696186] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 40.696186] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 40.696187] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 40.696187] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 40.696188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 40.696189] CR2: 000056543a022130 CR3: 0000000365f68004 CR4: 00000000000606f0
[ 40.696189] Call Trace:
[ 40.696194] chksum_update+0x19/0x30
[ 40.787423] crc32c+0x55/0x90
[ 40.787436] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 40.787444] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 40.801363] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 40.801372] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 40.801380] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 40.816516] process_one_work+0x172/0x310
[ 40.816518] worker_thread+0x2b/0x380
[ 40.816519] ? process_one_work+0x310/0x310
[ 40.816520] kthread+0x10a/0x120
[ 40.816521] ? kthread_park+0x80/0x80
[ 40.816523] ret_from_fork+0x35/0x40
[ 40.816525] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 40.923351] ---[ end trace 5899dd5ae1cf16a6 ]---
[ 40.927375] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 40.934016] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 40.934017] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 40.934018] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 40.934018] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 40.934019] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 40.934019] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 40.934020] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 40.934021] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 40.934021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 40.934022] CR2: 000056543a022130 CR3: 0000000365f68004 CR4: 00000000000606f0
[ 40.934181] general protection fault: 0000 [#14] SMP PTI
[ 41.021183] CPU: 0 PID: 4132 Comm: kworker/0:13H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 41.021183] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 41.021198] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 41.021202] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 41.021203] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 41.021204] RSP: 0018:ffffa4a88205f8e0 EFLAGS: 00010206
[ 41.021205] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 41.021205] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 41.021205] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 41.021206] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 41.021206] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 41.021207] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 41.021207] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 41.021208] CR2: 000056543a022130 CR3: 000000034bbcc005 CR4: 00000000000606f0
[ 41.021208] Call Trace:
[ 41.021212] chksum_update+0x19/0x30
[ 41.021214] crc32c+0x55/0x90
[ 41.021224] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 41.021232] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 41.021240] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 41.021249] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 41.021256] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 41.021258] process_one_work+0x172/0x310
[ 41.021260] worker_thread+0x2b/0x380
[ 41.021260] ? process_one_work+0x310/0x310
[ 41.021262] kthread+0x10a/0x120
[ 41.021263] ? kthread_park+0x80/0x80
[ 41.021266] ret_from_fork+0x35/0x40
[ 41.021267] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 41.021353] ---[ end trace 5899dd5ae1cf16a7 ]---
[ 41.283441] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 41.288151] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 41.306897] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 41.312122] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 41.319252] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 41.326375] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 41.333501] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 41.340634] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 41.347771] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 41.355873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 41.355874] CR2: 000056543a022130 CR3: 000000034bbcc005 CR4: 00000000000606f0
[ 41.356014] general protection fault: 0000 [#15] SMP PTI
[ 41.374053] CPU: 0 PID: 4154 Comm: kworker/0:14H Tainted: G D T 5.1.8-00445-g044f42625f44 #1
[ 41.374054] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[ 41.374071] Workqueue: events_highpri __bch2_read_endio [bcachefs]
[ 41.399681] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 41.399682] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 41.399682] RSP: 0018:ffffa4a8992eb8e0 EFLAGS: 00010206
[ 41.399683] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 41.399683] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 41.399684] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 41.399684] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 41.399685] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 41.399685] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 41.399686] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 41.399686] CR2: 000056543a022130 CR3: 0000000365f68006 CR4: 00000000000606f0
[ 41.399687] Call Trace:
[ 41.399691] chksum_update+0x19/0x30
[ 41.399693] crc32c+0x55/0x90
[ 41.493905] bch2_checksum_update+0x55/0x60 [bcachefs]
[ 41.493915] __bch2_checksum_bio.isra.4+0x5b9/0x7e0 [bcachefs]
[ 41.504872] bch2_checksum_bio+0x74/0xa0 [bcachefs]
[ 41.504881] ? __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 41.514969] __bch2_read_endio+0x20b/0x740 [bcachefs]
[ 41.514972] process_one_work+0x172/0x310
[ 41.524026] worker_thread+0x2b/0x380
[ 41.524027] ? process_one_work+0x310/0x310
[ 41.524029] kthread+0x10a/0x120
[ 41.524030] ? kthread_park+0x80/0x80
[ 41.524033] ret_from_fork+0x35/0x40
[ 41.524034] Modules linked in: xt_nat xt_tcpudp veth ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul ast ttm crc32_pclmul iTCO_wdt iTCO_vendor_support crc32c_intel drm_kms_helper evdev ghash_clmulni_intel cryptd intel_cstate intel_uncore drm i2c_i801 intel_rapl_perf efi_pstore efivars drm_panel_orientation_quirks xhci_pci syscopyarea sysfillrect igb sysimgblt xhci_hcd fb_sys_fops mpt3sas lpc_ich ehci_pci mfd_core i2c_algo_bit ehci_hcd dca thermal fan raid_class usbcore acpi_pad button scsi_transport_sas mei_me usb_common efivarfs
[ 41.626823] ---[ end trace 5899dd5ae1cf16a8 ]---
[ 41.636431] RIP: 0010:__crc32c_le_base+0x88/0x160
[ 41.636433] Code: 4d 8d a0 00 10 00 00 49 8d a8 00 18 00 00 49 8d 98 00 14 00 00 4d 8d 98 00 0c 00 00 4d 8d 90 00 08 00 00 4d 8d 88 00 04 00 00 <33> 46 04 48 83 c6 08 8b 0e 89 c7 0f b6 d0 c1 ef 18 41 8b 54 95 00
[ 41.659880] RSP: 0000:ffffa4a8823978e0 EFLAGS: 00010206
[ 41.659881] RAX: 0000000000000000 RBX: ffffffffa4c35200 RCX: 0000000000000000
[ 41.659882] RDX: 0000000000001000 RSI: 0003ac5d3ffffffc RDI: 0000000000000000
[ 41.679353] RBP: ffffffffa4c35600 R08: ffffffffa4c33e00 R09: ffffffffa4c34200
[ 41.679353] R10: ffffffffa4c34600 R11: ffffffffa4c34a00 R12: ffffffffa4c34e00
[ 41.679354] R13: ffffffffa4c35a00 R14: 0003ac5d40000ffc R15: 0003ac5d3ffffffc
[ 41.679355] FS: 0000000000000000(0000) GS:ffff89414fa00000(0000) knlGS:0000000000000000
[ 41.679356] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 41.714546] CR2: 000056543a022130 CR3: 0000000365f68006 CR4: 00000000000606f0```
BUG: using smp_processor_id() in preemptible [00000000] code: mount/455
also sometimes the fs just stops responding and i have to use magic keys to manually reboot but as the whole system just freezes i cannot get any output
Background compression is busted
It will keep trying to compress uncompressable data over and over
kernel BUG at fs/bcachefs/buckets.c:1258
I've got a broken filesystem that was happily ticking along at commit 1f342977 but that seems to have been broken by 990250b2.
Trying to mount the filesystem reproducibly dies with this backtrace (the first time I got this backtrace it was not a mount with -o fix_errors, but subsequent mount attempts have required -o fix_errors to get past the initial fsck errors.
The filesystem in question is encrypted (as can be seen from the backtrace) and tiered across a SSD (foreground_target and promote_target) and 2 HDDs (background_target), and uses lz4 compression.
[ 242.671016] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508257-3508257 missing! (replaying 3508257-3508458), exiting
[ 242.672339] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): Unable to continue, halting
[ 242.675671] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): Error in recovery: cannot allocate memory (1)
[ 242.676988] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): filesystem contains errors: please report this to the developers
[ 259.561776] bcachefs: bch2_parse_mount_opts() Bad mount option verbose_recovery
[ 306.580426] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508257-3508257 missing! (replaying 3508257-3508458), fixing
[ 306.581883] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508262-3508262 missing! (replaying 3508257-3508458), fixing
[ 306.583338] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508267-3508267 missing! (replaying 3508257-3508458), fixing
[ 306.584820] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508272-3508272 missing! (replaying 3508257-3508458), fixing
[ 306.586256] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508277-3508277 missing! (replaying 3508257-3508458), fixing
[ 306.587687] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508282-3508282 missing! (replaying 3508257-3508458), fixing
[ 306.589148] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508287-3508287 missing! (replaying 3508257-3508458), fixing
[ 306.590576] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508292-3508292 missing! (replaying 3508257-3508458), fixing
[ 306.591995] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508297-3508297 missing! (replaying 3508257-3508458), fixing
[ 306.593409] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 3508302-3508302 missing! (replaying 3508257-3508458), fixing
[ 306.594816] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): Ratelimiting new instances of previous error
[ 320.226331] kernel BUG at fs/bcachefs/buckets.c:1258!
[ 320.227722] invalid opcode: 0000 [#1] SMP PTI
[ 320.229126] CPU: 0 PID: 417 Comm: exe Not tainted 5.0.0+bcachefs.git20190423.990250b2-1-generic #1-Ubuntu
[ 320.230549] Hardware name: System76 Oryx Pro/ Oryx Pro, BIOS 1.05.02dRSA2 02/20/2017
[ 320.231965] RIP: 0010:bch2_trans_mark_extent+0x3b4/0x440
[ 320.233369] Code: 8b 85 10 ff ff ff 48 8b 50 58 48 8b bd 10 ff ff ff 4a 8d 44 02 0b 4c 8d bf 60 01 00 00 48 89 47 58 4c 39 f8 0f 86 89 fe ff ff <0f> 0b 0f 0b 0f 0b 48 8b bd 4a ff ff ff 48 89 7a 08 89 c7 4c 8b 4c
[ 320.234826] RSP: 0018:ffffb387838fe7b0 EFLAGS: 00010202
[ 320.236294] RAX: ffffb387838fee88 RBX: 0000000000000000 RCX: ffffb387838fe7f2
[ 320.237742] RDX: ffffb387838fee7c RSI: ffffb387838fee84 RDI: ffffb387838fed20
[ 320.239265] RBP: ffffb387838fe8a8 R08: 0000000000000001 R09: 000000000000000e
[ 320.240719] R10: 0000000000000080 R11: 0000000000000020 R12: ffff9222a6c87a60
[ 320.242170] R13: ffffffffffffff80 R14: 0000000000000000 R15: ffffb387838fee80
[ 320.243607] FS: 00007f07029175c0(0000) GS:ffff9222e6800000(0000) knlGS:0000000000000000
[ 320.245047] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 320.246484] CR2: 0000560db2124000 CR3: 0000000895b24003 CR4: 00000000003606f0
[ 320.247921] Call Trace:
[ 320.249361] bch2_trans_mark_key+0x97/0xb0
[ 320.250813] bch2_trans_mark_update+0x1d2/0x370
[ 320.252268] do_btree_insert_at+0x3ed/0xd30
[ 320.253717] ? bch2_extent_trim_atomic+0x1e3/0x2d0
[ 320.255165] bch2_trans_commit+0x28d/0x8f0
[ 320.256616] bch2_btree_delete_range+0x1e9/0x296
[ 320.258074] ? chacha_stream_xor+0x176/0x1f0
[ 320.259525] ? crypto_stats_skcipher_encrypt+0xe/0x10
[ 320.260971] ? validate_bset.constprop.54+0x507/0xe20
[ 320.262424] bch2_inode_rm+0xb8/0x3b0
[ 320.263861] ? mempool_kfree+0xe/0x10
[ 320.265294] ? mempool_free+0x2f/0x90
[ 320.266720] ? bch2_btree_node_read_done+0xb4a/0xdf0
[ 320.268153] ? __switch_to_asm+0x40/0x70
[ 320.269580] ? __switch_to_asm+0x34/0x70
[ 320.271001] ? __switch_to_asm+0x40/0x70
[ 320.272418] ? __switch_to_asm+0x40/0x70
[ 320.273828] ? __switch_to_asm+0x34/0x70
[ 320.275236] ? __switch_to_asm+0x40/0x70
[ 320.276631] ? __switch_to_asm+0x34/0x70
[ 320.278019] ? __switch_to_asm+0x40/0x70
[ 320.279397] ? __switch_to_asm+0x34/0x70
[ 320.280770] ? __switch_to_asm+0x40/0x70
[ 320.282129] ? __switch_to_asm+0x34/0x70
[ 320.283480] ? __switch_to_asm+0x40/0x70
[ 320.284828] ? __switch_to_asm+0x34/0x70
[ 320.286167] ? __switch_to_asm+0x40/0x70
[ 320.287502] ? __switch_to_asm+0x34/0x70
[ 320.288835] ? __switch_to+0x123/0x4e0
[ 320.290166] ? __switch_to_asm+0x40/0x70
[ 320.291483] ? __switch_to_asm+0x34/0x70
[ 320.292795] ? __switch_to_asm+0x40/0x70
[ 320.294104] ? __schedule+0x2d8/0x840
[ 320.295405] ? schedule+0x2c/0x70
[ 320.296697] ? schedule_timeout+0x258/0x360
[ 320.297987] ? bch2_bkey_pick_read_device+0x7d/0x430
[ 320.299284] ? mempool_free_slab+0x17/0x20
[ 320.300607] ? mempool_free+0x2f/0x90
[ 320.301896] ? wake_up_bit+0x42/0x50
[ 320.303177] ? btree_node_read_work+0x11f/0x1f0
[ 320.304452] ? bch2_btree_node_read+0x2d1/0x360
[ 320.305728] ? bch2_btree_node_iter_init+0x22f/0x5c0
[ 320.306997] ? bch2_inode_unpack+0x300/0x7e0
[ 320.308261] check_inode+0x2cc/0x660
[ 320.309572] ? __bch2_bkey_cmp_left_packed+0x40/0xb0
[ 320.310829] ? __bch2_btree_iter_traverse+0x16b/0x6a0
[ 320.312081] ? apic_timer_interrupt+0xa/0x20
[ 320.313374] ? bch2_btree_iter_traverse+0x12/0x30
[ 320.314620] ? bch2_btree_iter_peek+0x111/0x270
[ 320.315863] bch2_fsck_walk_inodes_only+0x17e/0x198
[ 320.317103] ? load_balance+0x161/0xa40
[ 320.318347] ? __switch_to_asm+0x40/0x70
[ 320.319557] ? __switch_to_asm+0x34/0x70
[ 320.320733] ? __switch_to_asm+0x40/0x70
[ 320.321894] ? __switch_to_asm+0x40/0x70
[ 320.323038] ? __switch_to_asm+0x34/0x70
[ 320.324177] ? __switch_to_asm+0x40/0x70
[ 320.325319] ? __switch_to_asm+0x34/0x70
[ 320.326448] ? __switch_to_asm+0x40/0x70
[ 320.327576] ? __switch_to_asm+0x34/0x70
[ 320.328706] ? __switch_to_asm+0x40/0x70
[ 320.329830] ? __switch_to_asm+0x34/0x70
[ 320.330950] ? __switch_to_asm+0x40/0x70
[ 320.332066] ? __switch_to_asm+0x34/0x70
[ 320.333176] ? __switch_to_asm+0x40/0x70
[ 320.334273] ? __switch_to_asm+0x34/0x70
[ 320.335360] ? __switch_to_asm+0x40/0x70
[ 320.336436] ? __switch_to_asm+0x34/0x70
[ 320.337502] ? __switch_to_asm+0x40/0x70
[ 320.338561] ? __schedule+0x2d8/0x840
[ 320.339616] ? journal_flush_pins+0xf9/0x1a0
[ 320.340712] ? journal_flush_done+0x75/0xd0
[ 320.341780] ? __closure_wake_up+0x2e/0x40
[ 320.342838] ? bch2_journal_flush_pins+0xb7/0xe0
[ 320.343896] ? irq_cpu_rmap_notify.cold.6+0x1d/0x1d
[ 320.344958] bch2_fs_recovery+0xdcc/0xffb
[ 320.346014] bch2_fs_start+0x185/0x490
[ 320.347066] ? bch2_fs_start+0x185/0x490
[ 320.348120] bch2_fs_open+0x22c/0x290
[ 320.349171] bch2_mount+0x28c/0x680
[ 320.350221] mount_fs+0x51/0x165
[ 320.351271] vfs_kern_mount.part.38+0x5d/0x110
[ 320.352324] do_mount+0x22f/0xd50
[ 320.353373] ksys_mount+0xb6/0xd0
[ 320.354416] __x64_sys_mount+0x25/0x30
[ 320.355443] do_syscall_64+0x5a/0x110
[ 320.356462] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 320.357485] RIP: 0033:0x7f070284963a
[ 320.358504] Code: 48 8b 0d 59 58 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 26 58 0c 00 f7 d8 64 89 01 48
[ 320.359562] RSP: 002b:00007ffdd07461a8 EFLAGS: 00000206 ORIG_RAX: 00000000000000a5
[ 320.360612] RAX: ffffffffffffffda RBX: 0000000000008000 RCX: 00007f070284963a
[ 320.361655] RDX: 00007ffdd0747d8a RSI: 00007ffdd0747db4 RDI: 00007ffdd0747d93
[ 320.362694] RBP: 00007f0702917540 R08: 0000560db21232a0 R09: 0073726f7272655f
[ 320.363735] R10: 0000000000008000 R11: 0000000000000206 R12: 0000560db21232a0
[ 320.364770] R13: 0000000000000000 R14: 00007ffdd0746418 R15: 0000000000000000
[ 320.365797] Modules linked in: netconsole rtsx_pci_sdmmc psmouse nvme r8169 nvme_core rtsx_pci realtek ahci libahci i2c_i801 wmi video
[ 320.366855] ---[ end trace b5e27897ebc93a9e ]---
[ 320.367923] RIP: 0010:bch2_trans_mark_extent+0x3b4/0x440
[ 320.368961] Code: 8b 85 10 ff ff ff 48 8b 50 58 48 8b bd 10 ff ff ff 4a 8d 44 02 0b 4c 8d bf 60 01 00 00 48 89 47 58 4c 39 f8 0f 86 89 fe ff ff <0f> 0b 0f 0b 0f 0b 48 8b bd 4a ff ff ff 48 89 7a 08 89 c7 4c 8b 4c
[ 320.370080] RSP: 0018:ffffb387838fe7b0 EFLAGS: 00010202
[ 320.371159] RAX: ffffb387838fee88 RBX: 0000000000000000 RCX: ffffb387838fe7f2
[ 320.372244] RDX: ffffb387838fee7c RSI: ffffb387838fee84 RDI: ffffb387838fed20
[ 320.373332] RBP: ffffb387838fe8a8 R08: 0000000000000001 R09: 000000000000000e
[ 320.374443] R10: 0000000000000080 R11: 0000000000000020 R12: ffff9222a6c87a60
[ 320.375522] R13: ffffffffffffff80 R14: 0000000000000000 R15: ffffb387838fee80
[ 320.376595] FS: 00007f07029175c0(0000) GS:ffff9222e6800000(0000) knlGS:0000000000000000
[ 320.377708] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 320.378779] CR2: 0000560db2124000 CR3: 0000000895b24003 CR4: 00000000003606f0
tools: compile failure, BCH_FS_FSCK_[UN]FIXED_ERRORS undeclared
Compiling the tools from commit 354a0aaf3099bbfb4be80307b35c98c10f59cceee fails:
gcc -std=gnu89 -O2 -g -MMD -Wall -Wno-pointer-sign -fno-strict-aliasing -I. -Iinclude -Iraid -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_LGPL_SOURCE -DRCU_MEMBARRIER -DZSTD_STATIC_LINKING_ONLY -DNO_BCACHEFS_CHARDEV -DNO_BCACHEFS_FS -DNO_BCACHEFS_SYSFS -DVERSION_STRING='"v0.1-nogit"' -Wno-unused-but-set-variable -I/nix/store/c1h8zyk4j7h38y15y7n96kx2y4q0p6j2-util-linux-2.33.1-dev/include/blkid -I/nix/store/c1h8zyk4j7h38y15y7n96kx2y4q0p6j2-util-linux-2.33.1-dev/include/uuid -I/nix/store/apgyqj2sj1dv3kzp1v4mdziq669wwwd7-libsodium-1.0.16-dev/include -I/nix/store/awv1zn1vrr7y34n2raml3i86m84jhqdf-liburcu-0.10.2/include -I/nix/store/ww7601vx7qrcwwfnwzs1cwwx6zcqdjz3-zlib-1.2.11-dev/include -I/nix/store/c3pf2yw9l7vv8vpa7sh5v8h5wy8x8d2y-zstd-1.3.8/include -I/nix/store/mpvmp2ryawzm5b8p4izy02zv75djqpns-lz4-1.8.3-dev/include -c -o cmd_run.o cmd_run.c
cmd_fsck.c: In function 'cmd_fsck':
cmd_fsck.c:68:15: error: 'BCH_FS_FSCK_FIXED_ERRORS' undeclared (first use in this function); did you mean 'BCH_FS_FIXED_GENS'?
if (test_bit(BCH_FS_FSCK_FIXED_ERRORS, &c->flags))
^~~~~~~~~~~~~~~~~~~~~~~~
BCH_FS_FIXED_GENS
cmd_fsck.c:68:15: note: each undeclared identifier is reported only once for each function it appears in
cmd_fsck.c:70:15: error: 'BCH_FS_FSCK_UNFIXED_ERRORS' undeclared (first use in this function); did you mean 'BCH_FS_FSCK_FIXED_ERRORS'?
if (test_bit(BCH_FS_FSCK_UNFIXED_ERRORS, &c->flags))
^~~~~~~~~~~~~~~~~~~~~~~~~~
BCH_FS_FSCK_FIXED_ERRORS
make: *** [<builtin>: cmd_fsck.o] Error 1
kernel BUG at fs/bcachefs/buckets.c:1258!
I'm not sure if this is a duplicate of #36, but I'm still seeing this with a kernel at commit 0b1aaaf3, which contains e3ddc90. Is this expected to have caused on-disc structures to corrupt, or am I hitting a different problem?
Annoyingly, I seem to have crossed a filesystem feature compatibility threshold; my older kernel refuses to attempt to mount the fs with โincompatible features detectedโ.
[ 83.649982] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal read done, 106779 keys in 23 entries, seq 4491807
[ 83.760522] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 4491786-4491786 missing! (replaying 4491780-4491807), fixing
[ 83.761823] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 4491791-4491791 missing! (replaying 4491780-4491807), fixing
[ 83.763090] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 4491796-4491796 missing! (replaying 4491780-4491807), fixing
[ 83.764362] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 4491801-4491801 missing! (replaying 4491780-4491807), fixing
[ 83.765652] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal entries 4491806-4491806 missing! (replaying 4491780-4491807), fixing
[ 83.772633] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): starting alloc read
[ 86.802997] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): alloc read done
[ 86.802998] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): starting stripes_read
[ 86.803195] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): stripes_read done
[ 86.803195] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): starting mark and sweep
[ 95.524898] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): mark and sweep done
[ 95.524899] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): starting journal replay
[ 96.800329] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): journal replay done
[ 96.800330] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): writing allocation info
[ 97.495182] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): alloc write done
[ 97.495183] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): checking for deleted inodes
[ 97.516035] bcachefs (d50f806d-78a0-40dd-9ae1-33c21762c56e): deleting inode 1085447
[ 97.516055] ------------[ cut here ]------------
[ 97.516055] kernel BUG at fs/bcachefs/buckets.c:1258!
[ 97.517332] invalid opcode: 0000 [#1] SMP PTI
[ 97.518567] CPU: 6 PID: 350 Comm: exe Not tainted 5.0.0+bcachefs.git20190508.0b1aaaf3-1-generic #1-Ubuntu
[ 97.519815] Hardware name: System76 Oryx Pro/ Oryx Pro, BIOS 1.05.02dRSA2 02/20/2017
[ 97.521112] RIP: 0010:bch2_trans_mark_extent+0x3b4/0x440
[ 97.522370] Code: 8b 85 10 ff ff ff 48 8b 50 58 48 8b bd 10 ff ff ff 4a 8d 44 02 0b 4c 8d bf 60 01 00 00 48 89 47 58 4c 39 f8 0f 86 89 fe ff ff <0f> 0b 0f 0b 0f 0b 48 8b bd 4a ff ff ff 48 89 7a 08 89 c7 4c 8b 4c
[ 97.523676] RSP: 0018:ffffa86503896798 EFLAGS: 00010202
[ 97.525031] RAX: ffffa86503896e78 RBX: 0000000000000000 RCX: ffffa865038967da
[ 97.526562] RDX: ffffa86503896e6c RSI: ffffa86503896e74 RDI: ffffa86503896d10
[ 97.527963] RBP: ffffa86503896890 R08: 0000000000000001 R09: 0000000000000005
[ 97.529346] R10: 0000000000000008 R11: 0000000000000020 R12: ffff9181d8d80b20
[ 97.530731] R13: fffffffffffffff8 R14: 0000000000000000 R15: ffffa86503896e70
[ 97.532122] FS: 00007efff85d85c0(0000) GS:ffff918262180000(0000) knlGS:0000000000000000
[ 97.533518] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 97.534915] CR2: 0000562ab212c000 CR3: 0000000893c56003 CR4: 00000000003606e0
[ 97.536334] Call Trace:
[ 97.537779] ? bch2_btree_iter_relock.part.26+0x273/0x3c0
[ 97.539213] bch2_trans_mark_key+0x97/0xb0
[ 97.540654] bch2_trans_mark_update+0x1d2/0x370
[ 97.542074] do_btree_insert_at+0x3ed/0xd40
[ 97.543515] ? bch2_extent_trim_atomic+0x1e3/0x2d0
[ 97.544954] bch2_trans_commit+0x27c/0x960
[ 97.546389] bch2_btree_delete_range+0x1e9/0x296
[ 97.547830] ? bch2_btree_delete_range+0x4d/0x296
[ 97.549267] ? chacha_stream_xor+0x176/0x1f0
[ 97.550689] ? __update_load_avg_cfs_rq+0x1b5/0x230
[ 97.552119] ? update_load_avg+0x8b/0x590
[ 97.553551] ? update_curr+0xf2/0x1e0
[ 97.554968] ? sched_clock+0x9/0x10
[ 97.556399] ? check_preempt_wakeup+0x1a0/0x250
[ 97.557830] bch2_inode_rm+0xb8/0x3b0
[ 97.559246] ? bch2_replicas_entry_idx+0x8a/0xb0
[ 97.560663] ? bch2_mark_extent+0x924/0x9e0
[ 97.562078] ? syscall_return_via_sysret+0x10/0x7f
[ 97.563501] ? __switch_to_asm+0x34/0x70
[ 97.564906] ? bch2_btree_node_iter_sort+0x177/0x200
[ 97.566314] ? __switch_to_asm+0x34/0x70
[ 97.567698] ? __switch_to_asm+0x40/0x70
[ 97.569084] ? __bch2_bkey_cmp_left_packed+0x40/0xb0
[ 97.570473] ? bch2_btree_node_iter_push+0x70/0x80
[ 97.571863] ? __bch2_btree_node_iter_fix.isra.23+0x16f/0x670
[ 97.573249] ? bch2_bset_fix_lookup_table+0x104/0x3c0
[ 97.574636] ? bch2_btree_node_iter_init+0x22f/0x5c0
[ 97.576068] ? bch2_btree_node_iter_sort+0x177/0x200
[ 97.577464] ? put_dec+0x18/0xa0
[ 97.578843] ? number+0x31f/0x360
[ 97.580229] ? sched_clock+0x9/0x10
[ 97.581651] ? sched_clock_cpu+0x11/0xc0
[ 97.583045] ? log_store+0x1ff/0x280
[ 97.584446] ? up+0x32/0x50
[ 97.585827] ? down_trylock+0x2e/0x40
[ 97.587229] ? vprintk_emit+0x211/0x270
[ 97.588641] ? vprintk_default+0x29/0x50
[ 97.590014] ? vprintk_func+0x47/0xbc
[ 97.591373] ? printk+0x58/0x6f
[ 97.592760] check_inode+0x2cc/0x660
[ 97.594120] ? __bch2_bkey_cmp_left_packed+0x40/0xb0
[ 97.595476] ? __bch2_btree_iter_traverse+0x16b/0x6a0
[ 97.596869] ? apic_timer_interrupt+0xa/0x20
[ 97.598264] ? apic_timer_interrupt+0xa/0x20
[ 97.599614] ? bch2_btree_iter_traverse+0x12/0x30
[ 97.601014] ? bch2_btree_iter_peek+0x111/0x270
[ 97.602350] bch2_fsck_walk_inodes_only+0x17e/0x198
[ 97.603693] ? bch2_fsck_walk_inodes_only+0x33/0x198
[ 97.605068] ? check_preempt_curr+0x68/0x90
[ 97.606399] ? attach_task+0x47/0x50
[ 97.607718] ? __switch_to_asm+0x40/0x70
[ 97.609074] ? __switch_to_asm+0x34/0x70
[ 97.610393] ? __switch_to_asm+0x40/0x70
[ 97.611701] ? __switch_to_asm+0x40/0x70
[ 97.613040] ? __switch_to_asm+0x34/0x70
[ 97.614334] ? __switch_to_asm+0x40/0x70
[ 97.615626] ? __switch_to_asm+0x34/0x70
[ 97.616927] ? __switch_to_asm+0x40/0x70
[ 97.618190] ? __switch_to_asm+0x34/0x70
[ 97.619452] ? sched_clock+0x9/0x10
[ 97.620740] ? sched_clock_cpu+0x11/0xc0
[ 97.621989] ? log_store+0x1ff/0x280
[ 97.623231] ? up+0x32/0x50
[ 97.624507] ? down_trylock+0x2e/0x40
[ 97.625754] ? vprintk_emit+0x211/0x270
[ 97.626984] ? vprintk_default+0x29/0x50
[ 97.628213] ? vprintk_func+0x47/0xbc
[ 97.629472] ? printk+0x58/0x6f
[ 97.630695] bch2_fs_recovery+0xdcc/0xffb
[ 97.631914] bch2_fs_start+0x185/0x490
[ 97.633175] ? bch2_fs_start+0x185/0x490
[ 97.634377] bch2_fs_open+0x22c/0x290
[ 97.635593] bch2_mount+0x28c/0x680
[ 97.636835] mount_fs+0x51/0x165
[ 97.638045] vfs_kern_mount.part.38+0x5d/0x110
[ 97.639254] do_mount+0x22f/0xd50
[ 97.640482] ksys_mount+0xb6/0xd0
[ 97.641685] __x64_sys_mount+0x25/0x30
[ 97.642872] do_syscall_64+0x5a/0x110
[ 97.644062] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 97.645285] RIP: 0033:0x7efff850a63a
[ 97.646468] Code: 48 8b 0d 59 58 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 26 58 0c 00 f7 d8 64 89 01 48
[ 97.647700] RSP: 002b:00007ffcb5fdc498 EFLAGS: 00000206 ORIG_RAX: 00000000000000a5
[ 97.648962] RAX: ffffffffffffffda RBX: 0000000000008000 RCX: 00007efff850a63a
[ 97.650201] RDX: 00007ffcb5fddda3 RSI: 00007ffcb5fddde3 RDI: 00007ffcb5fdddc2
[ 97.651430] RBP: 00007efff85d8540 R08: 0000562ab212b2a0 R09: 0073726f7272655f
[ 97.652712] R10: 0000000000008000 R11: 0000000000000206 R12: 0000562ab212b2a0
[ 97.653942] R13: 0000000000000000 R14: 00007ffcb5fdc708 R15: 0000000000000000
[ 97.655192] Modules linked in: uas usb_storage rtsx_pci_sdmmc psmouse nvme r8169 i2c_i801 nvme_core ahci rtsx_pci realtek libahci wmi video
[ 97.656498] ---[ end trace 5b2b52db0f6b29b3 ]---
[ 97.657768] RIP: 0010:bch2_trans_mark_extent+0x3b4/0x440
[ 97.659003] Code: 8b 85 10 ff ff ff 48 8b 50 58 48 8b bd 10 ff ff ff 4a 8d 44 02 0b 4c 8d bf 60 01 00 00 48 89 47 58 4c 39 f8 0f 86 89 fe ff ff <0f> 0b 0f 0b 0f 0b 48 8b bd 4a ff ff ff 48 89 7a 08 89 c7 4c 8b 4c
[ 97.660271] RSP: 0018:ffffa86503896798 EFLAGS: 00010202
[ 97.661545] RAX: ffffa86503896e78 RBX: 0000000000000000 RCX: ffffa865038967da
[ 97.662785] RDX: ffffa86503896e6c RSI: ffffa86503896e74 RDI: ffffa86503896d10
[ 97.664016] RBP: ffffa86503896890 R08: 0000000000000001 R09: 0000000000000005
[ 97.665293] R10: 0000000000000008 R11: 0000000000000020 R12: ffff9181d8d80b20
[ 97.666522] R13: fffffffffffffff8 R14: 0000000000000000 R15: ffffa86503896e70
[ 97.667744] FS: 00007efff85d85c0(0000) GS:ffff918262180000(0000) knlGS:0000000000000000
[ 97.669016] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 97.670249] CR2: 0000562ab212c000 CR3: 0000000893c56003 CR4: 00000000003606e0
kernel bug at ../fs/bcachefs/buckets.c:651
Mounting fails with this output, filesystem attempted to mount and created with commit 97d1478 and this format command: bcachefs format --compression=lz4 --background_compression=zstd --foreground_target=/dev/sda1 --background_target=/dev/sdb2 --promote_target=/dev/sda1 --encrypted --label=nixos --force /dev/sdb2 /dev/sda1.
Metadata dump:
https://drive.google.com/open?id=1PTTCTXyc0hWdSojfAxSZY5MDxrsJ7q0i
https://drive.google.com/open?id=1t-I-89sbrejTGOFIlTFLXvL2z2U0YTS5
bucket sector count overflow
mount: /mnt: cannot mount /dev/sda1:/dev/sdb2 read-only.
Using commit d541578, formatted using bcachefs-tools on commit 692eadd6ca9b45f12971126b326b6a89d7117e67 with command bcachefs format --compression=lz4 --background_compression=zstd --foreground_target=/dev/sda1 --background_target=/dev/sdb2 --promote_target=/dev/sda1 --encrypted --label=nixos --force /dev/sdb2 /dev/sda1.
Occurred after normal shutdown. Every mount attempt appears to generate about ~50000 journal keys in ~15 entries, one of which the journal spew of is below:
Aug 02 19:50:09 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): journal read done, 263923 keys in 127 entries, seq 284454
Aug 02 19:50:10 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): starting metadata mark and sweep
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): emergency read only
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 2 > U16_MAX
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): journal replay: error -30 while replaying key
Aug 02 19:50:11 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): Error in recovery: journal replay failed (-30)
Aug 02 19:50:20 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): journal read done, 289411 keys in 135 entries, seq 284466
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): starting metadata mark and sweep
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): emergency read only
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + -24 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 23 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): bucket sector count overflow: 65535 + 2 > U16_MAX
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): journal replay: error -30 while replaying key
Aug 02 19:50:21 nixos kernel: bcachefs (3b4f34c0-b807-4ccc-9354-b87199050f94): Error in recovery: journal replay failed (-30)
6 ptr gen in the future: 3 > 2
bcachefs fsck fixed it, but it says 'please report this to the developers' so here I am.
mount -t bcachefs /dev/sda1:/dev/sdb2 /mnt from a filesystem created with bcachefs format --compression=lz4 --background_compression=zstd --foreground_target=/dev/sda1 --background_target=/dev/sdb2 --promote_target=/dev/sda1 --encrypted --label=nixos --force /dev/sdb2 /dev/sda1 with commit koverstreet/bcachefs-tools@ed0993c
after an ordinary reboot fails and yields this in the journal:
Mar 13 04:50:20 nixos kernel: bcachefs (8d863c45-eaed-4b3f-b209-3c06fe786add): journal read done, 138782 keys in 16371 entries, seq 392348
Mar 13 04:50:21 nixos kernel: bcachefs (8d863c45-eaed-4b3f-b209-3c06fe786add): 6 ptr gen in the future: 3 > 2, exiting
Mar 13 04:50:21 nixos kernel: bcachefs (8d863c45-eaed-4b3f-b209-3c06fe786add): Unable to continue, halting
Mar 13 04:50:21 nixos kernel: bcachefs: bch2_fs_recovery() Error in recovery: error in recovery (1)
Mar 13 04:50:21 nixos kernel: bcachefs (8d863c45-eaed-4b3f-b209-3c06fe786add): filesystem contains errors: please report this to the developers
Mar 13 04:50:21 nixos kernel: mount with -o fix_errors to repair
Mar 13 04:50:21 nixos kernel: bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sda1: fsck error
fsck output:
journal read done, 138782 keys in 16371 entries, seq 392348
error validating btree node at btree 0 level 0/1
pos 529007:8 node offset 0 bset u64s 21582: invalid checksum
6 ptr gen in the future: 3 > 2: fix? (y,n) y
6 ptr gen in the future: 3 > 2: fix? (y,n) y
6 ptr gen in the future: 3 > 2: fix? (y,n) y
6 ptr gen in the future: 3 > 2: fix? (y,n) y
6 ptr gen in the future: 3 > 2: fix? (y,n) y
6 ptr gen in the future: 3 > 2: fix? (y,n) y
6 ptr gen in the future: 3 > 2: fix? (y,n) y
Fixed gens, restarting mark and sweep:
fsck error after system reset
My system froze up, as a reaction to which I reset it.
When booting back up, bcachefs greeted me with
unreachable directory found (inum 2879383), exiting
Unable to continue, halting
bch2_fs_recovery() Error in recovery: error in fsck (1)
filesystem contains errors: please report this to the developers
bch2_fs_open() bch_fs_open err opening /dev/disk/by-partlabel/nixos-fast: fsck error
when trying to mount after unlocking. nixos-fast is the partition on the fast foreground-target and promote-target device.
I have refrained from mounting with fix-errors, since when I had this problem in the past and did so it would lead to a completely empty file system.
Here and here are the metadata dump files produced by the bcachefs-tools.
module oops when adding a device
When I do
sudo mkdir -p /mnt/pool
sudo bcachefs format /dev/sdb
sudo mount -t bcachefs /dev/sdb /mnt/pool
sudo bcachefs format /dev/sdc
sudo bcachefs device add /mnt/pool /dev/sdc
the last command hangs and dmesg reports some bugs and a kernel oops in bch2_dev_add.
[ 231.839504] BUG: using smp_processor_id() in preemptible [00000000] code: bcachefs/468
[ 231.839797] caller is bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.839811] CPU: 1 PID: 468 Comm: bcachefs Not tainted 4.16.11-ARCH-bcachefs+ #6
[ 231.839814] Hardware name: ASUSTeK Computer INC. 1005PE/1005P, BIOS 1202 06/23/2010
[ 231.839818] Call Trace:
[ 231.839840] dump_stack+0x5c/0x85
[ 231.839853] check_preemption_disabled+0xde/0xe0
[ 231.839904] bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.839917] ? pcpu_chunk_relocate+0xa0/0xc0
[ 231.839967] bch2_mark_metadata_bucket+0x165/0x2c0 [bcachefs]
[ 231.840014] mark_metadata_sectors.constprop.0+0xa6/0xc0 [bcachefs]
[ 231.840065] bch2_mark_dev_superblock+0xce/0x240 [bcachefs]
[ 231.840116] __bch2_dev_attach_bdev+0x134/0x180 [bcachefs]
[ 231.840168] bch2_dev_add+0x19b/0x460 [bcachefs]
[ 231.840181] ? pagevec_lookup_range_tag+0x24/0x30
[ 231.840236] ? bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.840282] bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.840293] ? generic_writepages+0x70/0xa0
[ 231.840306] ? preempt_count_add+0x92/0xa0
[ 231.840314] ? _raw_spin_lock+0x13/0x40
[ 231.840321] ? preempt_count_add+0x92/0xa0
[ 231.840329] ? _raw_spin_lock+0x13/0x40
[ 231.840338] ? locked_inode_to_wb_and_lock_list+0x74/0x180
[ 231.840347] ? _raw_spin_unlock+0x16/0x30
[ 231.840354] ? writeback_single_inode+0x54/0x130
[ 231.840363] ? write_inode_now+0x8a/0xc0
[ 231.840371] ? security_capable+0x41/0x60
[ 231.840421] bch2_fs_file_ioctl+0x75/0x580 [bcachefs]
[ 231.840433] ? __blkdev_put+0x19f/0x1e0
[ 231.840445] do_vfs_ioctl+0x9f/0x610
[ 231.840455] ? __fput+0x12e/0x1e0
[ 231.840464] ? preempt_count_add+0x92/0xa0
[ 231.840472] ? _raw_spin_lock_irq+0x1a/0x40
[ 231.840482] SyS_ioctl+0x74/0x80
[ 231.840491] ? __close_fd+0x88/0xa0
[ 231.840501] do_syscall_64+0x6e/0x190
[ 231.840512] entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 231.840520] RIP: 0033:0x7f4c9c003667
[ 231.840525] RSP: 002b:00007ffc63cddda8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 231.840533] RAX: ffffffffffffffda RBX: 00007ffc63cdeefc RCX: 00007f4c9c003667
[ 231.840537] RDX: 00007ffc63cdddb0 RSI: 000000004010bc04 RDI: 0000000000000003
[ 231.840541] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000320
[ 231.840545] R10: 0000000000011000 R11: 0000000000000246 R12: 00007ffc63cdeef2
[ 231.840549] R13: 000055d0ecd20ee0 R14: 0000000000000000 R15: 00007ffc63cdddd0
[ 231.840707] BUG: using smp_processor_id() in preemptible [00000000] code: bcachefs/468
[ 231.840948] caller is bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.840956] CPU: 1 PID: 468 Comm: bcachefs Not tainted 4.16.11-ARCH-bcachefs+ #6
[ 231.840960] Hardware name: ASUSTeK Computer INC. 1005PE/1005P, BIOS 1202 06/23/2010
[ 231.840963] Call Trace:
[ 231.840979] dump_stack+0x5c/0x85
[ 231.840991] check_preemption_disabled+0xde/0xe0
[ 231.841038] bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.841050] ? pcpu_chunk_relocate+0xa0/0xc0
[ 231.841099] bch2_mark_metadata_bucket+0x165/0x2c0 [bcachefs]
[ 231.841148] mark_metadata_sectors.constprop.0+0xa6/0xc0 [bcachefs]
[ 231.841198] bch2_mark_dev_superblock+0x97/0x240 [bcachefs]
[ 231.841250] __bch2_dev_attach_bdev+0x134/0x180 [bcachefs]
[ 231.841300] bch2_dev_add+0x19b/0x460 [bcachefs]
[ 231.841310] ? pagevec_lookup_range_tag+0x24/0x30
[ 231.841365] ? bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.841411] bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.841421] ? generic_writepages+0x70/0xa0
[ 231.841433] ? preempt_count_add+0x92/0xa0
[ 231.841441] ? _raw_spin_lock+0x13/0x40
[ 231.841448] ? preempt_count_add+0x92/0xa0
[ 231.841456] ? _raw_spin_lock+0x13/0x40
[ 231.841464] ? locked_inode_to_wb_and_lock_list+0x74/0x180
[ 231.841473] ? _raw_spin_unlock+0x16/0x30
[ 231.841480] ? writeback_single_inode+0x54/0x130
[ 231.841489] ? write_inode_now+0x8a/0xc0
[ 231.841498] ? security_capable+0x41/0x60
[ 231.841548] bch2_fs_file_ioctl+0x75/0x580 [bcachefs]
[ 231.841559] ? __blkdev_put+0x19f/0x1e0
[ 231.841571] do_vfs_ioctl+0x9f/0x610
[ 231.841579] ? __fput+0x12e/0x1e0
[ 231.841587] ? preempt_count_add+0x92/0xa0
[ 231.841594] ? _raw_spin_lock_irq+0x1a/0x40
[ 231.841603] SyS_ioctl+0x74/0x80
[ 231.841612] ? __close_fd+0x88/0xa0
[ 231.841622] do_syscall_64+0x6e/0x190
[ 231.841633] entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 231.841643] RIP: 0033:0x7f4c9c003667
[ 231.841647] RSP: 002b:00007ffc63cddda8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 231.841654] RAX: ffffffffffffffda RBX: 00007ffc63cdeefc RCX: 00007f4c9c003667
[ 231.841658] RDX: 00007ffc63cdddb0 RSI: 000000004010bc04 RDI: 0000000000000003
[ 231.841661] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000320
[ 231.841665] R10: 0000000000011000 R11: 0000000000000246 R12: 00007ffc63cdeef2
[ 231.841669] R13: 000055d0ecd20ee0 R14: 0000000000000000 R15: 00007ffc63cdddd0
[ 231.841715] BUG: using smp_processor_id() in preemptible [00000000] code: bcachefs/468
[ 231.841950] caller is bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.841957] CPU: 1 PID: 468 Comm: bcachefs Not tainted 4.16.11-ARCH-bcachefs+ #6
[ 231.841960] Hardware name: ASUSTeK Computer INC. 1005PE/1005P, BIOS 1202 06/23/2010
[ 231.841963] Call Trace:
[ 231.841976] dump_stack+0x5c/0x85
[ 231.841987] check_preemption_disabled+0xde/0xe0
[ 231.842035] bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.842045] ? pcpu_chunk_relocate+0xa0/0xc0
[ 231.842094] bch2_mark_metadata_bucket+0x165/0x2c0 [bcachefs]
[ 231.842142] mark_metadata_sectors.constprop.0+0xa6/0xc0 [bcachefs]
[ 231.842193] bch2_mark_dev_superblock+0x97/0x240 [bcachefs]
[ 231.842245] __bch2_dev_attach_bdev+0x134/0x180 [bcachefs]
[ 231.842295] bch2_dev_add+0x19b/0x460 [bcachefs]
[ 231.842304] ? pagevec_lookup_range_tag+0x24/0x30
[ 231.842358] ? bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.842404] bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.842413] ? generic_writepages+0x70/0xa0
[ 231.842424] ? preempt_count_add+0x92/0xa0
[ 231.842431] ? _raw_spin_lock+0x13/0x40
[ 231.842437] ? preempt_count_add+0x92/0xa0
[ 231.842444] ? _raw_spin_lock+0x13/0x40
[ 231.842451] ? locked_inode_to_wb_and_lock_list+0x74/0x180
[ 231.842459] ? _raw_spin_unlock+0x16/0x30
[ 231.842464] ? writeback_single_inode+0x54/0x130
[ 231.842471] ? write_inode_now+0x8a/0xc0
[ 231.842479] ? security_capable+0x41/0x60
[ 231.842528] bch2_fs_file_ioctl+0x75/0x580 [bcachefs]
[ 231.842539] ? __blkdev_put+0x19f/0x1e0
[ 231.842549] do_vfs_ioctl+0x9f/0x610
[ 231.842557] ? __fput+0x12e/0x1e0
[ 231.842564] ? preempt_count_add+0x92/0xa0
[ 231.842571] ? _raw_spin_lock_irq+0x1a/0x40
[ 231.842580] SyS_ioctl+0x74/0x80
[ 231.842587] ? __close_fd+0x88/0xa0
[ 231.842596] do_syscall_64+0x6e/0x190
[ 231.842605] entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 231.842611] RIP: 0033:0x7f4c9c003667
[ 231.842615] RSP: 002b:00007ffc63cddda8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 231.842621] RAX: ffffffffffffffda RBX: 00007ffc63cdeefc RCX: 00007f4c9c003667
[ 231.842625] RDX: 00007ffc63cdddb0 RSI: 000000004010bc04 RDI: 0000000000000003
[ 231.842628] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000320
[ 231.842632] R10: 0000000000011000 R11: 0000000000000246 R12: 00007ffc63cdeef2
[ 231.842636] R13: 000055d0ecd20ee0 R14: 0000000000000000 R15: 00007ffc63cdddd0
[ 231.842649] BUG: using smp_processor_id() in preemptible [00000000] code: bcachefs/468
[ 231.842905] caller is bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.842912] CPU: 1 PID: 468 Comm: bcachefs Not tainted 4.16.11-ARCH-bcachefs+ #6
[ 231.842915] Hardware name: ASUSTeK Computer INC. 1005PE/1005P, BIOS 1202 06/23/2010
[ 231.842917] Call Trace:
[ 231.842929] dump_stack+0x5c/0x85
[ 231.842939] check_preemption_disabled+0xde/0xe0
[ 231.842986] bch2_dev_usage_update+0xa9/0x2b0 [bcachefs]
[ 231.842995] ? pcpu_chunk_relocate+0xa0/0xc0
[ 231.843044] bch2_mark_metadata_bucket+0x165/0x2c0 [bcachefs]
[ 231.843091] mark_metadata_sectors.constprop.0+0xa6/0xc0 [bcachefs]
[ 231.843141] bch2_mark_dev_superblock+0x97/0x240 [bcachefs]
[ 231.843192] __bch2_dev_attach_bdev+0x134/0x180 [bcachefs]
[ 231.843241] bch2_dev_add+0x19b/0x460 [bcachefs]
[ 231.843249] ? pagevec_lookup_range_tag+0x24/0x30
[ 231.843303] ? bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.843347] bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.843357] ? generic_writepages+0x70/0xa0
[ 231.843368] ? preempt_count_add+0x92/0xa0
[ 231.843375] ? _raw_spin_lock+0x13/0x40
[ 231.843381] ? preempt_count_add+0x92/0xa0
[ 231.843388] ? _raw_spin_lock+0x13/0x40
[ 231.843397] ? locked_inode_to_wb_and_lock_list+0x74/0x180
[ 231.843405] ? _raw_spin_unlock+0x16/0x30
[ 231.843410] ? writeback_single_inode+0x54/0x130
[ 231.843418] ? write_inode_now+0x8a/0xc0
[ 231.843425] ? security_capable+0x41/0x60
[ 231.843477] bch2_fs_file_ioctl+0x75/0x580 [bcachefs]
[ 231.843491] ? __blkdev_put+0x19f/0x1e0
[ 231.843502] do_vfs_ioctl+0x9f/0x610
[ 231.843510] ? __fput+0x12e/0x1e0
[ 231.843518] ? preempt_count_add+0x92/0xa0
[ 231.843526] ? _raw_spin_lock_irq+0x1a/0x40
[ 231.843536] SyS_ioctl+0x74/0x80
[ 231.843543] ? __close_fd+0x88/0xa0
[ 231.843553] do_syscall_64+0x6e/0x190
[ 231.843568] entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 231.843577] RIP: 0033:0x7f4c9c003667
[ 231.843580] RSP: 002b:00007ffc63cddda8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 231.843587] RAX: ffffffffffffffda RBX: 00007ffc63cdeefc RCX: 00007f4c9c003667
[ 231.843591] RDX: 00007ffc63cdddb0 RSI: 000000004010bc04 RDI: 0000000000000003
[ 231.843594] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000320
[ 231.843598] R10: 0000000000011000 R11: 0000000000000246 R12: 00007ffc63cdeef2
[ 231.843601] R13: 000055d0ecd20ee0 R14: 0000000000000000 R15: 00007ffc63cdddd0
[ 231.845630] BUG: unable to handle kernel paging request at 0000000000006e38
[ 231.845881] IP: __bch2_set_nr_journal_buckets+0x182/0x5e0 [bcachefs]
[ 231.846033] PGD 0 P4D 0
[ 231.846116] Oops: 0000 [#1] PREEMPT SMP NOPTI
[ 231.846225] Modules linked in: bcachefs lz4_compress zstd_compress zstd_decompress xxhash uas usb_storage 8021q mrp i915 arc4 joydev ath9k mousedev ath9k_common ath9k_hw ath i2c_algo_bit mac80211 snd_hda_codec_realtek iTCO_wdt snd_hda_codec_generic iTCO_vendor_support asus_wmi drm_kms_helper sparse_keymap wmi_bmof snd_hda_intel uvcvideo cfg80211 snd_hda_codec videobuf2_vmalloc snd_hda_core videobuf2_memops snd_hwdep rfkill coretemp videobuf2_v4l2 snd_pcm psmouse videobuf2_common atl1c input_leds snd_timer videodev snd led_class drm pcspkr i2c_i801 soundcore media shpchp intel_agp lpc_ich intel_gtt agpgart syscopyarea sysfillrect sysimgblt fb_sys_fops wmi evdev ac battery rtc_cmos acpi_cpufreq mac_hid ip_tables x_tables ext4 crc16 mbcache jbd2 fscrypto sd_mod serio_raw atkbd libps2 ahci libahci uhci_hcd
[ 231.846965] libata ehci_pci ehci_hcd scsi_mod usbcore usb_common i8042 serio
[ 231.846965] CPU: 1 PID: 468 Comm: bcachefs Not tainted 4.16.11-ARCH-bcachefs+ #6
[ 231.846965] Hardware name: ASUSTeK Computer INC. 1005PE/1005P, BIOS 1202 06/23/2010
[ 231.846965] RIP: 0010:__bch2_set_nr_journal_buckets+0x182/0x5e0 [bcachefs]
[ 231.846965] RSP: 0018:ffffbd3b0076faf0 EFLAGS: 00010202
[ 231.846965] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 0000000000000000
[ 231.846965] RDX: 0000000000000000 RSI: ffffffffc0dae633 RDI: ffffffff81e83c96
[ 231.846965] RBP: ffffa09827ec5400 R08: 0000000000000000 R09: ffffa0981e292330
[ 231.846965] R10: ffffbd3b0076fa78 R11: ffffa0983bb76000 R12: 0000000000000001
[ 231.846965] R13: ffffa0981e292330 R14: ffffa098308fc000 R15: ffffa0983bb76000
[ 231.846965] FS: 00007f4c9e211d80(0000) GS:ffffa0983f500000(0000) knlGS:0000000000000000
[ 231.851121] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 231.856088] CR2: 0000000000006e38 CR3: 000000001e086000 CR4: 00000000000006e0
[ 231.856088] Call Trace:
[ 231.856088] bch2_dev_add+0x1b5/0x460 [bcachefs]
[ 231.856088] ? pagevec_lookup_range_tag+0x24/0x30
[ 231.856088] ? bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.856088] bch2_fs_ioctl.part.1+0x205/0xa60 [bcachefs]
[ 231.856088] ? generic_writepages+0x70/0xa0
[ 231.856088] ? preempt_count_add+0x92/0xa0
[ 231.856088] ? _raw_spin_lock+0x13/0x40
[ 231.856088] ? preempt_count_add+0x92/0xa0
[ 231.856088] ? _raw_spin_lock+0x13/0x40
[ 231.856088] ? locked_inode_to_wb_and_lock_list+0x74/0x180
[ 231.856088] ? _raw_spin_unlock+0x16/0x30
[ 231.856088] ? writeback_single_inode+0x54/0x130
[ 231.856088] ? write_inode_now+0x8a/0xc0
[ 231.856088] ? security_capable+0x41/0x60
[ 231.856088] bch2_fs_file_ioctl+0x75/0x580 [bcachefs]
[ 231.856088] ? __blkdev_put+0x19f/0x1e0
[ 231.856088] do_vfs_ioctl+0x9f/0x610
[ 231.938725] ? __fput+0x12e/0x1e0
[ 231.938725] ? preempt_count_add+0x92/0xa0
[ 231.938725] ? _raw_spin_lock_irq+0x1a/0x40
[ 231.938725] SyS_ioctl+0x74/0x80
[ 231.938725] ? __close_fd+0x88/0xa0
[ 231.938725] do_syscall_64+0x6e/0x190
[ 231.938725] entry_SYSCALL_64_after_hwframe+0x3d/0xa2
[ 231.938725] RIP: 0033:0x7f4c9c003667
[ 231.938725] RSP: 002b:00007ffc63cddda8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 231.938725] RAX: ffffffffffffffda RBX: 00007ffc63cdeefc RCX: 00007f4c9c003667
[ 231.938725] RDX: 00007ffc63cdddb0 RSI: 000000004010bc04 RDI: 0000000000000003
[ 231.938725] RBP: 0000000000000004 R08: 0000000000000000 R09: 0000000000000320
[ 231.938725] R10: 0000000000011000 R11: 0000000000000246 R12: 00007ffc63cdeef2
[ 231.938725] R13: 000055d0ecd20ee0 R14: 0000000000000000 R15: 00007ffc63cdddd0
[ 231.938725] Code: 48 89 44 24 20 48 8d 83 40 fa 00 00 48 89 04 24 e9 43 02 00 00 bf 01 00 00 00 e8 6a d1 31 c0 48 c7 c7 33 e6 da c0 e8 1e 2d 5f c0 <48> 8b 83 38 6e 00 00 65 ff 00 8b b3 f8 6d 00 00 85 f6 0f 85 ad
[ 231.938725] RIP: __bch2_set_nr_journal_buckets+0x182/0x5e0 [bcachefs] RSP: ffffbd3b0076faf0
[ 231.938725] CR2: 0000000000006e38
[ 231.938725] ---[ end trace 03b641b0cf0c6fc1 ]---
[ 231.997292] note: bcachefs[468] exited with preempt_count 1
WARNING: CPU: 1 PID: 136 at fs/bcachefs/buckets.c:313 bch2_fs_usage_apply+0xc0/0xd0 [bcachefs]
After running into #30, I tried to evacuate the SSD that was left first. This caused a WARNING:
[ 1315.619574] ------------[ cut here ]------------
[ 1315.619577] disk usage increased without a reservation
[ 1315.619663] WARNING: CPU: 1 PID: 136 at fs/bcachefs/buckets.c:313 bch2_fs_usage_apply+0xc0/0xd0 [bcachefs]
[ 1315.619666] Modules linked in: bcachefs lz4_compress crc64 uas usb_storage joydev hid_generic usbhid hid i915 iTCO_wdt iTCO_vendor_support evdev video coretemp snd_hda_codec_realtek intel_gtt hwmon i2c_algo_bit snd_hda_codec_generic snd_hda_intel drm_kms_helper psmouse snd_hda_codec uhci_hcd realtek cfbfillrect snd_hda_core r8169 ehci_pci cfbimgblt i2c_i801 ehci_hcd snd_hwdep libphy cfbcopyarea usbcore lpc_ich snd_pcm drm mfd_core usb_common drm_panel_orientation_quirks snd_timer syscopyarea sysfillrect snd sysimgblt button fb_sys_fops soundcore
[ 1315.619728] CPU: 1 PID: 136 Comm: kworker/1:1H Tainted: G T 4.20.0-30547-gffe09df1065d #1
[ 1315.619731] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./To be filled by O.E.M., BIOS 080016 03/25/2010
[ 1315.619771] Workqueue: bcachefs bch2_write_index [bcachefs]
[ 1315.619808] RIP: 0010:bch2_fs_usage_apply+0xc0/0xd0 [bcachefs]
[ 1315.619813] Code: 00 00 74 13 f0 4d 29 ac 24 18 18 00 00 b8 ff ff ff ff 49 8d 0e eb 87 48 c7 c7 78 ca 74 c0 c6 05 a4 d5 08 00 01 e8 a1 94 97 cc <0f> 0b eb d6 66 90 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 41
[ 1315.619816] RSP: 0018:ffffb48480cc7698 EFLAGS: 00010246
[ 1315.619819] RAX: 0000000000000000 RBX: ffff9afeb8034200 RCX: 0000000000000000
[ 1315.619822] RDX: 0000000000000002 RSI: ffffffff8e5ad0ea RDI: ffffffff8e5ad4ea
[ 1315.619825] RBP: ffff9afea3ccaad8 R08: ffffffffffcfe1f4 R09: 00000000000209c0
[ 1315.619827] R10: 0000020613fcac86 R11: 0000000000000001 R12: ffff9afe93290000
[ 1315.619830] R13: 0000000000000015 R14: 0000000000000000 R15: 0000000000000000
[ 1315.619833] FS: 0000000000000000(0000) GS:ffff9afebba80000(0000) knlGS:0000000000000000
[ 1315.619836] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1315.619838] CR2: 00007fc2774af640 CR3: 00000001397bc000 CR4: 00000000000006e0
[ 1315.619841] Call Trace:
[ 1315.619885] bch2_trans_fs_usage_apply+0xb7/0x110 [bcachefs]
[ 1315.619923] ? bch2_mark_update+0x1ee/0x4b0 [bcachefs]
[ 1315.619960] bch2_trans_commit+0xe67/0x14b0 [bcachefs]
[ 1315.620000] bch2_migrate_index_update+0x743/0xa90 [bcachefs]
[ 1315.620052] __bch2_write_index+0x165/0x330 [bcachefs]
[ 1315.620090] bch2_write_index+0x16/0x90 [bcachefs]
[ 1315.620098] process_one_work+0x19b/0x390
[ 1315.620104] worker_thread+0x30/0x3b0
[ 1315.620109] ? process_one_work+0x390/0x390
[ 1315.620113] kthread+0x117/0x130
[ 1315.620117] ? kthread_park+0x80/0x80
[ 1315.620123] ret_from_fork+0x1f/0x40
[ 1315.620129] ---[ end trace ad705c0dbed707e5 ]---
[ 1315.620227] bcachefs: bch2_trans_fs_usage_apply() disk usage increased more than 0 sectors reserved
[ 1315.620231] bcachefs: bch2_trans_fs_usage_apply() while inserting
[ 1315.620263] bcachefs: bch2_trans_fs_usage_apply() u64s 11 type 6 4143:956 snap 0 len 28 ver 0: crc: c_size 30 size 128 offset 0 nonce 0 csum 5 compress 4 ptr: 2:190056990 gen 1 cached crc: c_size 28 size 28 offset 0 nonce 0 csum 5 compress 0 ptr: 3:
[ 1315.620266] bcachefs: bch2_trans_fs_usage_apply() overlapping with
[ 1315.620292] bcachefs: bch2_trans_fs_usage_apply() u64s 11 type 6 4143:956 snap 0 len 28 ver 0: crc: c_size 30 size 128 offset 0 nonce 0 csum 5 compress 4 ptr: 2:190056990 gen 1 crc: c_size 28 size 28 offset 0 nonce 0 csum 5 compress 0 ptr: 5:3292714
dev 0 bucket 2162 has wrong dirty_sectors: got 451, should be 452, exiting
After many messages with information about workqueue stalls, I did hard reboot. Now I got:
[ 47.903381] bcachefs (dm-4): journal read done, 11885 keys in 3 entries, seq 13988
[ 47.995532] bcachefs (dm-4): starting metadata mark and sweep
[ 47.997177] bcachefs (dm-4): starting mark and sweep
[ 48.613323] bcachefs (dm-4): dev 0 bucket 2162 has wrong dirty_sectors: got 451, should be 452, exiting
[ 48.633514] bcachefs (dm-4): Unable to continue, halting
[ 48.634449] bcachefs (dm-4): Error in recovery: error in mark and sweep (1)
[ 48.635832] bcachefs (dm-4): filesystem contains errors: please report this to the developers
[ 48.636781] mount with -o fix_errors to repair
[ 48.696401] BUG: unable to handle kernel NULL pointer dereference at 0000000000000189
[ 48.697290] #PF error: [WRITE]
[ 48.697793] PGD 0 P4D 0
[ 48.698282] Oops: 0002 [#2] SMP PTI
[ 48.698813] CPU: 1 PID: 2934 Comm: mount Tainted: G D W 5.0.0+ #136
[ 48.699575] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
[ 48.702548] RIP: 0010:mutex_lock+0x19/0x30
[ 48.703374] Code: 90 0f 1f 44 00 00 be 02 00 00 00 e9 41 fb ff ff 90 0f 1f 44 00 00 53 48 89 fb e8 32 dd ff ff 31 c0 65 48 8b 14 25 40 4d 01 00 <f0> 48 0f b1 13 74 06 48 89 df 5b eb ca 5b c3 0f 1f 84 00 00 00 00
[ 48.704757] RSP: 0018:ffffa29d41c67c80 EFLAGS: 00010246
[ 48.705200] RAX: 0000000000000000 RBX: 0000000000000189 RCX: 0000000080400007
[ 48.705716] RDX: ffff8b5e22b19d00 RSI: 0000000000000001 RDI: 0000000000000189
[ 48.706279] RBP: 0000000000000189 R08: 0000000000000000 R09: ffffffffc03fa500
[ 48.706816] R10: ffff8b5e236c66c0 R11: 0000000000000001 R12: 0000000000000000
[ 48.707334] R13: ffff8b5e22ef66e0 R14: 0000000000000000 R15: 0000000000000000
[ 48.707916] FS: 00007faa66aab780(0000) GS:ffff8b5e3fc80000(0000) knlGS:0000000000000000
[ 48.708612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 48.709130] CR2: 0000000000000189 CR3: 00000002224ea004 CR4: 00000000001606a0
[ 48.709704] Call Trace:
[ 48.710278] bch2_mount+0x2c5/0x650 [bcachefs]
[ 48.710777] mount_fs+0x4f/0x164
[ 48.711168] vfs_kern_mount+0x64/0x130
[ 48.711553] do_mount+0x212/0xcc0
[ 48.711952] ? _copy_from_user+0x37/0x60
[ 48.712364] ? memdup_user+0x4b/0x70
[ 48.712762] ksys_mount+0xba/0xd0
[ 48.713111] __x64_sys_mount+0x21/0x30
[ 48.713624] do_syscall_64+0x4f/0xd0
[ 48.714081] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 48.714752] RIP: 0033:0x7faa66387e5a
[ 48.715590] Code: 48 8b 0d 29 f0 2b 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 49 89 ca b8 a5 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d f6 ef 2b 00 f7 d8 64 89 01 48
[ 48.716914] RSP: 002b:00007ffc08a020f8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
[ 48.717564] RAX: ffffffffffffffda RBX: 0000564c0e60e400 RCX: 00007faa66387e5a
[ 48.718212] RDX: 0000564c0e611b40 RSI: 0000564c0e61d310 RDI: 0000564c0e611c20
[ 48.718800] RBP: 000000000000040c R08: 0000000000000000 R09: 0000000000000000
[ 48.719403] R10: 000000000000040c R11: 0000000000000246 R12: 0000000000000000
[ 48.720057] R13: 0000564c0e61d310 R14: 0000564c0e611c20 R15: 00007faa668a3244
[ 48.720572] Modules linked in: dm_crypt algif_skcipher af_alg xt_set ip_set iptable_filter ip_tables ip6t_rt xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 ip6table_filter ip6table_mangle ip6_tables ipv6 bcachefs lz4_compress xor zstd_decompress zstd_compress xxhash zlib_deflate raid6_pq lz4_decompress crct10dif_pclmul ghash_clmulni_intel tcp_diag aesni_intel inet_diag aes_x86_64 crypto_simd cryptd glue_helper virtio_balloon processor button virtio_net net_failover crc32c_intel failover ata_generic
[ 48.724199] CR2: 0000000000000189
[ 48.724572] ---[ end trace 9a9fe2a60c91b69f ]---
[ 48.725022] RIP: 0010:mutex_lock+0x19/0x30
[ 48.725403] Code: 90 0f 1f 44 00 00 be 02 00 00 00 e9 41 fb ff ff 90 0f 1f 44 00 00 53 48 89 fb e8 32 dd ff ff 31 c0 65 48 8b 14 25 40 4d 01 00 <f0> 48 0f b1 13 74 06 48 89 df 5b eb ca 5b c3 0f 1f 84 00 00 00 00
[ 48.726710] RSP: 0018:ffffa29d418b3c80 EFLAGS: 00010246
[ 48.727138] RAX: 0000000000000000 RBX: 0000000000000189 RCX: 0000000080400033
[ 48.727642] RDX: ffff8b5e354ad700 RSI: 0000000000000001 RDI: 0000000000000189
[ 48.728152] RBP: 0000000000000189 R08: 0000000000000000 R09: ffffffffc03fa500
[ 48.728738] R10: ffff8b5e32b1b840 R11: 0000000000000001 R12: 0000000000000000
[ 48.729270] R13: ffff8b5e328cce40 R14: 0000000000000000 R15: 0000000000000000
[ 48.729856] FS: 00007faa66aab780(0000) GS:ffff8b5e3fc80000(0000) knlGS:0000000000000000
[ 48.730568] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 48.731028] CR2: 0000000000000189 CR3: 00000002224ea004 CR4: 00000000001606a0
[ 48.794432] device-mapper: crypt: cbc(aes) using implementation "cbc-aes-aesni"
[ 49.893651] Adding 1433596k swap on /dev/mapper/crypt-swap. Priority:-2 extents:1 across:1433596k FS
bf55d426aaf035ba15e9ca0be286c4945e8c9864 causes virtualbox host modules to fail DKMS compilation
I noticed that it compiled fine for the vanilla Arch kernel, so I tried changing my config settings to match, but it still failed... the problem seems rooted in the way bcachefs is changing stuff to work properly, and virtualbox doesn't like it.
Error output:
Or does the problem lie with the virtualbox modules needing a patch to work with bcachefs's changes, whatever they are?
BCH_IOCTL_USAGE error: Numerical result out of range
First, thank Kent for writing such promising fs for Linux. I'm a Patreon supporter and I've been testing bcachefs since a year ago. I'm using multiple devices as a backup target filesystem for testing bcachefs (with different Ubuntu distributions). I find that "bcachefs fs usage" command always gives this BCH_IOCTL_USAGE error. Is it normal or something that I did wrong during fs creation?
root@nas2:~# bcachefs format --group hdd /dev/sdb /dev/sdc /dev/sdd /dev/sde /dev/sdf /dev/sdg /dev/sdi --group ssd /dev/sdj --foreground_target ssd --background_target hdd --promote_target ssd
root@nas2:~# bcachefs fs usage /mnt
BCH_IOCTL_USAGE error: Numerical result out of range
root@nas2:~# bcachefs version
bcachefs tool version v0.1-65-g93bdfcb
root@nas2:~# df
Filesystem 1K-blocks Used Available Use% Mounted on
udev 1508708 0 1508708 0% /dev
tmpfs 306944 2580 304364 1% /run
/dev/sda1 60406860 35291088 22024164 62% /
tmpfs 1534712 0 1534712 0% /dev/shm
tmpfs 5120 4 5116 1% /run/lock
tmpfs 1534712 0 1534712 0% /sys/fs/cgroup
/dev/sdb:/dev/sdc:/dev/sdd:/dev/sde:/dev/sdf:/dev/sdg:/dev/sdi:/dev/sdj 18428465192 7835295628 10593169564 43% /mnt
tmpfs 306940 0 306940 0% /run/user/1000
root@nas2:~# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.10
Release: 18.10
Codename: cosmic
root@nas2:~# for drive in /dev/sd?; do echo $drive; smartctl -i $drive; done | egrep 'dev|Family|Model|Capacity'
/dev/sda
/dev/sda: Unknown USB bridge [0x0080:0xa001 (0x204)]
Please specify device type with the -d option.
/dev/sdb
Model Family: Toshiba 3.5" DT01ACA... Desktop HDD
Device Model: TOSHIBA DT01ACA300
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdc
Model Family: Toshiba 3.5" DT01ACA... Desktop HDD
Device Model: TOSHIBA DT01ACA300
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdd
Model Family: Toshiba 3.5" DT01ACA... Desktop HDD
Device Model: TOSHIBA DT01ACA300
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sde
Model Family: Hitachi Deskstar 7K3000
Device Model: Hitachi HDS723020BLA642
User Capacity: 2,000,398,934,016 bytes [2.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdf
Model Family: Toshiba 3.5" DT01ACA... Desktop HDD
Device Model: TOSHIBA DT01ACA300
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdg
Model Family: Toshiba 3.5" DT01ACA... Desktop HDD
Device Model: TOSHIBA DT01ACA300
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdh
Model Family: Seagate Barracuda 7200.14 (AF)
Device Model: ST3000DM001-1ER166
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdi
Model Family: Toshiba 3.5" DT01ACA... Desktop HDD
Device Model: TOSHIBA DT01ACA300
User Capacity: 3,000,592,982,016 bytes [3.00 TB]
SMART support is: Available - device has SMART capability.
/dev/sdj
Model Family: Crucial/Micron MX100/MX200/M5x0/M600 Client SSDs
Device Model: Crucial_CT512MX100SSD1
User Capacity: 512,110,190,592 bytes [512 GB]
SMART support is: Available - device has SMART capability.
root@nas2:~# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 74.5G 0 disk
โโsda1 8:1 0 58.7G 0 part /
โโsda2 8:2 0 1K 0 part
โโsda5 8:5 0 15.9G 0 part [SWAP]
sdb 8:16 1 2.7T 0 disk /mnt
sdc 8:32 1 2.7T 0 disk
sdd 8:48 1 2.7T 0 disk
sde 8:64 1 1.8T 0 disk
sdf 8:80 1 2.7T 0 disk
sdg 8:96 1 2.7T 0 disk
sdh 8:112 1 2.7T 0 disk
sdi 8:128 1 2.7T 0 disk
sdj 8:144 1 477G 0 disk
Fuse / Non-linux support.
Plsease support Bcachefs for windows like this:
https://github.com/matt-wu/Ext3Fsd
mount by filesystem uuid or label
Looks like it's not yet possible to mount by filesystem uuid or label. ZFS implements this with zpool.cache and userspace daemons, but I think bcachefs can make it even easier.
It might require some redundant device metadata to answer questions like "to which filesystem does this device belong?" before actually mounting any filesystem. Then the kernel module could expose each filesystem's device pool as a disk alias to allow something like
mount -t bcachefs /dev/disk/by-uuid/<external-uuid> /mnt/pool
And the best feature: write-once /etc/fstab!
UUID=<external-uuid> /mnt/pool bcachefs defaults 0 1
A filesystem's external uuid is stable, right? Otherwise this plan becomes much less foolproof.
kernel BUG at fs/bcachefs/btree_update.h:105!
The evacuate that caused a warning in #31 did complete successfully. After that, I removed on of the HDDs in the fs, and ran rereplicate again. That rereplicate seemed to be stuck, so I decided to reboot the machine, and ended up with an fs that hit another kernel BUG when trying to mount:
[ 263.594125] ------------[ cut here ]------------
[ 263.594131] kernel BUG at fs/bcachefs/btree_update.h:105!
[ 263.594146] invalid opcode: 0000 [#1] SMP NOPTI
[ 263.594266] CPU: 3 PID: 1895 Comm: mount Tainted: G T 4.20.0-30547-gffe09df1065d #1
[ 263.594310] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./To be filled by O.E.M., BIOS 080016 03/25/2010
[ 263.594310] RIP: 0010:bch2_extent_replay_key+0x30c/0x330 [bcachefs]
[ 263.594310] Code: 8b 9c 24 c8 03 00 00 65 48 33 1c 25 28 00 00 00 41 8d 07 75 2b 48 8d a4 24 d0 03 00 00 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 0b <0f> 0b 48 8d 74 24 38 48 8b 7c 24 30 e8 63 e9 fc ff e9 29 ff ff ff
[ 263.594310] RSP: 0018:ffff99304029b630 EFLAGS: 00010246
[ 263.594310] RAX: 0000000000000000 RBX: ffff99304029b7f8 RCX: 0000000000000005
[ 263.594310] RDX: 0000000000000005 RSI: 0000000000000290 RDI: ffff949cb3e30000
[ 263.594310] RBP: ffff99304029ba28 R08: ffffffffc06f2f60 R09: ffffb9303fd84b30
[ 263.594310] R10: 0000000000000000 R11: 0000000000000010 R12: ffff99304029b6b0
[ 263.594310] R13: ffff949ca4030058 R14: ffff99304029b6d8 R15: 000000000000002e
[ 263.594310] FS: 00007f0a629babe8(0000) GS:ffff949cbbb80000(0000) knlGS:0000000000000000
[ 263.594310] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 263.594310] CR2: 000056549fa15000 CR3: 0000000134790000 CR4: 00000000000006e0
[ 263.594310] Call Trace:
[ 263.594310] ? __update_idle_core+0x73/0xa0
[ 263.594310] bch2_journal_replay+0x115/0x1d0 [bcachefs]
[ 263.594310] bch2_fs_recovery+0x34d/0x4c0 [bcachefs]
[ 263.594310] bch2_fs_start+0x1a0/0x4f0 [bcachefs]
[ 263.594310] bch2_fs_open+0x2b4/0x320 [bcachefs]
[ 263.594310] bch2_mount+0x30e/0x730 [bcachefs]
[ 263.594310] mount_fs+0x4b/0x15f
[ 263.594310] vfs_kern_mount.part.11+0x56/0x130
[ 263.594310] do_mount+0x237/0xd50
[ 263.594310] ? memdup_user+0x4f/0x80
[ 263.594310] ksys_mount+0xc7/0xe0
[ 263.594310] __x64_sys_mount+0x22/0x30
[ 263.594310] do_syscall_64+0x67/0x2fe
[ 263.594310] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 263.594310] RIP: 0033:0x7f0a627338ef
[ 263.594310] Code: b8 b0 00 00 00 8d 36 0f 05 48 89 c7 e8 0a e8 ff ff 48 8d 64 24 08 c3 0f 1f 40 00 48 8d 64 24 f8 4c 8d 11 b8 a5 00 00 00 0f 05 <48> 89 c7 e8 e9 e7 ff ff 48 8d 64 24 08 c3 0f 1f 00 48 8d 64 24 f8
[ 263.594310] RSP: 002b:00007ffd5b7d9770 EFLAGS: 00000246 ORIG_RAX: 00000000000000a5
[ 263.594310] RAX: ffffffffffffffda RBX: 000056541a4c96c0 RCX: 00007f0a627338ef
[ 263.594310] RDX: 000056541a4c9580 RSI: 000056541a4c9f80 RDI: 00007f0a624b5de0
[ 263.594310] RBP: 00007f0a62711210 R08: 0000000000000000 R09: 8080808080808080
[ 263.594310] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[ 263.594310] R13: 0000000000000000 R14: 00007f0a624b5de0 R15: 000056541a4c9580
[ 263.594310] Modules linked in: bcachefs lz4_compress crc64 uas usb_storage joydev hid_generic usbhid hid i915 iTCO_wdt iTCO_vendor_support evdev video intel_gtt coretemp snd_hda_codec_realtek i2c_algo_bit hwmon snd_hda_codec_generic d
rm_kms_helper snd_hda_intel cfbfillrect uhci_hcd snd_hda_codec cfbimgblt realtek cfbcopyarea ehci_pci r8169 lpc_ich psmouse snd_hda_core ehci_hcd drm libphy usbcore i2c_i801 snd_hwdep mfd_core drm_panel_orientation_quirks usb_common snd_
pcm syscopyarea sysfillrect snd_timer sysimgblt button snd fb_sys_fops soundcore
[ 263.611957] ---[ end trace 270e830e205852b3 ]---
[ 263.616623] RIP: 0010:bch2_extent_replay_key+0x30c/0x330 [bcachefs]
[ 263.621036] Code: 8b 9c 24 c8 03 00 00 65 48 33 1c 25 28 00 00 00 41 8d 07 75 2b 48 8d a4 24 d0 03 00 00 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 0b <0f> 0b 48 8d 74 24 38 48 8b 7c 24 30 e8 63 e9 fc ff e9 29 ff ff ff
[ 263.630187] RSP: 0018:ffff99304029b630 EFLAGS: 00010246
[ 263.634691] RAX: 0000000000000000 RBX: ffff99304029b7f8 RCX: 0000000000000005
[ 263.639104] RDX: 0000000000000005 RSI: 0000000000000290 RDI: ffff949cb3e30000
[ 263.643339] RBP: ffff99304029ba28 R08: ffffffffc06f2f60 R09: ffffb9303fd84b30
[ 263.647593] R10: 0000000000000000 R11: 0000000000000010 R12: ffff99304029b6b0
[ 263.651829] R13: ffff949ca4030058 R14: ffff99304029b6d8 R15: 000000000000002e
[ 263.656124] FS: 00007f0a629babe8(0000) GS:ffff949cbbb80000(0000) knlGS:0000000000000000
[ 263.660443] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 263.664782] CR2: 000056549fa15000 CR3: 0000000134790000 CR4: 00000000000006e0
I believe I was able to mount with -o fix_errors, but running rereplicate again after that hung again:
task [bcachefs]:2074 blocked for more than 120 seconds
Linux 5.1 rebase?
kernel BUG at fs/bcachefs/bkey_sort.c:122!
Commit: f61b91d
Differs from version in output below because I merged 5.0.16.
[350711.376210] ------------[ cut here ]------------
[350711.376215] kernel BUG at fs/bcachefs/bkey_sort.c:122!
[350711.376223] invalid opcode: 0000 [#1] SMP PTI
[350711.380675] CPU: 0 PID: 32426 Comm: kworker/0:0 Tainted: G T 5.0.16-00437-g961e9523f23d #1
[350711.390324] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./E3C224D4I-14S, BIOS P3.20 05/29/2015
[350711.400353] Workqueue: bcachefs bch2_write_index [bcachefs]
[350711.406047] RIP: 0010:bch2_sort_extents+0x284/0x290 [bcachefs]
[350711.411967] Code: 48 8b 44 24 20 80 78 01 00 78 a1 eb c3 48 8b 34 24 8d 50 ff 41 89 55 08 49 8d 7d 10 48 c1 e2 04 e8 f1 49 06 d7 e9 71 ff ff ff <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 41 57 49 89 f7 41
[350711.430798] RSP: 0018:ffffb7dc81f5f6c0 EFLAGS: 00010212
[350711.436111] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffff98ed4348a030
[350711.443333] RDX: 0000000000000053 RSI: ffff98ed19eb2ff8 RDI: ffff98ed19eb2ff8
[350711.450551] RBP: ffffb7dc81f5f720 R08: ffff98ed19eb3038 R09: ffff98ed19eb2fe0
[350711.457770] R10: ffff98ed19eb3038 R11: ffff98ed19eb2fe0 R12: ffffb7dc81f5f790
[350711.464988] R13: ffffb7dc81f5f780 R14: ffff98ed19eb3290 R15: 0000000000000001
[350711.472211] FS: 0000000000000000(0000) GS:ffff98edcfa00000(0000) knlGS:0000000000000000
[350711.480381] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[350711.486215] CR2: 000055c126090000 CR3: 00000002c0f32001 CR4: 00000000000606f0
[350711.493433] Call Trace:
[350711.496000] btree_node_sort.constprop.6+0x1d8/0x5a0 [bcachefs]
[350711.502029] bch2_btree_init_next+0x9a/0x1f0 [bcachefs]
[350711.507371] bch2_trans_commit+0xfaa/0x1540 [bcachefs]
[350711.512635] bch2_migrate_index_update+0x6b5/0x9d0 [bcachefs]
[350711.518505] ? bch2_migrate_index_update+0xab/0x9d0 [bcachefs]
[350711.524459] __bch2_write_index+0x158/0x320 [bcachefs]
[350711.529713] bch2_write_index+0x11/0x90 [bcachefs]
[350711.534600] process_one_work+0x172/0x310
[350711.538704] worker_thread+0x2b/0x380
[350711.542463] ? process_one_work+0x310/0x310
[350711.546745] kthread+0x10a/0x120
[350711.550074] ? kthread_park+0x80/0x80
[350711.553836] ret_from_fork+0x35/0x40
[350711.557506] Modules linked in: veth xt_nat xt_tcpudp ipt_MASQUERADE nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_nat nf_nat_ipv4 xt_addrtype iptable_filter ip_tables bpfilter xt_conntrack x_tables nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc sha1_ssse3 sha1_generic sctp bcachefs lz4_compress crc64 bonding sch_fq_codel binfmt_misc nct6775 hwmon_vid jc42 joydev hid_generic usbhid hid uas usb_storage intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm ast ttm irqbypass iTCO_wdt drm_kms_helper iTCO_vendor_support evdev crct10dif_pclmul crc32_pclmul drm crc32c_intel efi_pstore ghash_clmulni_intel cryptd intel_cstate intel_uncore intel_rapl_perf efivars lpc_ich drm_panel_orientation_quirks syscopyarea sysfillrect sysimgblt i2c_i801 mfd_core fb_sys_fops fan thermal igb ehci_pci mpt3sas ehci_hcd i2c_algo_bit xhci_pci xhci_hcd raid_class dca scsi_transport_sas acpi_pad button usbcore mei_me usb_common efivarfs
[350711.643245] ---[ end trace 66417764d4433654 ]---
[350711.668427] RIP: 0010:bch2_sort_extents+0x284/0x290 [bcachefs]
[350711.668429] Code: 48 8b 44 24 20 80 78 01 00 78 a1 eb c3 48 8b 34 24 8d 50 ff 41 89 55 08 49 8d 7d 10 48 c1 e2 04 e8 f1 49 06 d7 e9 71 ff ff ff <0f> 0b 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 41 57 49 89 f7 41
[350711.668430] RSP: 0018:ffffb7dc81f5f6c0 EFLAGS: 00010212
[350711.668431] RAX: 0000000000000001 RBX: 0000000000000001 RCX: ffff98ed4348a030
[350711.668431] RDX: 0000000000000053 RSI: ffff98ed19eb2ff8 RDI: ffff98ed19eb2ff8
[350711.668432] RBP: ffffb7dc81f5f720 R08: ffff98ed19eb3038 R09: ffff98ed19eb2fe0
[350711.668432] R10: ffff98ed19eb3038 R11: ffff98ed19eb2fe0 R12: ffffb7dc81f5f790
[350711.668433] R13: ffffb7dc81f5f780 R14: ffff98ed19eb3290 R15: 0000000000000001
[350711.668434] FS: 0000000000000000(0000) GS:ffff98edcfa00000(0000) knlGS:0000000000000000
[350711.668434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[350711.668435] CR2: 000055c126090000 CR3: 00000002c0f32001 CR4: 00000000000606f0
Failed to mount with fix_errors option after drive removal
While adding a drive to a running system, I accidentally pulled a bcachefs HDD that was in active use. The system apparently kernel panic-ed and the machine was rebooted, after which the bcachefs volume will not remount.
Kernel info
Linux btea0 4.16.0+bcachefs.git20180614.0eb4ad1d-1-generic #1-Ubuntu SMP Thu Jun 14 01:56:06 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Bcachefs volume
btea@btea0:/bill$ sudo bcachefs show-super /dev/sdb
External UUID: 45385d39-40a7-483c-8710-e72653c48234
Internal UUID: 7552bc05-282d-463d-955a-fffacad00cc1
Label:
Version: 9
Block_size: 4.0K
Btree node size: 256.0K
Error action: remount-ro
Clean: 1
Metadata replicas: 1
Data replicas: 1
Metadata checksum type: crc32c (1)
Data checksum type: crc32c (1)
Compression type: none (0)
Foreground write target: 258
Background write target: 257
Promote target: 258
String hash type: siphash (2)
32 bit inodes: 0
GC reserve percentage: 8%
Root reserve percentage: 0%
Devices: 3 live, 3 total
Sections: journal,members,replicas,disk_groups
Superblock size: 9528
Members (size 176):
Device 0:
UUID: af462727-4da9-43ba-8072-ca2ea5b1cc35
Size: 10.9T
Bucket size: 512.0K
First bucket: 0
Buckets: 22888448
Last mount: Wed Dec 31 19:03:16 1969
State: readwrite
Group: hdd
Data allowed: journal,btree,data
Has data: journal,btree,data
Replacement policy: lru
Discard: 0
Device 1:
UUID: 9d6a952c-ff6d-4f6d-baea-f5e5e4f12c32
Size: 10.9T
Bucket size: 512.0K
First bucket: 0
Buckets: 22888448
Last mount: Wed Dec 31 19:03:16 1969
State: readwrite
Group: hdd
Data allowed: journal,btree,data
Has data: journal,btree,data
Replacement policy: lru
Discard: 0
Device 2:
UUID: e5b35c8a-c837-4aca-990b-dceb07551462
Size: 953.9G
Bucket size: 256.0K
First bucket: 0
Buckets: 3907049
Last mount: Wed Dec 31 19:03:16 1969
State: readwrite
Group: nvme
Data allowed: journal,btree,data
Has data: journal,btree,data,cached
Replacement policy: lru
Discard: 0
Drive detachment
Aug 21 09:30:58 btea0 kernel: ata3: exception Emask 0x50 SAct 0x0 SErr 0x4090800 action 0xe frozen
Aug 21 09:30:58 btea0 kernel: ata3: irq_stat 0x00400040, connection status changed
Aug 21 09:30:58 btea0 kernel: ata3: SError: { HostInt PHYRdyChg 10B8B DevExch }
Aug 21 09:30:58 btea0 kernel: ata3: hard resetting link
Aug 21 09:30:58 btea0 kernel: ata3: SATA link down (SStatus 0 SControl 300)
Aug 21 09:30:59 btea0 kernel: ata3: hard resetting link
Aug 21 09:31:05 btea0 kernel: ata3: link is slow to respond, please be patient (ready=0)
Aug 21 09:31:09 btea0 kernel: ata3: COMRESET failed (errno=-16)
Aug 21 09:31:09 btea0 kernel: ata3: hard resetting link
Aug 21 09:31:15 btea0 kernel: ata3: link is slow to respond, please be patient (ready=0)
Aug 21 09:31:16 btea0 kernel: ata3: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
Aug 21 09:31:16 btea0 kernel: ata3.00: configured for UDMA/133
Aug 21 09:31:16 btea0 kernel: ata3: EH complete
Aug 21 09:35:31 btea0 kernel: ata2: exception Emask 0x10 SAct 0x0 SErr 0x4050000 action 0xe frozen
Aug 21 09:35:31 btea0 kernel: ata2: irq_stat 0x00400040, connection status changed
Aug 21 09:35:31 btea0 kernel: ata2: SError: { PHYRdyChg CommWake DevExch }
Aug 21 09:35:31 btea0 kernel: ata2: hard resetting link
Aug 21 09:35:37 btea0 kernel: ata2: link is slow to respond, please be patient (ready=0)
Aug 21 09:35:41 btea0 kernel: ata2: COMRESET failed (errno=-16)
Aug 21 09:35:41 btea0 kernel: ata2: hard resetting link
Aug 21 09:35:46 btea0 kernel: ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
Aug 21 09:35:46 btea0 kernel: ata2.00: ATA-8: WDC WD3001FFSX-68JNUN0, 81.00A81, max UDMA/133
Aug 21 09:35:46 btea0 kernel: ata2.00: 5860533168 sectors, multi 0: LBA48 NCQ (depth 31/32), AA
Aug 21 09:35:46 btea0 kernel: ata2.00: configured for UDMA/133
Aug 21 09:35:46 btea0 kernel: ata2: EH complete
Aug 21 09:35:46 btea0 kernel: scsi 1:0:0:0: Direct-Access ATA WDC WD3001FFSX-6 0A81 PQ: 0 ANSI: 5
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: Attached scsi generic sg3 type 0
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: [sdd] 5860533168 512-byte logical blocks: (3.00 TB/2.73 TiB)
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: [sdd] 4096-byte physical blocks
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: [sdd] Write Protect is off
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: [sdd] Mode Sense: 00 3a 00 00
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Aug 21 09:35:46 btea0 kernel: sd 1:0:0:0: [sdd] Attached SCSI disk
Aug 21 10:02:04 btea0 kernel: ------------[ cut here ]------------
Aug 21 10:02:04 btea0 kernel: kernel BUG at /build/linux-iJySqy/linux-4.16.0+bcachefs.git20180614.0eb4ad1d/fs/bcachefs/btree_update_interior.c:1641!
Aug 21 10:02:04 btea0 kernel: invalid opcode: 0000 [#1] SMP PTI
Aug 21 10:02:04 btea0 kernel: Modules linked in: binfmt_misc ipmi_ssif kvm_intel kvm irqbypass joydev input_leds ipmi_si ipmi_devintf ipmi_msghandler acpi_pad tcp_bbr sch_fq ib_ise
Aug 21 10:02:04 btea0 kernel: CPU: 3 PID: 17767 Comm: kworker/u32:4 Not tainted 4.16.0+bcachefs.git20180614.0eb4ad1d-1-generic #1-Ubuntu
Aug 21 10:02:04 btea0 kernel: Hardware name: Supermicro SYS-5028D-TN4T/X10SDV-TLN4F, BIOS 1.3 02/13/2018
Aug 21 10:02:04 btea0 kernel: Workqueue: events_unbound __bch2_read_endio
Aug 21 10:02:04 btea0 kernel: RIP: 0010:__bch2_foreground_maybe_merge+0x860/0x900
Aug 21 10:02:04 btea0 kernel: RSP: 0018:ffffae96dcbc3708 EFLAGS: 00010246
Aug 21 10:02:04 btea0 kernel: RAX: 0000000000000001 RBX: 00000000fffffffc RCX: 0000000000000002
Aug 21 10:02:04 btea0 kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff9f66aa53e650
Aug 21 10:02:04 btea0 kernel: RBP: ffffae96dcbc38b0 R08: 0000000000000001 R09: 0000000000102955
Aug 21 10:02:04 btea0 kernel: R10: 000000002019fb50 R11: 0000000000000000 R12: ffff9f66b23b8400
Aug 21 10:02:04 btea0 kernel: R13: ffffae96dcbc3bd0 R14: ffff9f68156b0000 R15: fffffffffffffffc
Aug 21 10:02:04 btea0 kernel: FS: 0000000000000000(0000) GS:ffff9f682f2c0000(0000) knlGS:0000000000000000
Aug 21 10:02:04 btea0 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Aug 21 10:02:04 btea0 kernel: CR2: 00007fb35d83c068 CR3: 0000000362c0a004 CR4: 00000000003606e0
Aug 21 10:02:04 btea0 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Aug 21 10:02:04 btea0 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Aug 21 10:02:04 btea0 kernel: Call Trace:
Aug 21 10:02:04 btea0 kernel: ? six_trylock_convert+0x3c/0x50
Aug 21 10:02:04 btea0 kernel: ? __bch2_btree_node_relock+0x89/0x210
Aug 21 10:02:04 btea0 kernel: bch2_btree_insert_node+0x4ed/0x670
Aug 21 10:02:04 btea0 kernel: __bch2_foreground_maybe_merge+0x781/0x900
Aug 21 10:02:04 btea0 kernel: __bch2_btree_insert_at+0x5fe/0x720
Aug 21 10:02:04 btea0 kernel: bch2_rbio_narrow_crcs+0x295/0x2d0
Aug 21 10:02:04 btea0 kernel: __bch2_read_endio+0x602/0x7c0
Aug 21 10:02:04 btea0 kernel: process_one_work+0x1de/0x3e0
Aug 21 10:02:04 btea0 kernel: worker_thread+0x32/0x410
Aug 21 10:02:04 btea0 kernel: kthread+0x121/0x140
Aug 21 10:02:04 btea0 kernel: ? process_one_work+0x3e0/0x3e0
Aug 21 10:02:04 btea0 kernel: ? kthread_create_worker_on_cpu+0x70/0x70
Aug 21 10:02:04 btea0 kernel: ? do_syscall_64+0x73/0x130
Aug 21 10:02:04 btea0 kernel: ? SyS_exit+0x17/0x20
Aug 21 10:02:04 btea0 kernel: ret_from_fork+0x35/0x40
Aug 21 10:02:04 btea0 kernel: Code: f4 44 01 4d 85 ff 74 1e 49 8b 07 49 8b 7f 08 49 83 c7 18 48 89 da 4c 89 f6 e8 9d 5a a3 00 49 8b 07 48 85 c0 75 e5 e9 03 fc ff ff <0f> 0b 89 c3 8
Aug 21 10:02:04 btea0 kernel: RIP: __bch2_foreground_maybe_merge+0x860/0x900 RSP: ffffae96dcbc3708
Aug 21 10:02:04 btea0 kernel: ---[ end trace b1d5620a6651ccf0 ]---
Subsequent mount result
btea@btea0:/bill$ sudo mount "/dev/sdb:/dev/sdc:/dev/nvme0n1" -t bcachefs /bill
mount: /bill: wrong fs type, bad option, bad superblock on /dev/sdb:/dev/sdc:/dev/nvme0n1, missing codepage or helper program, or other error.
[ 4750.911808] bcachefs (45385d39-40a7-483c-8710-e72653c48234): recovering from clean shutdown, journal seq 191345
[ 4754.317393] bcachefs (45385d39-40a7-483c-8710-e72653c48234): journal read done, 8474230 keys in 3349 entries, seq 425768
[ 4754.317398] bcachefs (45385d39-40a7-483c-8710-e72653c48234): superblock journal seq (191345) doesn't match journal (425768) after clean shutdown, exiting
[ 4754.317443] bcachefs (45385d39-40a7-483c-8710-e72653c48234): Unable to continue, halting
[ 4754.319206] bcachefs (45385d39-40a7-483c-8710-e72653c48234): filesystem contains errors: please report this to the developers
[ 4754.319240] mount with -o fix_errors to repair
Mount w/fix_errors result
btea@btea0:/bill$ sudo mount "/dev/sdb:/dev/sdc:/dev/nvme0n1" -t bcachefs -o fix_errors /bill
[ 4765.600793] bcachefs (45385d39-40a7-483c-8710-e72653c48234): recovering from clean shutdown, journal seq 191345
[ 4769.056953] bcachefs (45385d39-40a7-483c-8710-e72653c48234): journal read done, 8474230 keys in 3349 entries, seq 425768
[ 4769.056956] bcachefs (45385d39-40a7-483c-8710-e72653c48234): superblock journal seq (191345) doesn't match journal (425768) after clean shutdown, fixing
bcachefs (45385d39-40a7-483c-8710-e72653c48234): superblock journal seq (191345) doesn't match journal (425768) after clean shutdown, exiting
bcachefs (45385d39-40a7-483c-8710-e72653c48234): Unable to continue, halting
bcachefs (45385d39-40a7-483c-8710-e72653c48234): filesystem contains errors: please report this to the developers
bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sdb: fsck error
At this point the system was locked, even the console was unresponsive.
BUG: unable to handle kernel paging request [...] IP: ZSTD_compressSequences_internal
Created a bcachefs for testing with
./mkfs.bcachefs --compression_type=zstd --background_compression_type=zstd -L bcacheMedia /dev/sdc1
Get this when doing an rsync to it.
Here is the dmesg output https://gist.github.com/BlackLotus/e158b7ed7dea45c5ef21923729f78d13
Kernel is compiled from git master 0eb4ad1
linux master rebase
after a rebase with upstream linux master there were a couple of changes needed - mainly from upstream clean up of unused variables:
i did not make a pull request as it is a bit massive
ignore this, it was my first attempt and the master branch for some reason had some commits twice.
rebasing without the doubly applied commits and with this commit b81d050
i was able to boot to 5.3.0-rc2 and writing this from it
my method was using git rebase -i taking only your commits and applying them to master
e: uptime 3 hours, only dmesg for bcachefs is
bucket sector count overflow: 65535 + -128 > U16_MAX
superblock journal seq / journal seq mismatch on multi-device FS
Hi,
Twice now I've run into what looks like a data corruption bug, one that fsck/-o fix_errors seems not to be able to fix easily. (I make daily backups, so nothing was lost.) The rough sequence of steps I followed each time:
- Set up an encrypted multi-device tiered filesystem, /dev/sda2 (HDD) as background_target, /dev/sdb2 (SSD) as foreground_target and promote_target. This serves as my root filesystem which has to be mounted using a hacked up initramfs.
- At some later point set up background_compression with zstd.
- Everything works fine over multiple restarts, until:
- At some point there is an attempt by the initramfs to mount one of the drives, not both, read-only. For me this was caused by a) accidentally running an old initramfs or b) my hacked up initramfs being blown away by an upgrade. Anyway, this fails with
insufficient devices, as expected, but takes a noticeably long time to do so.
[ 43.728424] bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sda2: insufficient devices
- When trying to mount the filesystem after that (properly, with both devices), I get this error:
[ 81.943979] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): recovering from clean shutdown, journal seq 18446744073709551615
[ 86.232951] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): journal read done, 3781 keys in 113 entries, seq 331620
[ 86.232954] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): superblock journal seq (18446744073709551615) doesn't match journal (331620) a
[ 86.233018] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): Unable to continue, halting
[ 86.233085] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): filesystem contains errors: please report this to the developers
[ 86.233145] mount with -o fix_errors to repair
[ 86.233146] bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sdb2: fsck error
NB: the superblock journal seq is 2^64 - 1.
- The FS is difficult to recover at this point;
-o fix_errorsdoesn't help, and fsck seems to get a little farther, but mount then fails again. Multiple rounds of fsck/mount/fsck/mount don't help.
I can't be totally sure what causes this. Step 4 seems necessary to trigger this bug, but not sufficient: it directly preceded the error both times. But I tried replicating this with smaller file-backed loopback devices without any real success, so maybe there needs to be some specific data in the journal for it to trigger.
This is all with commit 9c08efd, so a couple weeks out of date now. I'll upgrade and see if it triggers again.
Here's the superblock information (taken after the mount failed) and a dmesg log if it helps. Note that the "clean" flag is different on the two devices, not sure if that matters.
/dev/sda2 superblock:
External UUID: 1c6fb4a7-6172-4646-9dda-64da58327beb
Internal UUID: a07f676a-de61-43a7-a1b3-a18d8f813344
Label:
Version: 9
Block_size: 512
Btree node size: 256.0K
Error action: remount-ro
Clean: 1
Metadata replicas: 1
Data replicas: 1
Metadata checksum type: crc32c (1)
Data checksum type: crc32c (1)
Compression type: none (0)
Foreground write target: 1
Background write target: 2
Promote target: 1
String hash type: siphash (2)
32 bit inodes: 0
GC reserve percentage: 8%
Root reserve percentage: 0%
Devices: 2 live, 2 total
Sections: journal,members,crypt,replicas,clean
Superblock size: 9200
Members (size 120):
Device 0:
UUID: 7b799051-7060-4e77-9144-72b5f184b171
Size: 223.1G
Bucket size: 256.0K
First bucket: 0
Buckets: 913696
Last mount: Thu Jan 1 00:00:46 1970
State: readwrite
Group: `๏ฟฝ
Data allowed: journal,btree,data
Has data: journal,btree,data,cached
Replacement policy: lru
Discard: 0
Device 1:
UUID: 19f52b7a-ba13-4b4c-8f71-de883e541c8c
Size: 1.8T
Bucket size: 512.0K
First bucket: 0
Buckets: 3815444
Last mount: Thu Jan 1 00:00:46 1970
State: readwrite
Group: `๏ฟฝ
Data allowed: journal,btree,data
Has data: journal,btree,data
Replacement policy: lru
Discard: 0
/dev/sdb2 superblock:
External UUID: 1c6fb4a7-6172-4646-9dda-64da58327beb
Internal UUID: a07f676a-de61-43a7-a1b3-a18d8f813344
Label:
Version: 9
Block_size: 512
Btree node size: 256.0K
Error action: remount-ro
Clean: 0
Metadata replicas: 1
Data replicas: 1
Metadata checksum type: crc32c (1)
Data checksum type: crc32c (1)
Compression type: none (0)
Foreground write target: 1
Background write target: 2
Promote target: 1
String hash type: siphash (2)
32 bit inodes: 0
GC reserve percentage: 8%
Root reserve percentage: 0%
Devices: 2 live, 2 total
Sections: journal,members,crypt,replicas,clean
Superblock size: 9480
Members (size 120):
Device 0:
UUID: 7b799051-7060-4e77-9144-72b5f184b171
Size: 223.1G
Bucket size: 256.0K
First bucket: 0
Buckets: 913696
Last mount: Thu Jan 1 00:00:46 1970
State: readwrite
Group: ๏ฟฝ
Data allowed: journal,btree,data
Has data: journal,btree,data,cached
Replacement policy: lru
Discard: 0
Device 1:
UUID: 19f52b7a-ba13-4b4c-8f71-de883e541c8c
Size: 1.8T
Bucket size: 512.0K
First bucket: 0
Buckets: 3815444
Last mount: Thu Jan 1 00:00:46 1970
State: readwrite
Group: ๏ฟฝ
Data allowed: journal,btree,data
Has data: journal,btree,data
Replacement policy: lru
Discard: 0
diff between the two, for clarity:
8c8
< Clean: 1
---
> Clean: 0
23c23
< Superblock size: 9200
---
> Superblock size: 9480
35c35
< Group: `๏ฟฝ
---
> Group: ๏ฟฝ
49c49
< Group: `๏ฟฝ
---
> Group: ๏ฟฝ
dmesg log with verbose_init,verbose_recovery options:
[ 2357.322991] bcachefs: bch2_fs_open()
[ 2357.322992] bcachefs: bch2_read_super()
[ 2357.323669] bcachefs: bch2_read_super() ret 0
[ 2357.324021] bcachefs: bch2_read_super()
[ 2357.326757] bcachefs: bch2_read_super() ret 0
[ 2357.327053] bcachefs: bch2_fs_alloc()
[ 2357.327354] bcachefs: bch2_fs_journal_init()
[ 2357.327359] bcachefs: bch2_fs_journal_init() ret 0
[ 2357.327360] bcachefs: bch2_fs_btree_cache_init()
[ 2357.327427] bcachefs: bch2_fs_btree_cache_init() ret 0
[ 2357.327462] bcachefs: bch2_fs_encryption_init()
[ 2357.327475] bcachefs: bch2_fs_encryption_init() ret 0
[ 2357.327477] bcachefs: __bch2_fs_compress_init()
[ 2357.327479] bcachefs: __bch2_fs_compress_init() ret 0
[ 2357.327480] bcachefs: bch2_fs_fsio_init()
[ 2357.327492] bcachefs: bch2_fs_fsio_init() ret 0
[ 2357.327492] bcachefs: bch2_dev_alloc()
[ 2357.328782] bcachefs: bch2_dev_alloc() ret 0
[ 2357.328784] bcachefs: bch2_dev_alloc()
[ 2357.333838] bcachefs: bch2_dev_alloc() ret 0
[ 2357.334022] bcachefs: bch2_fs_alloc() ret 0
[ 2357.334059] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): recovering from clean shutdown, journal seq 18446744073709551615
[ 2361.643306] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): journal read done, 3781 keys in 113 entries, seq 331620
[ 2361.643308] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): superblock journal seq (18446744073709551615) doesn't match journal (331620) after clean shutdown, exiting
[ 2361.643378] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): Unable to continue, halting
[ 2361.643444] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): filesystem contains errors: please report this to the developers
[ 2361.643505] mount with -o fix_errors to repair
[ 2361.643506] bcachefs: bch2_fs_open() bch_fs_open err opening /dev/sda2: fsck error
[ 2361.643564] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): shutting down
[ 2361.689327] bcachefs (1c6fb4a7-6172-4646-9dda-64da58327beb): shutdown complete
[ 2361.704344] bcachefs: bch2_fs_open() ret -22
5.1 general protection fault: 0000 [#1] SMP PTI
[ 13.079767] general protection fault: 0000 [#1] SMP PTI
[ 13.079870] CPU: 6 PID: 573 Comm: systemd-udevd Not tainted 5.1.0+ #7
[ 13.079965] Hardware name: Intel Corporation S1200SP/S1200SP, BIOS S1200SP.86B.03.01.0038.062620180344 06/26/2018
[ 13.080087] RIP: 0010:strcmp+0x8/0x20
[ 13.080178] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.080334] RSP: 0018:ffffb109c3b87d08 EFLAGS: 00010286
[ 13.080427] RAX: ffffb109c3b6c1f0 RBX: ffffb109c3b6c230 RCX: ffffb109c3b6c1f0
[ 13.080523] RDX: ffffb109c3b65004 RSI: ffffffff89839635 RDI: 48ffb108f474c60c
[ 13.080619] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.080716] R10: ffffb109c3b87e88 R11: 0000000000000088 R12: 0000000000000027
[ 13.080813] R13: ffffb109c3b87e98 R14: ffffffff89839634 R15: ffffb109c3b87e98
[ 13.080909] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd80000(0000) knlGS:0000000000000000
[ 13.081024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.081121] CR2: 00007f97f671ca24 CR3: 000000083900a003 CR4: 00000000003606e0
[ 13.081218] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.081314] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.081410] Call Trace:
[ 13.081501] find_sec+0x43/0x60
[ 13.081591] load_module+0xe3/0x2b80
[ 13.081681] ? vfs_read+0x11d/0x140
[ 13.081770] ? kernel_read_file+0x1b4/0x1d0
[ 13.081861] ? __do_sys_finit_module+0xd2/0x100
[ 13.081952] __do_sys_finit_module+0xd2/0x100
[ 13.082045] do_syscall_64+0x55/0x100
[ 13.082135] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 13.082227] RIP: 0033:0x7f97f55cf469
[ 13.082316] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d ff 49 2b 00 f7 d8 64 89 01 48
[ 13.082470] RSP: 002b:00007ffe1c68ae78 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 13.082584] RAX: ffffffffffffffda RBX: 000055a196a28ae0 RCX: 00007f97f55cf469
[ 13.082680] RDX: 0000000000000000 RSI: 00007f97f5ee8265 RDI: 0000000000000011
[ 13.082776] RBP: 00007f97f5ee8265 R08: 0000000000000000 R09: 00007ffe1c68b3f0
[ 13.082872] R10: 0000000000000011 R11: 0000000000000246 R12: 0000000000000000
[ 13.082968] R13: 000055a196a28a90 R14: 0000000000020000 R15: 000055a1962d0efc
[ 13.083064] Modules linked in: intel_cstate ipmi_si(+) intel_uncore ipmi_devintf intel_rapl_perf ipmi_msghandler mousedev input_leds intel_pch_thermal ie31200_edac parport_pc parport acpi_power_meter(+) acpi_pad pcc_cpufreq sunrpc vhost_net tun vhost tap virtio_rng ip_tables x_tables autofs4 btrfs zstd_compress raid10 multipath linear 3w_9xxx ixgbe xfrm_algo mdio via686a dm_crypt raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid0 dm_mirror dm_region_hash dm_log sym53c8xx megaraid_sas megaraid aic7xxx scsi_transport_spi 3w_xxxx e1000e e1000 e100 mii raid1 hid_generic usbhid hid igb i2c_algo_bit i2c_i801 dca ptp pps_core ahci libahci
[ 13.083422] general protection fault: 0000 [#2] SMP PTI
[ 13.083423] CPU: 2 PID: 553 Comm: systemd-udevd Tainted: G D 5.1.0+ #7
[ 13.083423] Hardware name: Intel Corporation S1200SP/S1200SP, BIOS S1200SP.86B.03.01.0038.062620180344 06/26/2018
[ 13.083425] RIP: 0010:strcmp+0x8/0x20
[ 13.083426] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.083430] ---[ end trace 3a1d76d272411047 ]---
[ 13.109555] RIP: 0010:strcmp+0x8/0x20
[ 13.115762] RSP: 0000:ffffb109c395fd08 EFLAGS: 00010286
[ 13.115763] RAX: ffffb109c3b5c1f0 RBX: ffffb109c3b5c230 RCX: ffffb109c3b5c1f0
[ 13.115764] RDX: ffffb109c3b55004 RSI: ffffffff89839635 RDI: 48ffb108f473c60c
[ 13.115765] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.115856] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.115946] R10: ffffb109c395fe88 R11: 0000000000000080 R12: 0000000000000027
[ 13.116037] RSP: 0018:ffffb109c3b87d08 EFLAGS: 00010286
[ 13.116134] R13: ffffb109c395fe98 R14: ffffffff89839634 R15: ffffb109c395fe98
[ 13.116229] RAX: ffffb109c3b6c1f0 RBX: ffffb109c3b6c230 RCX: ffffb109c3b6c1f0
[ 13.116326] FS: 00007f97f674c8c0(0000) GS:ffff9c009fc80000(0000) knlGS:0000000000000000
[ 13.116326] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.116327] CR2: 00007f50a4d473e6 CR3: 0000000838482002 CR4: 00000000003606e0
[ 13.116328] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.116328] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.116329] Call Trace:
[ 13.116332] find_sec+0x43/0x60
[ 13.116334] load_module+0xe3/0x2b80
[ 13.116488] RDX: ffffb109c3b65004 RSI: ffffffff89839635 RDI: 48ffb108f474c60c
[ 13.116488] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.116585] ? vfs_read+0x11d/0x140
[ 13.116676] R10: ffffb109c3b87e88 R11: 0000000000000088 R12: 0000000000000027
[ 13.116777] ? kernel_read_file+0x1b4/0x1d0
[ 13.116881] R13: ffffb109c3b87e98 R14: ffffffff89839634 R15: ffffb109c3b87e98
[ 13.116882] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd80000(0000) knlGS:0000000000000000
[ 13.117010] ? __do_sys_finit_module+0xd2/0x100
[ 13.117105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.117106] CR2: 00007f97f671ca24 CR3: 000000083900a003 CR4: 00000000003606e0
[ 13.117204] __do_sys_finit_module+0xd2/0x100
[ 13.117298] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.117402] do_syscall_64+0x55/0x100
[ 13.117492] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.117581] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 13.119124] RIP: 0033:0x7f97f55cf469
[ 13.119125] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d ff 49 2b 00 f7 d8 64 89 01 48
[ 13.119125] RSP: 002b:00007ffe1c68af28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 13.119126] RAX: ffffffffffffffda RBX: 000055a196a20bc0 RCX: 00007f97f55cf469
[ 13.119127] RDX: 0000000000000000 RSI: 00007f97f5ee8265 RDI: 0000000000000011
[ 13.119127] RBP: 00007f97f5ee8265 R08: 0000000000000000 R09: 00007ffe1c68b4a0
[ 13.119127] R10: 0000000000000011 R11: 0000000000000246 R12: 0000000000000000
[ 13.119128] R13: 000055a196a15e90 R14: 0000000000020000 R15: 000055a1962d0efc
[ 13.119982] Modules linked in: intel_cstate ipmi_si(+) intel_uncore ipmi_devintf intel_rapl_perf ipmi_msghandler mousedev input_leds intel_pch_thermal ie31200_edac parport_pc parport acpi_power_meter(+) acpi_pad pcc_cpufreq sunrpc vhost_net tun vhost tap virtio_rng ip_tables x_tables autofs4 btrfs zstd_compress raid10 multipath linear 3w_9xxx ixgbe xfrm_algo mdio via686a dm_crypt raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid0 dm_mirror dm_region_hash dm_log sym53c8xx megaraid_sas megaraid aic7xxx scsi_transport_spi 3w_xxxx e1000e e1000 e100 mii raid1 hid_generic usbhid hid igb i2c_algo_bit i2c_i801 dca ptp pps_core ahci libahci
[ 13.120036] ---[ end trace 3a1d76d272411048 ]---
[ 13.135506] cryptd: max_cpu_qlen set to 1000
[ 13.136076] BUG: unable to handle kernel paging request at 000074d19776a3d4
[ 13.147994] RIP: 0010:strcmp+0x8/0x20
[ 13.148016] #PF error: [normal kernel read fault]
[ 13.148105] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.148195] PGD 0 P4D 0
[ 13.148355] RSP: 0018:ffffb109c3b87d08 EFLAGS: 00010286
[ 13.148434] Oops: 0000 [#3] SMP PTI
[ 13.148436] CPU: 6 PID: 554 Comm: systemd-udevd Tainted: G D 5.1.0+ #7
[ 13.148527] RAX: ffffb109c3b6c1f0 RBX: ffffb109c3b6c230 RCX: ffffb109c3b6c1f0
[ 13.148615] Hardware name: Intel Corporation S1200SP/S1200SP, BIOS S1200SP.86B.03.01.0038.062620180344 06/26/2018
[ 13.148728] RDX: ffffb109c3b65004 RSI: ffffffff89839635 RDI: 48ffb108f474c60c
[ 13.148729] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.148824] RIP: 0010:strcmp+0x8/0x20
[ 13.148825] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.148944] R10: ffffb109c3b87e88 R11: 0000000000000088 R12: 0000000000000027
[ 13.149039] RSP: 0018:ffffb109c3977d08 EFLAGS: 00010286
[ 13.149148] R13: ffffb109c3b87e98 R14: ffffffff89839634 R15: ffffb109c3b87e98
[ 13.149149] FS: 00007f97f674c8c0(0000) GS:ffff9c009fc80000(0000) knlGS:0000000000000000
[ 13.149237] RAX: ffffb109c3b42a48 RBX: ffffb109c3b43108 RCX: ffffb109c3b42a48
[ 13.149238] RDX: ffffb109c3b3b004 RSI: ffffffff89839635 RDI: 000074d19776a3d5
[ 13.149391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.149391] CR2: 00007f50a4d473e6 CR3: 0000000838482002 CR4: 00000000003606e0
[ 13.149486] RBP: 000000000000001b R08: 0000000000000046 R09: 0000000000000000
[ 13.149487] R10: ffffb109c3977e88 R11: 000000000000015b R12: 000000000000002d
[ 13.149593] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.149701] R13: ffffb109c3977e98 R14: ffffffff89839634 R15: ffffb109c3977e98
[ 13.149702] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd80000(0000) knlGS:0000000000000000
[ 13.149816] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.150798] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.150798] CR2: 000074d19776a3d4 CR3: 00000008382e4004 CR4: 00000000003606e0
[ 13.150799] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.150800] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.150800] Call Trace:
[ 13.150805] find_sec+0x43/0x60
[ 13.151364] load_module+0xe3/0x2b80
[ 13.151366] ? vfs_read+0x11d/0x140
[ 13.151367] ? kernel_read_file+0x1b4/0x1d0
[ 13.151368] ? __do_sys_finit_module+0xd2/0x100
[ 13.151369] __do_sys_finit_module+0xd2/0x100
[ 13.151371] do_syscall_64+0x55/0x100
[ 13.151373] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 13.151374] RIP: 0033:0x7f97f55cf469
[ 13.152126] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d ff 49 2b 00 f7 d8 64 89 01 48
[ 13.152127] RSP: 002b:00007ffe1c68af28 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 13.152128] RAX: ffffffffffffffda RBX: 000055a196a14890 RCX: 00007f97f55cf469
[ 13.152128] RDX: 0000000000000000 RSI: 00007f97f5ee8265 RDI: 0000000000000013
[ 13.152129] RBP: 00007f97f5ee8265 R08: 0000000000000000 R09: 00007ffe1c68b4a0
[ 13.152129] R10: 0000000000000013 R11: 0000000000000246 R12: 0000000000000000
[ 13.152130] R13: 000055a196a154d0 R14: 0000000000020000 R15: 000055a1962d0efc
[ 13.152131] Modules linked in: cryptd glue_helper intel_cstate ipmi_si(+) intel_uncore ipmi_devintf intel_rapl_perf ipmi_msghandler mousedev input_leds intel_pch_thermal ie31200_edac parport_pc parport acpi_power_meter(+) acpi_pad pcc_cpufreq sunrpc vhost_net tun vhost tap virtio_rng ip_tables x_tables autofs4 btrfs zstd_compress raid10 multipath linear 3w_9xxx ixgbe xfrm_algo mdio via686a dm_crypt raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid0 dm_mirror dm_region_hash dm_log sym53c8xx megaraid_sas megaraid aic7xxx scsi_transport_spi 3w_xxxx e1000e e1000 e100 mii raid1 hid_generic usbhid hid igb i2c_algo_bit i2c_i801 dca ptp pps_core ahci libahci
[ 13.152152] CR2: 000074d19776a3d4
[ 13.152153] ---[ end trace 3a1d76d272411049 ]---
[ 13.180708] RIP: 0010:strcmp+0x8/0x20
[ 13.180803] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.180958] RSP: 0018:ffffb109c3b87d08 EFLAGS: 00010286
[ 13.181052] RAX: ffffb109c3b6c1f0 RBX: ffffb109c3b6c230 RCX: ffffb109c3b6c1f0
[ 13.181150] RDX: ffffb109c3b65004 RSI: ffffffff89839635 RDI: 48ffb108f474c60c
[ 13.181247] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.181342] R10: ffffb109c3b87e88 R11: 0000000000000088 R12: 0000000000000027
[ 13.181440] R13: ffffb109c3b87e98 R14: ffffffff89839634 R15: ffffb109c3b87e98
[ 13.181538] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd80000(0000) knlGS:0000000000000000
[ 13.181655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.181749] CR2: 000074d19776a3d4 CR3: 00000008382e4004 CR4: 00000000003606e0
[ 13.181845] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.181940] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.187350] Adding 1047548k swap on /dev/sda2. Priority:-2 extents:1 across:1047548k SSFS
[ 13.188272] Adding 1047548k swap on /dev/sdb2. Priority:-3 extents:1 across:1047548k SSFS
[ 13.188499] AVX2 version of gcm_enc/dec engaged.
[ 13.188593] AES CTR mode by8 optimization enabled
[ 13.191395] ppdev: user-space parallel port driver
[ 13.207129] BUG: unable to handle kernel paging request at ffffb10a4cf55554
[ 13.207238] #PF error: [normal kernel read fault]
[ 13.207356] PGD 83f541067 P4D 83f541067 PUD 0
[ 13.207447] Oops: 0000 [#4] SMP PTI
[ 13.207536] CPU: 5 PID: 564 Comm: systemd-udevd Tainted: G D 5.1.0+ #7
[ 13.207650] Hardware name: Intel Corporation S1200SP/S1200SP, BIOS S1200SP.86B.03.01.0038.062620180344 06/26/2018
[ 13.207770] RIP: 0010:strcmp+0x8/0x20
[ 13.207859] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.208012] RSP: 0018:ffffb109c3aabd08 EFLAGS: 00010286
[ 13.208104] RAX: ffffb109c3ad61a8 RBX: ffffb109c3ad6268 RCX: ffffb109c3ad61a8
[ 13.208199] RDX: ffffb109c3ad0004 RSI: ffffffff89839635 RDI: ffffb10a4cf55555
[ 13.208295] RBP: 0000000000000003 R08: 0000000000000046 R09: 0000000000000000
[ 13.208432] R10: ffffb109c3aabe88 R11: 0000000000000043 R12: 000000000000002b
[ 13.215764] R13: ffffb109c3aabe98 R14: ffffffff89839634 R15: ffffb109c3aabe98
[ 13.215860] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd40000(0000) knlGS:0000000000000000
[ 13.215975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.216067] CR2: ffffb10a4cf55554 CR3: 00000008382fe005 CR4: 00000000003606e0
[ 13.216163] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.216258] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.216381] Call Trace:
[ 13.216469] find_sec+0x43/0x60
[ 13.216558] load_module+0xe3/0x2b80
[ 13.216647] ? vfs_read+0x11d/0x140
[ 13.216736] ? kernel_read_file+0x1b4/0x1d0
[ 13.216826] ? __do_sys_finit_module+0xd2/0x100
[ 13.216917] __do_sys_finit_module+0xd2/0x100
[ 13.217007] do_syscall_64+0x55/0x100
[ 13.217096] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 13.217188] RIP: 0033:0x7f97f55cf469
[ 13.217277] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d ff 49 2b 00 f7 d8 64 89 01 48
[ 13.217430] RSP: 002b:00007ffe1c68ae78 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 13.217544] RAX: ffffffffffffffda RBX: 000055a196a17c40 RCX: 00007f97f55cf469
[ 13.217639] RDX: 0000000000000000 RSI: 00007f97f5ee8265 RDI: 0000000000000017
[ 13.217734] RBP: 00007f97f5ee8265 R08: 0000000000000000 R09: 000055a196a05940
[ 13.217830] R10: 0000000000000017 R11: 0000000000000246 R12: 0000000000000000
[ 13.217925] R13: 000055a196a15e90 R14: 0000000000020000 R15: 000055a1962d0efc
[ 13.218020] Modules linked in: ghash_clmulni_intel ppdev aesni_intel aes_x86_64 crypto_simd cryptd glue_helper intel_cstate ipmi_si(+) intel_uncore ipmi_devintf intel_rapl_perf ipmi_msghandler mousedev input_leds intel_pch_thermal ie31200_edac parport_pc parport acpi_power_meter(+) acpi_pad pcc_cpufreq sunrpc vhost_net tun vhost tap virtio_rng ip_tables x_tables autofs4 btrfs zstd_compress raid10 multipath linear 3w_9xxx ixgbe xfrm_algo mdio via686a dm_crypt raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid0 dm_mirror dm_region_hash dm_log sym53c8xx megaraid_sas megaraid aic7xxx scsi_transport_spi 3w_xxxx e1000e e1000 e100 mii raid1 hid_generic usbhid hid igb i2c_algo_bit i2c_i801 dca ptp pps_core ahci libahci
[ 13.218404] CR2: ffffb10a4cf55554
[ 13.218492] ---[ end trace 3a1d76d27241104a ]---
[ 13.218493] BUG: unable to handle kernel paging request at ffffb10a4cf95554
[ 13.218494] #PF error: [normal kernel read fault]
[ 13.219021] PGD 83f541067 P4D 83f541067 PUD 0
[ 13.219112] Oops: 0000 [#5] SMP PTI
[ 13.219200] CPU: 4 PID: 569 Comm: systemd-udevd Tainted: G D 5.1.0+ #7
[ 13.219314] Hardware name: Intel Corporation S1200SP/S1200SP, BIOS S1200SP.86B.03.01.0038.062620180344 06/26/2018
[ 13.219434] RIP: 0010:strcmp+0x8/0x20
[ 13.219523] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.233969] RSP: 0018:ffffb109c397fd08 EFLAGS: 00010286
[ 13.234061] RAX: ffffb109c3b161a8 RBX: ffffb109c3b16268 RCX: ffffb109c3b161a8
[ 13.234157] RDX: ffffb109c3b10004 RSI: ffffffff89839635 RDI: ffffb10a4cf95555
[ 13.234252] RBP: 0000000000000003 R08: 0000000000000046 R09: 0000000000000000
[ 13.234347] R10: ffffb109c397fe88 R11: 000000000000018e R12: 000000000000002b
[ 13.234443] R13: ffffb109c397fe98 R14: ffffffff89839634 R15: ffffb109c397fe98
[ 13.247974] RIP: 0010:strcmp+0x8/0x20
[ 13.247981] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd00000(0000) knlGS:0000000000000000
[ 13.248082] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.248196] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.248197] CR2: ffffb10a4cf95554 CR3: 0000000837834006 CR4: 00000000003606e0
[ 13.248388] RSP: 0018:ffffb109c3b87d08 EFLAGS: 00010286
[ 13.248482] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.248577] RAX: ffffb109c3b6c1f0 RBX: ffffb109c3b6c230 RCX: ffffb109c3b6c1f0
[ 13.248668] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.248668] Call Trace:
[ 13.248763] RDX: ffffb109c3b65004 RSI: ffffffff89839635 RDI: 48ffb108f474c60c
[ 13.248764] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.248861] find_sec+0x43/0x60
[ 13.248954] R10: ffffb109c3b87e88 R11: 0000000000000088 R12: 0000000000000027
[ 13.249041] load_module+0xe3/0x2b80
[ 13.249135] R13: ffffb109c3b87e98 R14: ffffffff89839634 R15: ffffb109c3b87e98
[ 13.249135] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd40000(0000) knlGS:0000000000000000
[ 13.249231] ? vfs_read+0x11d/0x140
[ 13.249317] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.249318] CR2: ffffb10a4cf55554 CR3: 00000008382fe005 CR4: 00000000003606e0
[ 13.249413] ? kernel_read_file+0x1b4/0x1d0
[ 13.249500] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.249501] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.249597] ? __do_sys_finit_module+0xd2/0x100
[ 13.250403] __do_sys_finit_module+0xd2/0x100
[ 13.250494] do_syscall_64+0x55/0x100
[ 13.250583] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 13.250675] RIP: 0033:0x7f97f55cf469
[ 13.250764] Code: 00 f3 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d ff 49 2b 00 f7 d8 64 89 01 48
[ 13.250917] RSP: 002b:00007ffe1c68ae78 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 13.251031] RAX: ffffffffffffffda RBX: 000055a196a157f0 RCX: 00007f97f55cf469
[ 13.251127] RDX: 0000000000000000 RSI: 00007f97f5ee8265 RDI: 0000000000000017
[ 13.251222] RBP: 00007f97f5ee8265 R08: 0000000000000000 R09: 000055a196a05940
[ 13.251318] R10: 0000000000000017 R11: 0000000000000246 R12: 0000000000000000
[ 13.251413] R13: 000055a196a1a550 R14: 0000000000020000 R15: 000055a1962d0efc
[ 13.251509] Modules linked in: ghash_clmulni_intel ppdev aesni_intel aes_x86_64 crypto_simd cryptd glue_helper intel_cstate ipmi_si(+) intel_uncore ipmi_devintf intel_rapl_perf ipmi_msghandler mousedev input_leds intel_pch_thermal ie31200_edac parport_pc parport acpi_power_meter(+) acpi_pad pcc_cpufreq sunrpc vhost_net tun vhost tap virtio_rng ip_tables x_tables autofs4 btrfs zstd_compress raid10 multipath linear 3w_9xxx ixgbe xfrm_algo mdio via686a dm_crypt raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid0 dm_mirror dm_region_hash dm_log sym53c8xx megaraid_sas megaraid aic7xxx scsi_transport_spi 3w_xxxx e1000e e1000 e100 mii raid1 hid_generic usbhid hid igb i2c_algo_bit i2c_i801 dca ptp pps_core ahci libahci
[ 13.251897] CR2: ffffb10a4cf95554
[ 13.251986] ---[ end trace 3a1d76d27241104b ]---
[ 13.281769] RIP: 0010:strcmp+0x8/0x20
[ 13.281881] Code: d0 48 89 d0 75 e9 48 85 d2 74 05 c6 44 17 ff 00 48 c7 c0 f9 ff ff ff c3 c3 c3 0f 1f 84 00 00 00 00 00 48 83 c7 01 48 83 c6 01 <0f> b6 47 ff 3a 46 ff 75 07 84 c0 75 eb 31 c0 c3 19 c0 83 c8 01 c3
[ 13.282034] RSP: 0018:ffffb109c3b87d08 EFLAGS: 00010286
[ 13.282126] RAX: ffffb109c3b6c1f0 RBX: ffffb109c3b6c230 RCX: ffffb109c3b6c1f0
[ 13.282222] RDX: ffffb109c3b65004 RSI: ffffffff89839635 RDI: 48ffb108f474c60c
[ 13.282317] RBP: 0000000000000001 R08: 0000000000000046 R09: 0000000000000000
[ 13.282413] R10: ffffb109c3b87e88 R11: 0000000000000088 R12: 0000000000000027
[ 13.282508] R13: ffffb109c3b87e98 R14: ffffffff89839634 R15: ffffb109c3b87e98
[ 13.282604] FS: 00007f97f674c8c0(0000) GS:ffff9c009fd00000(0000) knlGS:0000000000000000
[ 13.282718] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 13.282811] CR2: ffffb10a4cf95554 CR3: 0000000837834006 CR4: 00000000003606e0
[ 13.282906] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 13.283001] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 13.418120] intel_rapl: Found RAPL domain package
[ 13.418254] intel_rapl: Found RAPL domain core
[ 13.418397] intel_rapl: Found RAPL domain dram
[ 13.522069] ipmi_si dmi-ipmi-si.0: IPMI message handler: Found new BMC (man_id: 0x000157, prod_id: 0x0078, dev_id: 0x21)
[ 13.537609] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized
[ 14.100468] power_meter ACPI000D:00: Found ACPI power meter.
[ 14.100582] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[ 14.208173] power_meter ACPI000D:00: Found ACPI power meter.
[ 14.208298] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[ 14.308088] audit: type=1400 audit(1562270596.715:2): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/sbin/haveged" pid=844 comm="apparmor_parser" name="/usr/sbin/haveged" offset=127
[ 14.337522] audit: type=1400 audit(1562270596.747:3): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/bin/lxc-start" pid=849 comm="apparmor_parser" name="/usr/bin/lxc-start" offset=147
[ 14.342450] audit: type=1400 audit(1562270596.751:4): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/sbin/named" pid=845 comm="apparmor_parser" name="/usr/sbin/named" offset=125
[ 14.363966] audit: type=1400 audit(1562270596.771:5): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/sbin/ntpd" pid=847 comm="apparmor_parser" name="/usr/sbin/ntpd" offset=124
[ 14.405219] openvswitch: Open vSwitch switching datapath
[ 14.490846] audit: type=1400 audit(1562270596.899:6): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="lxc-container-default" pid=846 comm="apparmor_parser" name="lxc-container-default" offset=150
[ 14.504621] audit: type=1400 audit(1562270596.915:7): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/bin/lxc-start" pid=895 comm="apparmor_parser" name="/usr/bin/lxc-start" offset=147
[ 14.523387] audit: type=1400 audit(1562270596.931:8): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/sbin/haveged" pid=896 comm="apparmor_parser" name="/usr/sbin/haveged" offset=127
[ 14.538648] audit: type=1400 audit(1562270596.947:9): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/sbin/named" pid=897 comm="apparmor_parser" name="/usr/sbin/named" offset=125
[ 14.544905] audit: type=1400 audit(1562270596.955:10): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="/usr/sbin/ntpd" pid=898 comm="apparmor_parser" name="/usr/sbin/ntpd" offset=124
[ 14.668339] audit: type=1400 audit(1562270597.075:11): apparmor="STATUS" info="failed to unpack end of profile" error=-71 profile="unconfined" name="lxc-container-default" pid=893 comm="apparmor_parser" name="lxc-container-default" offset=150
[ 14.682633] Process accounting resumed
[ 14.690347] random: crng init done
[ 14.690463] random: 7 urandom warning(s) missed due to ratelimiting
[ 14.704788] new mount options do not match the existing superblock, will be ignored
[ 14.710282] fuse init (API version 7.29)
[...]
Corrupt binaries when packaging with makepkg (arch linux's build tool)
the packages compile fine, but when the package() is called (present in all PKGBUILDS), results in corrupt packages both in pkg/ and the resulting pkg.tar.whatever .
cp -ar in /tmp (a tmpfs mount in arch), deleting pkg/ and repackaging with makepkg -R results in a non corrupt package.
as always if you need any help to set up arch, you have my tele
BCacheFS 5.0 rebase fails to build ~ failure on building drivers/staging/media/ipu3/ipu3-dmamap.c
I get this error with building the BCacheFS 5.0 rebase, but not from the 5.0 kernel, with or without the stable patches:
I use this kernel config file for both (.txt extension because GitHub complains, otherwise):
unable to handle kernel paging request: anon_unlink_vmas
During a boot attempt today I had this occur, the next boot went fine.
(Didn't land in persistent storage, sorry for the screenshots.)
Commit was 1f34297.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.