[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

Bug#960322: mdadm: Debian 10.4-kernel 4.19.0-9 update no longer mounting mdadm array at boot



Package: mdadm
Version: 4.1-1
Severity: normal

Dear Maintainer,

   * What led up to the situation?

Updating to Debian 10.4

   * What exactly did you do (or not do) that was effective (or
     ineffective)?

I issues the command to upgrade from a fresh install of Debian 10.3 to 10.4.
(sudo apt upgrade)

   * What was the outcome of this action?

Previously working mdadm array was no longer being mounted at boot.

   * What outcome did you expect instead?

That upgrading to Debian 10.4 would auto-mount my mdadm array at boot.

Lastly, I've been using Linux for a couple of years and still consider myself a
total newbie. I've done numerous kernel upgrades while running Mint, Manjaro,
Arch, Ubuntu, etc., and never had my array fail to auto-mount at boot after
kernel updates. Except ONE other time. And the fix then, like now, was to
simply revert to the previous kernel. Since I've only been using vanilla Debian
for about a week, do I need to issue some command after a kernel update is
applied and before I reboot (to make sure my mounted mdadm array comes back)? I
noticed the kernel in 10.3 was 4.19.0-8 and 10.4 has 4.19.0-9. Maybe there's a
bug with -9 and mdadm arrays or I'm just a newbie and should have typed:
update-initramfs -u  after getting kernel updates?



-- Package-specific info:
--- mdadm.conf
HOMEHOST <system>
MAILADDR root
ARRAY /dev/md/0 metadata=1.2 spares=1 name=server-pc:0 UUID=ab816d7f-8aa0-43c2-ad8d-73bc675b6a34

--- /etc/default/mdadm
AUTOCHECK=true
START_DAEMON=true
DAEMON_OPTIONS="--syslog"
VERBOSE=false

--- /proc/mdstat:
Personalities : [raid6] [raid5] [raid4] [linear] [multipath] [raid0] [raid1] [raid10] 
md0 : active raid6 sdi[7] sdp[12](S) sda[8] sdf[10] sdo[14] sdn[13] sdj[11] sdl[4] sdk[0] sde[9] sdd[6] sdh[3] sdb[2] sdc[5] sdg[1]
      46882646016 blocks super 1.2 level 6, 512k chunk, algorithm 2 [14/14] [UUUUUUUUUUUUUU]
      bitmap: 0/30 pages [0KB], 65536KB chunk

unused devices: <none>

--- /proc/partitions:
major minor  #blocks  name

  65        0  468851544 sdq
  65        1  468849664 sdq1
  65       16  488386584 sdr
  65       17  488384512 sdr1
   8      192  125034840 sdm
   8      208 3907018584 sdn
   8      224 3907018584 sdo
   8      112 3907018584 sdh
   8       32 3907018584 sdc
   8       64 3907018584 sde
   8      160 3907018584 sdk
   8       16 3907018584 sdb
   8       96 3907018584 sdg
   8       48 3907018584 sdd
   8      128 3907018584 sdi
   8        0 3907018584 sda
   8       80 3907018584 sdf
   8      240 3907018584 sdp
   8      144 3907018584 sdj
   8      176 3907018584 sdl
   9        0 46882646016 md0

--- LVM physical volumes:
LVM does not seem to be used.
--- mount output
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
udev on /dev type devtmpfs (rw,nosuid,relatime,size=8132532k,nr_inodes=2033133,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,noexec,relatime,size=1630640k,mode=755)
/dev/sdr1 on / type xfs (rw,relatime,attr2,inode64,noquota)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup2 on /sys/fs/cgroup/unified type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=33,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13172)
mqueue on /dev/mqueue type mqueue (rw,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
sunrpc on /run/rpc_pipefs type rpc_pipefs (rw,relatime)
nfsd on /proc/fs/nfsd type nfsd (rw,relatime)
/dev/sdq1 on /mnt/timeshift type xfs (rw,relatime,attr2,inode64,noquota)
/dev/sdm on /mnt/sparessd type xfs (rw,relatime,attr2,inode64,noquota)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,relatime)
/dev/md0 on /mnt/md0 type xfs (rw,relatime,attr2,inode64,sunit=1024,swidth=6144,noquota)
192.168.1.6:/mnt/backup on /mnt/rosewill type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=900,retrans=5,sec=sys,clientaddr=192.168.1.5,local_lock=none,addr=192.168.1.6,_netdev)
tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=1630636k,mode=700,uid=1000,gid=1000)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000)

--- initrd.img-4.19.0-8-amd64:
246054 blocks
22e9d55a0719a1fb7568aae1ce23d296  ./etc/mdadm/mdadm.conf
22e9d55a0719a1fb7568aae1ce23d296  ./etc/mdadm/mdadm.conf.tmp
d3be82c0f275d6c25b04d388baf9e836  ./etc/modprobe.d/mdadm.conf
f3b648ca1c912da30940f0b821b7e9e6  ./scripts/local-block/mdadm
192ccafcfe38eabf0f5184786764c4a9  ./scripts/local-bottom/mdadm
900a0273bb21b3874ff4301e69d065f9  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/dm-mod.ko
07417998fbc263b9a49f171503624e33  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/linear.ko
f7c0a5e4b7ae3a9f206e52d2f65c8016  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/md-mod.ko
4a1b80494b924a3126c0dc3c7e301bbe  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/multipath.ko
8f59e9da9c9a43431002ae666d521bbf  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/raid0.ko
d1da9b5daeec9bd387b20401ce319e77  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/raid1.ko
68b6ae5d049ded2b37ea1c7ac81fce41  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/raid10.ko
6d8365ce3d0099eca9851af45a014fad  ./usr/lib/modules/4.19.0-8-amd64/kernel/drivers/md/raid456.ko
d325a636dd5d9c95289b6653eb1fb070  ./usr/sbin/mdadm

--- initrd's /conf/conf.d/md:
no conf/md file.

--- /proc/modules:
dm_mod 155648 0 - Live 0xffffffffc1037000
raid10 57344 0 - Live 0xffffffffc04fc000
raid1 45056 0 - Live 0xffffffffc0374000
raid0 20480 0 - Live 0xffffffffc036a000
multipath 16384 0 - Live 0xffffffffc0347000
linear 16384 0 - Live 0xffffffffc0350000
raid456 172032 1 - Live 0xffffffffc0436000
async_raid6_recov 20480 1 raid456, Live 0xffffffffc0341000
async_memcpy 16384 2 raid456,async_raid6_recov, Live 0xffffffffc0261000
async_pq 16384 2 raid456,async_raid6_recov, Live 0xffffffffc025c000
async_xor 16384 3 raid456,async_raid6_recov,async_pq, Live 0xffffffffc015b000
async_tx 16384 5 raid456,async_raid6_recov,async_memcpy,async_pq,async_xor, Live 0xffffffffc0156000
raid6_pq 122880 4 btrfs,raid456,async_raid6_recov,async_pq, Live 0xffffffffc01fe000
libcrc32c 16384 3 xfs,btrfs,raid456, Live 0xffffffffc0098000
md_mod 167936 7 raid10,raid1,raid0,multipath,linear,raid456, Live 0xffffffffc040c000
raid_class 16384 1 mpt3sas, Live 0xffffffffc02ba000
scsi_mod 249856 7 sg,ses,sd_mod,mpt3sas,raid_class,scsi_transport_sas,libata, Live 0xffffffffc00b1000

--- /var/log/syslog:

--- volume detail:
/dev/sda:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250800 sectors, after=11952 sectors
          State : clean
    Device UUID : 1389c218:8502262d:c78b84df:a3ebdb08

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : da7b7f56 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 11
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdb:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 82ae41b5:8803ea77:1ef41473:922f4320

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 6cb65239 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 2
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdc:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 30ff1b07:133b549c:1aa091a5:ab050bb8

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : ad3f5c8a - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 5
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdd:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 2598e323:ce69248a:2abfde73:4eb6c37c

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 4adcf3ee - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 6
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sde:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250800 sectors, after=11952 sectors
          State : clean
    Device UUID : 1fd318fe:57c91391:e9b0de39:b48766c7

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : 3ca4516a - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 10
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdf:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250800 sectors, after=11952 sectors
          State : clean
    Device UUID : 875a75ab:53c2a6d5:86f33eb4:2b491adf

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : c0a7d5e3 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 9
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdg:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 3769675c:c567b873:8aba17f8:f078f234

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : a95c80f4 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdh:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : ba0e4429:53584793:d21f0bb4:e29c5748

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 6520a041 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 3
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdi:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : df802302:3ed2feb9:167ff372:39aad85b

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 3720f8f0 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 7
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdj:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250800 sectors, after=11952 sectors
          State : clean
    Device UUID : 92432d84:cd9eb66d:52460d33:076cacf1

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : c2d01110 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 8
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdk:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 3fece8f7:11633e36:5c96855e:e8d2d80b

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 44b83511 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 0
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdl:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 2d610eb8:f5378c90:bcd28f86:f7573a0c

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 87974056 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 4
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdm is not recognised by mdadm.
/dev/sdn:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250800 sectors, after=11952 sectors
          State : clean
    Device UUID : 455e1c8a:a8acfe82:9977fdf0:41f3d2ac

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : 571df222 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 13
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdo:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250800 sectors, after=11952 sectors
          State : clean
    Device UUID : fff42d5b:ca42cc5a:69e83320:0936568b

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 13:58:30 2020
  Bad Block Log : 512 entries available at offset 24 sectors
       Checksum : db6d296 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 12
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdp:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 99c9ad61:911cb77d:7d7d831d:032e2eee
           Name : server-pc:0  (local to host server-pc)
  Creation Time : Sat Dec  2 21:22:25 2017
     Raid Level : raid6
   Raid Devices : 14

 Avail Dev Size : 7813786288 (3725.90 GiB 4000.66 GB)
     Array Size : 46882646016 (44710.78 GiB 48007.83 GB)
  Used Dev Size : 7813774336 (3725.90 GiB 4000.65 GB)
    Data Offset : 250880 sectors
   Super Offset : 8 sectors
   Unused Space : before=250792 sectors, after=11952 sectors
          State : clean
    Device UUID : 29a979d5:bbe6cfac:3190679e:30d9f534

Internal Bitmap : 8 sectors from superblock
    Update Time : Mon May 11 10:49:03 2020
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 1d94968 - correct
         Events : 39807

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : spare
   Array State : AAAAAAAAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
--
/dev/sdq:
   MBR Magic : aa55
Partition[0] :    937703087 sectors at            1 (type ee)
--
/dev/sdq1 is not recognised by mdadm.
/dev/sdr:
   MBR Magic : aa55
Partition[0] :    976769024 sectors at         2048 (type 83)
--
/dev/sdr1 is not recognised by mdadm.

--- /proc/cmdline
BOOT_IMAGE=/boot/vmlinuz-4.19.0-8-amd64 root=UUID=5f106fd3-99e0-4e9b-8061-c379048e9863 ro quiet

--- grub2:
set root='hd17,msdos1'
set root='hd17,msdos1'
	set root='hd17,msdos1'
	linux	/boot/vmlinuz-4.19.0-9-amd64 root=UUID=5f106fd3-99e0-4e9b-8061-c379048e9863 ro  quiet
		set root='hd17,msdos1'
		linux	/boot/vmlinuz-4.19.0-8-amd64 root=UUID=5f106fd3-99e0-4e9b-8061-c379048e9863 ro  quiet
		set root='hd17,msdos1'
		linux	/boot/vmlinuz-4.19.0-8-amd64 root=UUID=5f106fd3-99e0-4e9b-8061-c379048e9863 ro single 
		set root='hd17,msdos1'
		linux	/boot/vmlinuz-4.19.0-9-amd64 root=UUID=5f106fd3-99e0-4e9b-8061-c379048e9863 ro  quiet
		set root='hd17,msdos1'
		linux	/boot/vmlinuz-4.19.0-9-amd64 root=UUID=5f106fd3-99e0-4e9b-8061-c379048e9863 ro single 

--- udev:
ii  udev           241-7~deb10u4 amd64        /dev/ and hotplug management daemon
9d7dfcdc58fa54941f8d28f6094a7a5b  /lib/udev/rules.d/01-md-raid-creating.rules
aa83f41de49462d05e446cfc5e14e74b  /lib/udev/rules.d/63-md-raid-arrays.rules
904bb2cce2cfd4a2c94aa957e7968e16  /lib/udev/rules.d/64-md-raid-assembly.rules
ba1d376ca9b7364576f950d06ba18207  /lib/udev/rules.d/69-md-clustered-confirm-device.rules
745ed418fa58498790836a08c627e1ca  /lib/udev/rules.d/99-systemd.rules

--- /dev:
brw-rw---- 1 root disk 9, 0 May 11 09:00 /dev/md0

/dev/disk/by-id:
total 0
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1334PEJT189S -> ../../sde
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1334PEJT72BS -> ../../sdc
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1334PEJT76AS -> ../../sdg
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1334PEJT8TSS -> ../../sdd
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1334PEJT8WZS -> ../../sdb
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1334PEJTB0US -> ../../sdh
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HDN724040ALE640_PK1338P4HWVJ1B -> ../../sdk
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HMS5C4040ALE640_PL1331LAGTP6EH -> ../../sdj
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-HGST_HMS5C4040ALE640_PL1331LAGTWEXH -> ../../sdl
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-Samsung_SSD_840_PRO_Series_S1ANNSAF800288F -> ../../sdm
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-Samsung_SSD_860_EVO_500GB_S59UNJ0N301201R -> ../../sdr
lrwxrwxrwx 1 root root 10 May 11 09:00 ata-Samsung_SSD_860_EVO_500GB_S59UNJ0N301201R-part1 -> ../../sdr1
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-SanDisk_SDSSDHII480G_153706801248 -> ../../sdq
lrwxrwxrwx 1 root root 10 May 11 09:00 ata-SanDisk_SDSSDHII480G_153706801248-part1 -> ../../sdq1
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-TOSHIBA_HDWE140_Y6D6KTJVF58D -> ../../sdp
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-TOSHIBA_HDWE140_Y6L4KO61F58D -> ../../sdf
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-TOSHIBA_HDWQ140_47U4Y08OFPBE -> ../../sdi
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-TOSHIBA_HDWQ140_57L3K1OKFPBE -> ../../sda
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-WDC_WD40EFRX-68N32N0_WD-WCC7K5LYCPKT -> ../../sdn
lrwxrwxrwx 1 root root  9 May 11 09:00 ata-WDC_WD40EFRX-68N32N0_WD-WCC7K7ST8XKD -> ../../sdo
lrwxrwxrwx 1 root root  9 May 11 09:00 md-name-server-pc:0 -> ../../md0
lrwxrwxrwx 1 root root  9 May 11 09:00 md-uuid-99c9ad61:911cb77d:7d7d831d:032e2eee -> ../../md0
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x500003976b88247b -> ../../sdf
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x500003976b981675 -> ../../sdp
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x50000397bcf0048e -> ../../sdi
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x50000397cb8011d3 -> ../../sda
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca22ecb3884 -> ../../sdj
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca22ecb4ff2 -> ../../sdl
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca249dac111 -> ../../sdk
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca250e71cac -> ../../sde
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca250e7327a -> ../../sdc
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca250e732f5 -> ../../sdg
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca250e738f1 -> ../../sdd
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca250e73955 -> ../../sdb
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5000cca250e7414e -> ../../sdh
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x50014ee211ecdbb7 -> ../../sdo
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x50014ee267423757 -> ../../sdn
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5001b44ed538a460 -> ../../sdq
lrwxrwxrwx 1 root root 10 May 11 09:00 wwn-0x5001b44ed538a460-part1 -> ../../sdq1
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x50025385a028e91b -> ../../sdm
lrwxrwxrwx 1 root root  9 May 11 09:00 wwn-0x5002538e30316023 -> ../../sdr
lrwxrwxrwx 1 root root 10 May 11 09:00 wwn-0x5002538e30316023-part1 -> ../../sdr1

/dev/disk/by-partuuid:
total 0
lrwxrwxrwx 1 root root 10 May 11 09:00 8cfbd718-01 -> ../../sdr1
lrwxrwxrwx 1 root root 10 May 11 09:00 9d596b53-5bba-4dc4-8b97-001ea588618c -> ../../sdq1

/dev/disk/by-path:
total 0
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:00:17.0-ata-1 -> ../../sdq
lrwxrwxrwx 1 root root 10 May 11 09:00 pci-0000:00:17.0-ata-1-part1 -> ../../sdq1
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:00:17.0-ata-2 -> ../../sdr
lrwxrwxrwx 1 root root 10 May 11 09:00 pci-0000:00:17.0-ata-2-part1 -> ../../sdr1
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy14-lun-0 -> ../../sda
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy15-lun-0 -> ../../sdb
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy16-lun-0 -> ../../sdc
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy17-lun-0 -> ../../sdd
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy20-lun-0 -> ../../sde
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy21-lun-0 -> ../../sdf
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy22-lun-0 -> ../../sdg
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy23-lun-0 -> ../../sdh
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy26-lun-0 -> ../../sdi
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy27-lun-0 -> ../../sdj
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy28-lun-0 -> ../../sdk
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy29-lun-0 -> ../../sdl
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy30-lun-0 -> ../../sdm
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy33-lun-0 -> ../../sdn
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy34-lun-0 -> ../../sdo
lrwxrwxrwx 1 root root  9 May 11 09:00 pci-0000:01:00.0-sas-exp0x50030480010c9a7f-phy35-lun-0 -> ../../sdp

/dev/disk/by-uuid:
total 0
lrwxrwxrwx 1 root root 10 May 11 09:00 5f106fd3-99e0-4e9b-8061-c379048e9863 -> ../../sdr1
lrwxrwxrwx 1 root root  9 May 11 09:00 ab816d7f-8aa0-43c2-ad8d-73bc675b6a34 -> ../../md0
lrwxrwxrwx 1 root root  9 May 11 09:00 d2b035ab-aa40-427b-8729-af483ccf91ad -> ../../sdm
lrwxrwxrwx 1 root root 10 May 11 09:00 f434e069-2834-468f-98e6-c9e7352f73c3 -> ../../sdq1

/dev/md:
total 0
lrwxrwxrwx 1 root root 6 May 11 09:00 0 -> ../md0

Auto-generated on Mon, 11 May 2020 14:44:15 -0400 by mdadm bugscript

-- System Information:
Debian Release: 10.4
  APT prefers stable-updates
  APT policy: (500, 'stable-updates'), (500, 'stable')
Architecture: amd64 (x86_64)

Kernel: Linux 4.19.0-8-amd64 (SMP w/8 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages mdadm depends on:
ii  debconf [debconf-2.0]  1.5.71
ii  libc6                  2.28-10
ii  lsb-base               10.2019051400
ii  udev                   241-7~deb10u4

Versions of packages mdadm recommends:
ii  exim4-daemon-light [mail-transport-agent]  4.92-8+deb10u3
ii  kmod                                       26-1

Versions of packages mdadm suggests:
pn  dracut-core  <none>

-- debconf information:
  mdadm/autocheck: true
  mdadm/start_daemon: true
  mdadm/mail_to: root


Reply to: