09.09.2013

6816

Backup mit tar legt System lahm

Hallo,

ich versuche hier verzweifelt ein Backup unseres Debian Servers einzurichten.
Leider legt tar nach einigen Minuten das komplette System lahm.
Ich habe schon mit cpulimit gearbeitet, mit nice und mit ionice.
Leider ohne Erfolg, nach einigen Minuten geht der Load hoch und man kann den Server nicht mehr benutzen.

Das sieht dann so aus:

top - 16:19:14 up 11 days, 6:26, 1 user, load average: 4.06, 1.75, 0.89
Tasks: 309 total, 1 running, 308 sleeping, 0 stopped, 0 zombie
Cpu0 : 0.7%us, 0.0%sy, 0.0%ni, 0.0%id, 99.0%wa, 0.0%hi, 0.3%si, 0.0%st
Cpu1 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu2 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu3 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu4 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu5 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu6 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu7 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu8 : 0.3%us, 0.0%sy, 0.0%ni, 99.7%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu9 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu10 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Cpu11 : 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 65520920k total, 65070044k used, 450876k free, 2952248k buffers
Swap: 33553328k total, 54864k used, 33498464k free, 45617824k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1946 mysql 20 0 13.9g 8.9g 8164 S 0 14.2 4701:37 mysqld
6642 root 39 19 597m 568m 1056 D 0 0.9 0:05.68 tar
6477 popuser 20 0 121m 53m 2856 S 0 0.1 0:00.81 spamd
6526 popuser 20 0 120m 53m 2836 S 0 0.1 0:02.95 spamd
6524 root 20 0 116m 48m 2396 S 0 0.1 0:06.44 spamd
10974 bind 20 0 287m 31m 2416 S 0 0.0 0:00.61 named
12257 root 20 0 283m 28m 10m S 0 0.0 1:21.18 apache2
6253 www-data 20 0 284m 20m 2632 S 0 0.0 0:00.10 apache2
6259 www-data 20 0 284m 20m 2676 D 0 0.0 0:00.10 apache2
6303 www-data 20 0 284m 20m 2028 S 0 0.0 0:00.12 apache2
6888 www-data 20 0 284m 20m 2004 S 0 0.0 0:00.02 apache2
6254 www-data 20 0 284m 20m 1996 S 0 0.0 0:00.09 apache2
6291 www-data 20 0 284m 20m 2016 D 0 0.0 0:00.08 apache2
6491 www-data 20 0 284m 20m 2012 S 0 0.0 0:00.05 apache2
6926 psaadm 20 0 239m 20m 11m S 0 0.0 0:00.06 sw-engine-cgi
6247 www-data 20 0 284m 20m 2008 S 0 0.0 0:00.07 apache2
6889 www-data 20 0 284m 20m 1996 S 0 0.0 0:00.01 apache2
6887 www-data 20 0 284m 20m 1916 S 0 0.0 0:00.01 apache2

Bitte markiere auch die Kommentare, die zur Lösung des Beitrags beigetragen haben

Content-ID: 216457

Url: https://administrator.de/forum/backup-mit-tar-legt-system-lahm-216457.html

Ausgedruckt am: 24.12.2024 um 14:12 Uhr

21 Kommentare

Neuester Kommentar

Hi,

Also die Ausgabe von "top" sieht doch gut aus. Nur ein kern ist 99%wa, sprich tar wartet auf die Festplatten.
Falls jetzt noch was auf die gleiche Platte zugreift, kommt es nachtürlich zu kleineren Wartezeiten. Zugriffe auf nicht am Backup beteiligte Platten sollten ohne Probleme funktionieren.

Was versuchst du zu backupen? Ich sehe nämlich noch mysql laufen. Das verträgt es gar nicht mit tar im laufenden Betrieb gesichert zu werden.

mfg

Cthluhu

Das ist ein Shopsystem (osCommerce), was halt täglich gesichert werden soll, vor allem auch die MySQL.
Der Rest sind mittels Plesk eingerichtet Websites.

Leider ist die angesprochene Wartezeit dann nach einiger Zeit schon knapp eine Minute, was im laufenden Betrieb nicht akzeptabel ist.
Und wenn dann das Backup noch etwas weiter läuft geht dann gar nichts mehr.
Ich habe noch kein Backup geschafft, zuvor erliegt der Server leider immer.

Zur Zeit werden die Websites und die Datenbank per winSCP auf unseren lokalen Windows Server gesichert, das läuft, aber ist nicht wirklich das was will.
Eigentlich soll ein inkrementelles Backup auf unserem Backup-ftp erstellt werden, aber ich bekomme das nicht hin.

Ich hatte schon überlegt einfach einen zweiten Server zu nehmen und dann alles spiegeln, aber es muss doch auch so irgend wie gehen.

moin,

was sagt den iotop?

von wo nach wo geht denn der Backup?

und eine sql-db soltle man dumpen und dnn den dump sichern und nciht die laufende db. das gibt nur inkonsistenzen.

Ein rsync auf ein zweites Sytsme oder eine zweite Platte, die nur für backups da ist, wirkt da manchmal wunder.

lks

iotop bleibt leider auch hängen, aber es scheint tar beim Lesen zu sein der 100% io auslastet.
Das Backup soll per sftp auf ein Backup-ftp, derzeit mit tartarus.
Der Server und der Backup-ftp stehen beide bei Hetzner.
MySQL wird natürlich als dump gesichert.

Zitat von @AS-N00:

Das Backup soll per sftp auf ein Backup-ftp, derzeit mit tartarus.

ich kenne tartarus nicht (habe es bei hetznwe auch nie benutzt), aber piped es den tar-output direkt auf den ftpserver (in die datenverbindung)? oder arbeitet es mit temporären Zwischendateien.

eventuell läuft einfach ein filesystem voll ( /var oder /tmp oder gar / selbst).

laß mal ein watch -d df -vh mitlaufen, um zu sehen, ob sich da was tut.

lks

PS: Ich lasse tar backups entweder in ein eigenes filesystem reinlaufen oder schiebe sie per netcat auf ein anderes System.

Das Backup wird direkt auf dem ftp erstellt, es gibt kein temporäres Verzeichnis auf dem Server.
Ich habe das gerade nochmal mit watch verifiziert, filesysteme liegen bei maximal 53% und es ändert sich beim Lauf des Backups auch nichts.

Schau mal die Ausgabe von dmesg an. Vllt hat die Platte einen knacks und kann einzelne Sektoren nicht mehr lesen. Das würde dann dort drin stehn.

Du erstellst das Backup direkt auf den FTP? Kann es sein, dass da mal die Verbindung kurz abbricht? Kann es sein, dass der Server nur hängt, weil tar die Netzwerkverbingung auch ausfährt und alles andere (z.B. ssh) zuwenig response-time hat?

Wie erstellst du das tar-Archiv? Das kann schonmal probleme machen, wenn aus versehen sachen wie /proc /dev oder /sys mit gesichert werden.

Hallo,

ich habe jetzt das Backup mal lokal erstellen lassen, leider gleicher Effekt, das System hängt nach wenigen Minuten.
/proc /dev /sys werden nicht gesichert.

Hier die Ausgabe von dmesg:

EH complete
[988275.837977] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988275.838016] ata2.00: irq_stat 0x40000008
[988275.838046] ata2.00: failed command: READ FPDMA QUEUED
[988275.838083] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988275.838085] res 41/40:20:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988275.838182] ata2.00: status: { DRDY ERR }
[988275.838211] ata2.00: error: { UNC }
[988275.839778] ata2.00: configured for UDMA/133
[988275.839817] ata2: EH complete
[988278.900493] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988278.900530] ata2.00: irq_stat 0x40000008
[988278.900561] ata2.00: failed command: READ FPDMA QUEUED
[988278.900597] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988278.900599] res 41/40:20:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988278.900696] ata2.00: status: { DRDY ERR }
[988278.900724] ata2.00: error: { UNC }
[988278.939529] ata2.00: configured for UDMA/133
[988278.939571] ata2: EH complete
[988282.234808] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988282.234847] ata2.00: irq_stat 0x40000008
[988282.234877] ata2.00: failed command: READ FPDMA QUEUED
[988282.234915] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988282.234917] res 41/40:20:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988282.235014] ata2.00: status: { DRDY ERR }
[988282.235042] ata2.00: error: { UNC }
[988282.256239] ata2.00: configured for UDMA/133
[988282.256281] ata2: EH complete
[988285.371691] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988285.371729] ata2.00: irq_stat 0x40000008
[988285.371759] ata2.00: failed command: READ FPDMA QUEUED
[988285.371796] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988285.371798] res 41/40:20:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988285.371895] ata2.00: status: { DRDY ERR }
[988285.371924] ata2.00: error: { UNC }
[988285.373591] ata2.00: configured for UDMA/133
[988285.373633] ata2: EH complete
[988288.780159] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988288.780197] ata2.00: irq_stat 0x40000008
[988288.780228] ata2.00: failed command: READ FPDMA QUEUED
[988288.780263] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988288.780266] res 41/40:20:10:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988288.780362] ata2.00: status: { DRDY ERR }
[988288.780390] ata2.00: error: { UNC }
[988288.782049] ata2.00: configured for UDMA/133
[988288.782090] sd 1:0:0:0: [sdb] Unhandled sense code
[988288.782119] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[988288.782172] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[988288.782236] Descriptor sense data with sense descriptors (in hex):
[988288.782271] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[988288.782373] 64 20 eb 10
[988288.782420] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[988288.782480] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 20 ea f8 00 00 20 00
[988288.782567] end_request: I/O error, dev sdb, sector 1679878928
[988288.782601] raid1: sdb3: rescheduling sector 1611715320
[988288.782644] ata2: EH complete
[988291.588639] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988291.588677] ata2.00: irq_stat 0x40000008
[988291.588707] ata2.00: failed command: READ FPDMA QUEUED
[988291.588743] ata2.00: cmd 60/08:00:08:eb:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988291.588745] res 41/40:08:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988291.588844] ata2.00: status: { DRDY ERR }
[988291.588872] ata2.00: error: { UNC }
[988291.590318] ata2.00: configured for UDMA/133
[988291.590359] ata2: EH complete
[988294.172039] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988294.172075] ata2.00: irq_stat 0x40000008
[988294.172105] ata2.00: failed command: READ FPDMA QUEUED
[988294.172142] ata2.00: cmd 60/08:00:08:eb:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988294.172144] res 41/40:08:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988294.172241] ata2.00: status: { DRDY ERR }
[988294.172269] ata2.00: error: { UNC }
[988294.173902] ata2.00: configured for UDMA/133
[988294.173941] ata2: EH complete
[988296.755526] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988296.755563] ata2.00: irq_stat 0x40000008
[988296.755593] ata2.00: failed command: READ FPDMA QUEUED
[988296.755630] ata2.00: cmd 60/08:00:08:eb:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988296.755632] res 41/40:08:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988296.755729] ata2.00: status: { DRDY ERR }
[988296.755757] ata2.00: error: { UNC }
[988296.757404] ata2.00: configured for UDMA/133
[988296.757444] ata2: EH complete
[988297.648134] raid1: sdb3: redirecting sector 1611715320 to another mirror
[988300.529431] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988300.529470] ata2.00: irq_stat 0x40000008
[988300.529500] ata2.00: failed command: READ FPDMA QUEUED
[988300.529537] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988300.529539] res 41/40:20:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988300.529635] ata2.00: status: { DRDY ERR }
[988300.529663] ata2.00: error: { UNC }
[988300.530991] ata2.00: configured for UDMA/133
[988300.531030] ata2: EH complete
[988304.064157] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988304.064195] ata2.00: irq_stat 0x40000008
[988304.064225] ata2.00: failed command: READ FPDMA QUEUED
[988304.064262] ata2.00: cmd 60/20:00:f8:ea:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988304.064264] res 41/40:20:08:eb:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988304.064363] ata2.00: status: { DRDY ERR }
[988304.064391] ata2.00: error: { UNC }
[988304.065818] ata2.00: configured for UDMA/133
[988304.065856] ata2: EH complete
[988325.619816] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988325.619853] ata2.00: irq_stat 0x40000008
[988325.619884] ata2.00: failed command: READ FPDMA QUEUED
[988325.619920] ata2.00: cmd 60/20:00:48:b6:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988325.619922] res 41/40:20:58:b6:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988325.620032] ata2.00: status: { DRDY ERR }
[988325.620063] ata2.00: error: { UNC }
[988325.641160] ata2.00: configured for UDMA/133
[988325.641201] ata2: EH complete
[988328.281740] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988328.281779] ata2.00: irq_stat 0x40000008
[988328.281808] ata2.00: failed command: READ FPDMA QUEUED
[988328.281845] ata2.00: cmd 60/20:00:48:b6:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988328.281847] res 41/40:20:58:b6:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988328.281945] ata2.00: status: { DRDY ERR }
[988328.281973] ata2.00: error: { UNC }
[988328.283422] ata2.00: configured for UDMA/133
[988328.283462] ata2: EH complete
[988330.923569] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988330.923607] ata2.00: irq_stat 0x40000008
[988330.923638] ata2.00: failed command: READ FPDMA QUEUED
[988330.923675] ata2.00: cmd 60/20:00:48:b6:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[988330.923677] res 41/40:20:58:b6:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988330.923773] ata2.00: status: { DRDY ERR }
[988330.923802] ata2.00: error: { UNC }
[988330.925376] ata2.00: configured for UDMA/133
[988330.925417] ata2: EH complete
[988338.165646] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988338.165684] ata2.00: irq_stat 0x40000008
[988338.165715] ata2.00: failed command: READ FPDMA QUEUED
[988338.165751] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988338.165753] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988338.165850] ata2.00: status: { DRDY ERR }
[988338.165878] ata2.00: error: { UNC }
[988338.200189] ata2.00: configured for UDMA/133
[988338.200229] ata2: EH complete
[988340.759747] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988340.759785] ata2.00: irq_stat 0x40000008
[988340.759814] ata2.00: failed command: READ FPDMA QUEUED
[988340.759851] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988340.759853] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988340.759949] ata2.00: status: { DRDY ERR }
[988340.759977] ata2.00: error: { UNC }
[988340.791741] ata2.00: configured for UDMA/133
[988340.791781] ata2: EH complete
[988343.424063] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988343.424100] ata2.00: irq_stat 0x40000008
[988343.424130] ata2.00: failed command: READ FPDMA QUEUED
[988343.424168] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988343.424170] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988343.424266] ata2.00: status: { DRDY ERR }
[988343.424293] ata2.00: error: { UNC }
[988343.425750] ata2.00: configured for UDMA/133
[988343.425789] ata2: EH complete
[988346.049167] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988346.049206] ata2.00: irq_stat 0x40000008
[988346.049235] ata2.00: failed command: READ FPDMA QUEUED
[988346.049272] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988346.049274] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988346.049372] ata2.00: status: { DRDY ERR }
[988346.049400] ata2.00: error: { UNC }
[988346.050906] ata2.00: configured for UDMA/133
[988346.050945] ata2: EH complete
[988348.640937] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988348.640974] ata2.00: irq_stat 0x40000008
[988348.641004] ata2.00: failed command: READ FPDMA QUEUED
[988348.641041] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988348.641043] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988348.641139] ata2.00: status: { DRDY ERR }
[988348.641167] ata2.00: error: { UNC }
[988348.642647] ata2.00: configured for UDMA/133
[988348.642687] ata2: EH complete
[988351.265977] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988351.266014] ata2.00: irq_stat 0x40000008
[988351.266044] ata2.00: failed command: READ FPDMA QUEUED
[988351.266082] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988351.266084] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988351.266182] ata2.00: status: { DRDY ERR }
[988351.266210] ata2.00: error: { UNC }
[988351.267617] ata2.00: configured for UDMA/133
[988351.267658] sd 1:0:0:0: [sdb] Unhandled sense code
[988351.267688] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[988351.267741] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[988351.267806] Descriptor sense data with sense descriptors (in hex):
[988351.267842] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[988351.267943] 64 20 d1 98
[988351.267990] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[988351.268076] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 20 d1 98 00 00 08 00
[988351.268176] end_request: I/O error, dev sdb, sector 1679872408
[988351.268213] raid1: sdb3: rescheduling sector 1611708824
[988351.268261] ata2: EH complete
[988353.907817] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988353.907854] ata2.00: irq_stat 0x40000008
[988353.907884] ata2.00: failed command: READ FPDMA QUEUED
[988353.907920] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988353.907922] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988353.908040] ata2.00: status: { DRDY ERR }
[988353.908070] ata2.00: error: { UNC }
[988353.909706] ata2.00: configured for UDMA/133
[988353.909745] ata2: EH complete
[988356.491252] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988356.491290] ata2.00: irq_stat 0x40000008
[988356.491320] ata2.00: failed command: READ FPDMA QUEUED
[988356.491356] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988356.491358] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988356.491456] ata2.00: status: { DRDY ERR }
[988356.491483] ata2.00: error: { UNC }
[988356.492928] ata2.00: configured for UDMA/133
[988356.492967] ata2: EH complete
[988359.074687] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988359.074724] ata2.00: irq_stat 0x40000008
[988359.074754] ata2.00: failed command: READ FPDMA QUEUED
[988359.074791] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988359.074793] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988359.074889] ata2.00: status: { DRDY ERR }
[988359.074917] ata2.00: error: { UNC }
[988359.076331] ata2.00: configured for UDMA/133
[988359.076372] ata2: EH complete
[988361.632106] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988361.632143] ata2.00: irq_stat 0x40000008
[988361.632172] ata2.00: failed command: READ FPDMA QUEUED
[988361.632209] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988361.632211] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988361.632308] ata2.00: status: { DRDY ERR }
[988361.632336] ata2.00: error: { UNC }
[988361.667661] ata2.00: configured for UDMA/133
[988361.667699] ata2: EH complete
[988364.258219] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988364.258256] ata2.00: irq_stat 0x40000008
[988364.258286] ata2.00: failed command: READ FPDMA QUEUED
[988364.258321] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988364.258323] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988364.258417] ata2.00: status: { DRDY ERR }
[988364.258445] ata2.00: error: { UNC }
[988364.259829] ata2.00: configured for UDMA/133
[988364.259868] ata2: EH complete
[988366.858335] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[988366.858372] ata2.00: irq_stat 0x40000008
[988366.858402] ata2.00: failed command: READ FPDMA QUEUED
[988366.858438] ata2.00: cmd 60/08:00:98:d1:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[988366.858440] res 41/40:08:98:d1:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[988366.858537] ata2.00: status: { DRDY ERR }
[988366.858566] ata2.00: error: { UNC }
[988366.859930] ata2.00: configured for UDMA/133
[988366.859971] sd 1:0:0:0: [sdb] Unhandled sense code
[988366.860024] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[988366.860081] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[988366.860151] Descriptor sense data with sense descriptors (in hex):
[988366.860190] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[988366.860293] 64 20 d1 98
[988366.860340] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[988366.860402] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 20 d1 98 00 00 08 00
[988366.860489] end_request: I/O error, dev sdb, sector 1679872408
[988366.860537] ata2: EH complete
[988366.879248] raid1:md2: read error corrected (8 sectors at 1611710872 on sdb3)
[988366.879306] raid1: sdb3: redirecting sector 1611708824 to another mirror
[991155.087120] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[991155.087158] ata2.00: irq_stat 0x40000008
[991155.087189] ata2.00: failed command: READ FPDMA QUEUED
[991155.087226] ata2.00: cmd 60/40:08:60:5d:1a/00:00:64:00:00/40 tag 1 ncq 32768 in
[991155.087228] res 41/40:40:60:5d:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[991155.087325] ata2.00: status: { DRDY ERR }
[991155.087353] ata2.00: error: { UNC }
[991155.088726] ata2.00: configured for UDMA/133
[991155.088768] ata2: EH complete
[991157.662313] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[991157.662352] ata2.00: irq_stat 0x40000008
[991157.662382] ata2.00: failed command: READ FPDMA QUEUED
[991157.662417] ata2.00: cmd 60/40:00:60:5d:1a/00:00:64:00:00/40 tag 0 ncq 32768 in
[991157.662419] res 41/40:40:60:5d:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[991157.662515] ata2.00: status: { DRDY ERR }
[991157.662543] ata2.00: error: { UNC }
[991157.664040] ata2.00: configured for UDMA/133
[991157.664082] ata2: EH complete
[991160.811867] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[991160.811906] ata2.00: irq_stat 0x40000008
[991160.811936] ata2.00: failed command: READ FPDMA QUEUED
[991160.811971] ata2.00: cmd 60/40:00:60:5d:1a/00:00:64:00:00/40 tag 0 ncq 32768 in
[991160.811973] res 41/40:40:88:5d:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[991160.812090] ata2.00: status: { DRDY ERR }
[991160.812120] ata2.00: error: { UNC }
[991160.847156] ata2.00: configured for UDMA/133
[991160.847197] ata2: EH complete
[991163.470875] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[991163.470913] ata2.00: irq_stat 0x40000008
[991163.470943] ata2.00: failed command: READ FPDMA QUEUED
[991163.470979] ata2.00: cmd 60/40:00:60:5d:1a/00:00:64:00:00/40 tag 0 ncq 32768 in
[991163.470981] res 41/40:40:60:5d:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[991163.480236] ata2.00: status: { DRDY ERR }
[991163.480267] ata2.00: error: { UNC }
[991163.481974] ata2.00: configured for UDMA/133
[991163.482015] ata2: EH complete
[991166.104308] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[991166.104347] ata2.00: irq_stat 0x40000008
[991166.104378] ata2.00: failed command: READ FPDMA QUEUED
[991166.104414] ata2.00: cmd 60/40:00:60:5d:1a/00:00:64:00:00/40 tag 0 ncq 32768 in
[991166.104416] res 41/40:40:60:5d:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[991166.104512] ata2.00: status: { DRDY ERR }
[991166.104540] ata2.00: error: { UNC }
[991166.106133] ata2.00: configured for UDMA/133
[991166.106175] ata2: EH complete
[991169.354388] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[991169.354426] ata2.00: irq_stat 0x40000008
[991169.354457] ata2.00: failed command: READ FPDMA QUEUED
[991169.354494] ata2.00: cmd 60/40:00:60:5d:1a/00:00:64:00:00/40 tag 0 ncq 32768 in
[991169.354496] res 41/40:40:88:5d:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[991169.354593] ata2.00: status: { DRDY ERR }
[991169.354621] ata2.00: error: { UNC }
[991169.356153] ata2.00: configured for UDMA/133
[991169.356198] sd 1:0:0:0: [sdb] Unhandled sense code
[991169.356228] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[991169.356281] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[991169.356348] Descriptor sense data with sense descriptors (in hex):
[991169.356383] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[991169.356484] 64 1a 5d 88
[991169.356532] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[991169.356593] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 1a 5d 60 00 00 40 00
[991169.356680] end_request: I/O error, dev sdb, sector 1679449480
[991169.356713] raid1: sdb3: rescheduling sector 1611285856
[991169.356762] ata2: EH complete
[991170.716972] raid1: sda3: redirecting sector 1611285856 to another mirror
[1030993.622881] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1030993.622991] ata2.00: irq_stat 0x40000008
[1030993.623091] ata2.00: failed command: READ FPDMA QUEUED
[1030993.623283] ata2.00: cmd 60/20:00:18:cd:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[1030993.623286] res 41/40:20:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1030993.623605] ata2.00: status: { DRDY ERR }
[1030993.623697] ata2.00: error: { UNC }
[1030993.625117] ata2.00: configured for UDMA/133
[1030993.625220] ata2: EH complete
[1030996.223033] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1030996.223137] ata2.00: irq_stat 0x40000008
[1030996.223232] ata2.00: failed command: READ FPDMA QUEUED
[1030996.223333] ata2.00: cmd 60/20:00:18:cd:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[1030996.223335] res 41/40:20:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1030996.223563] ata2.00: status: { DRDY ERR }
[1030996.223656] ata2.00: error: { UNC }
[1030996.225188] ata2.00: configured for UDMA/133
[1030996.225294] ata2: EH complete
[1030998.905979] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1030998.906082] ata2.00: irq_stat 0x40000008
[1030998.906178] ata2.00: failed command: READ FPDMA QUEUED
[1030998.906282] ata2.00: cmd 60/20:00:18:cd:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[1030998.906284] res 41/40:20:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1030998.906510] ata2.00: status: { DRDY ERR }
[1030998.906604] ata2.00: error: { UNC }
[1030998.941219] ata2.00: configured for UDMA/133
[1030998.941324] ata2: EH complete
[1031001.589860] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031001.589962] ata2.00: irq_stat 0x40000008
[1031001.590058] ata2.00: failed command: READ FPDMA QUEUED
[1031001.590160] ata2.00: cmd 60/20:00:18:cd:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[1031001.590162] res 41/40:20:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031001.590388] ata2.00: status: { DRDY ERR }
[1031001.590480] ata2.00: error: { UNC }
[1031001.591926] ata2.00: configured for UDMA/133
[1031001.592045] ata2: EH complete
[1031004.256640] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031004.256745] ata2.00: irq_stat 0x40000008
[1031004.256840] ata2.00: failed command: READ FPDMA QUEUED
[1031004.256941] ata2.00: cmd 60/20:00:18:cd:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[1031004.256943] res 41/40:20:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031004.257204] ata2.00: status: { DRDY ERR }
[1031004.257309] ata2.00: error: { UNC }
[1031004.258886] ata2.00: configured for UDMA/133
[1031004.258990] ata2: EH complete
[1031007.023465] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031007.023568] ata2.00: irq_stat 0x40000008
[1031007.023661] ata2.00: failed command: READ FPDMA QUEUED
[1031007.023762] ata2.00: cmd 60/20:00:18:cd:20/00:00:64:00:00/40 tag 0 ncq 16384 in
[1031007.023764] res 41/40:20:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031007.023992] ata2.00: status: { DRDY ERR }
[1031007.024102] ata2.00: error: { UNC }
[1031007.025642] ata2.00: configured for UDMA/133
[1031007.025749] sd 1:0:0:0: [sdb] Unhandled sense code
[1031007.025843] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1031007.026025] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1031007.026410] Descriptor sense data with sense descriptors (in hex):
[1031007.026574] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1031007.027831] 64 20 cd 28
[1031007.028302] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1031007.028558] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 20 cd 18 00 00 20 00
[1031007.029674] end_request: I/O error, dev sdb, sector 1679871272
[1031007.029779] raid1: sdb3: rescheduling sector 1611707672
[1031007.029897] ata2: EH complete
[1031009.715244] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031009.715347] ata2.00: irq_stat 0x40000008
[1031009.715440] ata2.00: failed command: READ FPDMA QUEUED
[1031009.715541] ata2.00: cmd 60/08:00:28:cd:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031009.715543] res 41/40:08:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031009.715771] ata2.00: status: { DRDY ERR }
[1031009.715863] ata2.00: error: { UNC }
[1031009.717545] ata2.00: configured for UDMA/133
[1031009.717651] ata2: EH complete
[1031012.348677] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031012.348780] ata2.00: irq_stat 0x40000008
[1031012.348875] ata2.00: failed command: READ FPDMA QUEUED
[1031012.348975] ata2.00: cmd 60/08:00:28:cd:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031012.348977] res 41/40:08:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031012.349204] ata2.00: status: { DRDY ERR }
[1031012.349297] ata2.00: error: { UNC }
[1031012.350803] ata2.00: configured for UDMA/133
[1031012.350905] ata2: EH complete
[1031014.932060] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031014.932162] ata2.00: irq_stat 0x40000008
[1031014.932258] ata2.00: failed command: READ FPDMA QUEUED
[1031014.932359] ata2.00: cmd 60/08:00:28:cd:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031014.932361] res 41/40:08:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031014.932586] ata2.00: status: { DRDY ERR }
[1031014.932679] ata2.00: error: { UNC }
[1031014.934230] ata2.00: configured for UDMA/133
[1031014.934335] ata2: EH complete
[1031017.515550] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031017.515652] ata2.00: irq_stat 0x40000008
[1031017.515746] ata2.00: failed command: READ FPDMA QUEUED
[1031017.515846] ata2.00: cmd 60/08:00:28:cd:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031017.515848] res 41/40:08:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031017.516085] ata2.00: status: { DRDY ERR }
[1031017.516189] ata2.00: error: { UNC }
[1031017.517637] ata2.00: configured for UDMA/133
[1031017.517741] ata2: EH complete
[1031020.098995] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031020.099098] ata2.00: irq_stat 0x40000008
[1031020.099192] ata2.00: failed command: READ FPDMA QUEUED
[1031020.099293] ata2.00: cmd 60/08:00:28:cd:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031020.099295] res 41/40:08:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031020.099519] ata2.00: status: { DRDY ERR }
[1031020.099612] ata2.00: error: { UNC }
[1031020.101178] ata2.00: configured for UDMA/133
[1031020.101284] ata2: EH complete
[1031022.661687] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031022.661791] ata2.00: irq_stat 0x40000008
[1031022.661885] ata2.00: failed command: READ FPDMA QUEUED
[1031022.661987] ata2.00: cmd 60/08:00:28:cd:20/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031022.661989] res 41/40:08:28:cd:20/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031022.671383] ata2.00: status: { DRDY ERR }
[1031022.671483] ata2.00: error: { UNC }
[1031022.700235] ata2.00: configured for UDMA/133
[1031022.700342] sd 1:0:0:0: [sdb] Unhandled sense code
[1031022.700436] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1031022.700620] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1031022.701007] Descriptor sense data with sense descriptors (in hex):
[1031022.701170] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1031022.702431] 64 20 cd 28
[1031022.702865] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1031022.703118] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 20 cd 28 00 00 08 00
[1031022.704138] end_request: I/O error, dev sdb, sector 1679871272
[1031022.704258] ata2: EH complete
[1031022.719324] raid1:md2: read error corrected (8 sectors at 1611709736 on sdb3)
[1031022.744790] raid1: sdb3: redirecting sector 1611707672 to another mirror
[1031029.432677] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031029.432781] ata2.00: irq_stat 0x40000008
[1031029.432876] ata2.00: failed command: READ FPDMA QUEUED
[1031029.432976] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031029.432979] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031029.433206] ata2.00: status: { DRDY ERR }
[1031029.433297] ata2.00: error: { UNC }
[1031029.434734] ata2.00: configured for UDMA/133
[1031029.434837] ata2: EH complete
[1031032.007796] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031032.007898] ata2.00: irq_stat 0x40000008
[1031032.007993] ata2.00: failed command: READ FPDMA QUEUED
[1031032.008119] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031032.008122] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031032.008364] ata2.00: status: { DRDY ERR }
[1031032.008457] ata2.00: error: { UNC }
[1031032.009913] ata2.00: configured for UDMA/133
[1031032.010020] ata2: EH complete
[1031034.632896] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031034.633000] ata2.00: irq_stat 0x40000008
[1031034.633095] ata2.00: failed command: READ FPDMA QUEUED
[1031034.633196] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031034.633199] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031034.633425] ata2.00: status: { DRDY ERR }
[1031034.633517] ata2.00: error: { UNC }
[1031034.634999] ata2.00: configured for UDMA/133
[1031034.635105] ata2: EH complete
[1031037.207966] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031037.208088] ata2.00: irq_stat 0x40000008
[1031037.208192] ata2.00: failed command: READ FPDMA QUEUED
[1031037.208297] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031037.208299] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031037.208526] ata2.00: status: { DRDY ERR }
[1031037.208619] ata2.00: error: { UNC }
[1031037.210041] ata2.00: configured for UDMA/133
[1031037.210147] ata2: EH complete
[1031039.833074] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031039.833178] ata2.00: irq_stat 0x40000008
[1031039.833276] ata2.00: failed command: READ FPDMA QUEUED
[1031039.833377] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031039.833379] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031039.833606] ata2.00: status: { DRDY ERR }
[1031039.833699] ata2.00: error: { UNC }
[1031039.835119] ata2.00: configured for UDMA/133
[1031039.835224] ata2: EH complete
[1031042.416552] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031042.416655] ata2.00: irq_stat 0x40000008
[1031042.416775] ata2.00: failed command: READ FPDMA QUEUED
[1031042.416903] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031042.416906] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031042.417208] ata2.00: status: { DRDY ERR }
[1031042.417318] ata2.00: error: { UNC }
[1031042.418890] ata2.00: configured for UDMA/133
[1031042.419025] sd 1:0:0:0: [sdb] Unhandled sense code
[1031042.419134] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1031042.419317] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1031042.419704] Descriptor sense data with sense descriptors (in hex):
[1031042.419869] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1031042.421174] 64 1a 86 28
[1031042.421608] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1031042.421862] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 1a 86 28 00 00 08 00
[1031042.422847] end_request: I/O error, dev sdb, sector 1679459880
[1031042.422945] raid1: sdb3: rescheduling sector 1611296296
[1031042.423053] ata2: EH complete
[1031045.083249] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031045.083352] ata2.00: irq_stat 0x40000008
[1031045.083446] ata2.00: failed command: READ FPDMA QUEUED
[1031045.083546] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031045.083548] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031045.083775] ata2.00: status: { DRDY ERR }
[1031045.083867] ata2.00: error: { UNC }
[1031045.085566] ata2.00: configured for UDMA/133
[1031045.085672] ata2: EH complete
[1031047.658429] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031047.658533] ata2.00: irq_stat 0x40000008
[1031047.658628] ata2.00: failed command: READ FPDMA QUEUED
[1031047.658730] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031047.658733] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031047.658961] ata2.00: status: { DRDY ERR }
[1031047.659053] ata2.00: error: { UNC }
[1031047.660644] ata2.00: configured for UDMA/133
[1031047.660750] ata2: EH complete
[1031050.291864] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031050.291967] ata2.00: irq_stat 0x40000008
[1031050.292081] ata2.00: failed command: READ FPDMA QUEUED
[1031050.292191] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031050.292194] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031050.292420] ata2.00: status: { DRDY ERR }
[1031050.292512] ata2.00: error: { UNC }
[1031050.293937] ata2.00: configured for UDMA/133
[1031050.294041] ata2: EH complete
[1031052.884830] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031052.884933] ata2.00: irq_stat 0x40000008
[1031052.885027] ata2.00: failed command: READ FPDMA QUEUED
[1031052.885129] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031052.885131] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031052.885358] ata2.00: status: { DRDY ERR }
[1031052.885450] ata2.00: error: { UNC }
[1031052.918344] ata2.00: configured for UDMA/133
[1031052.918450] ata2: EH complete
[1031055.492022] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031055.492126] ata2.00: irq_stat 0x40000008
[1031055.492222] ata2.00: failed command: READ FPDMA QUEUED
[1031055.492323] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031055.492325] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031055.492553] ata2.00: status: { DRDY ERR }
[1031055.492646] ata2.00: error: { UNC }
[1031055.494316] ata2.00: configured for UDMA/133
[1031055.494421] ata2: EH complete
[1031058.117120] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1031058.117222] ata2.00: irq_stat 0x40000008
[1031058.117316] ata2.00: failed command: READ FPDMA QUEUED
[1031058.117420] ata2.00: cmd 60/08:00:28:86:1a/00:00:64:00:00/40 tag 0 ncq 4096 in
[1031058.117422] res 41/40:08:28:86:1a/00:00:64:00:00/00 Emask 0x409 (media error) <F>
[1031058.117647] ata2.00: status: { DRDY ERR }
[1031058.117741] ata2.00: error: { UNC }
[1031058.119341] ata2.00: configured for UDMA/133
[1031058.119448] sd 1:0:0:0: [sdb] Unhandled sense code
[1031058.119541] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1031058.119723] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1031058.120139] Descriptor sense data with sense descriptors (in hex):
[1031058.120313] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1031058.121577] 64 1a 86 28
[1031058.122007] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1031058.122263] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 64 1a 86 28 00 00 08 00
[1031058.123247] end_request: I/O error, dev sdb, sector 1679459880
[1031058.123361] ata2: EH complete
[1031058.151832] raid1:md2: read error corrected (8 sectors at 1611298344 on sdb3)
[1031058.151958] raid1: sdb3: redirecting sector 1611296296 to another mirror
[1031715.406249] Registering the dns_resolver key type
[1031715.406321] Slow work thread pool: Starting up
[1031715.406517] Slow work thread pool: Ready
[1031715.449615] Status code returned 0xc000006d NT_STATUS_LOGON_FAILURE
[1031715.449655] CIFS VFS: Send error in SessSetup = -13
[1031715.449694] CIFS VFS: cifs_mount failed w/return code = -13
[1031732.601194] Status code returned 0xc000006d NT_STATUS_LOGON_FAILURE
[1031732.601234] CIFS VFS: Send error in SessSetup = -13
[1031732.601273] CIFS VFS: cifs_mount failed w/return code = -13
[1031750.084172] Status code returned 0xc000006d NT_STATUS_LOGON_FAILURE
[1031750.084202] CIFS VFS: Send error in SessSetup = -13
[1031750.084230] CIFS VFS: cifs_mount failed w/return code = -13
[1032935.967624] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1032935.967661] ata2.00: irq_stat 0x40000008
[1032935.967691] ata2.00: failed command: READ FPDMA QUEUED
[1032935.967728] ata2.00: cmd 60/00:00:20:08:d2/01:00:66:00:00/40 tag 0 ncq 131072 in
[1032935.967730] res 41/40:00:b8:08:d2/00:01:66:00:00/00 Emask 0x409 (media error) <F>
[1032935.967827] ata2.00: status: { DRDY ERR }
[1032935.967855] ata2.00: error: { UNC }
[1032935.969270] ata2.00: configured for UDMA/133
[1032935.969312] ata2: EH complete
[1033036.496762] ata2.00: exception Emask 0x0 SAct 0x7 SErr 0x0 action 0x0
[1033036.496801] ata2.00: irq_stat 0x40000008
[1033036.496831] ata2.00: failed command: READ FPDMA QUEUED
[1033036.496868] ata2.00: cmd 60/00:00:e0:a0:0f/01:00:07:00:00/40 tag 0 ncq 131072 in
[1033036.496870] res 41/40:00:30:a1:0f/00:01:07:00:00/00 Emask 0x409 (media error) <F>
[1033036.496993] ata2.00: status: { DRDY ERR }
[1033036.497023] ata2.00: error: { UNC }
[1033036.498354] ata2.00: configured for UDMA/133
[1033036.498397] ata2: EH complete
[1033164.617521] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1033164.617560] ata2.00: irq_stat 0x40000008
[1033164.617614] ata2.00: failed command: READ FPDMA QUEUED
[1033164.617656] ata2.00: cmd 60/00:08:e0:60:ba/01:00:4c:00:00/40 tag 1 ncq 131072 in
[1033164.617659] res 41/40:00:90:61:ba/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033164.617769] ata2.00: status: { DRDY ERR }
[1033164.617798] ata2.00: error: { UNC }
[1033164.636568] ata2.00: configured for UDMA/133
[1033164.636614] ata2: EH complete
[1033168.985402] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1033168.985440] ata2.00: irq_stat 0x40000008
[1033168.985470] ata2.00: failed command: READ FPDMA QUEUED
[1033168.985508] ata2.00: cmd 60/00:00:e0:60:ba/01:00:4c:00:00/40 tag 0 ncq 131072 in
[1033168.985510] res 41/40:00:90:61:ba/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033168.985610] ata2.00: status: { DRDY ERR }
[1033168.985638] ata2.00: error: { UNC }
[1033168.987039] ata2.00: configured for UDMA/133
[1033168.987083] ata2: EH complete
[1033173.135522] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1033173.135560] ata2.00: irq_stat 0x40000008
[1033173.135591] ata2.00: failed command: READ FPDMA QUEUED
[1033173.135629] ata2.00: cmd 60/00:08:e0:60:ba/01:00:4c:00:00/40 tag 1 ncq 131072 in
[1033173.135631] res 41/40:00:90:61:ba/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033173.135729] ata2.00: status: { DRDY ERR }
[1033173.135758] ata2.00: error: { UNC }
[1033173.137407] ata2.00: configured for UDMA/133
[1033173.137449] ata2: EH complete
[1033178.560745] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033178.560783] ata2.00: irq_stat 0x40000008
[1033178.560813] ata2.00: failed command: READ FPDMA QUEUED
[1033178.560850] ata2.00: cmd 60/00:00:e0:60:ba/01:00:4c:00:00/40 tag 0 ncq 131072 in
[1033178.560853] res 41/40:00:a0:61:ba/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033178.560949] ata2.00: status: { DRDY ERR }
[1033178.560978] ata2.00: error: { UNC }
[1033178.562295] ata2.00: configured for UDMA/133
[1033178.562335] ata2: EH complete
[1033183.365710] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033183.365737] ata2.00: irq_stat 0x40000008
[1033183.365759] ata2.00: failed command: READ FPDMA QUEUED
[1033183.365785] ata2.00: cmd 60/00:00:e0:60:ba/01:00:4c:00:00/40 tag 0 ncq 131072 in
[1033183.365786] res 41/40:00:a0:61:ba/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033183.365862] ata2.00: status: { DRDY ERR }
[1033183.365883] ata2.00: error: { UNC }
[1033183.387181] ata2.00: configured for UDMA/133
[1033183.387222] ata2: EH complete
[1033199.772032] ata2.00: qc timeout (cmd 0x2f)
[1033199.772073] ata2: failed to read log page 10h (errno=-5)
[1033199.772111] ata2.00: exception Emask 0x1 SAct 0x7fffffff SErr 0x0 action 0x6 frozen
[1033199.772163] ata2.00: irq_stat 0x40000008
[1033199.772194] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.772230] ata2.00: cmd 61/08:00:58:98:e7/00:00:1e:00:00/40 tag 0 ncq 4096 out
[1033199.772232] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.772329] ata2.00: status: { DRDY }
[1033199.772357] ata2.00: failed command: READ FPDMA QUEUED
[1033199.772393] ata2.00: cmd 60/08:08:d8:20:bc/01:00:4c:00:00/40 tag 1 ncq 135168 in
[1033199.772395] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.772493] ata2.00: status: { DRDY }
[1033199.772521] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.772556] ata2.00: cmd 61/08:10:00:18:10/00:00:04:00:00/40 tag 2 ncq 4096 out
[1033199.772558] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.772653] ata2.00: status: { DRDY }
[1033199.772681] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.772716] ata2.00: cmd 61/08:18:78:19:10/00:00:04:00:00/40 tag 3 ncq 4096 out
[1033199.772718] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.772815] ata2.00: status: { DRDY }
[1033199.772843] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.772878] ata2.00: cmd 61/08:20:88:19:10/00:00:04:00:00/40 tag 4 ncq 4096 out
[1033199.772880] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.772977] ata2.00: status: { DRDY }
[1033199.773005] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.773040] ata2.00: cmd 61/08:28:68:1a:10/00:00:0b:00:00/40 tag 5 ncq 4096 out
[1033199.773042] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.773137] ata2.00: status: { DRDY }
[1033199.773164] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.773200] ata2.00: cmd 61/08:30:40:1e:10/00:00:0b:00:00/40 tag 6 ncq 4096 out
[1033199.773202] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.773296] ata2.00: status: { DRDY }
[1033199.773324] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.773360] ata2.00: cmd 61/08:38:c8:34:50/00:00:11:00:00/40 tag 7 ncq 4096 out
[1033199.773362] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.773460] ata2.00: status: { DRDY }
[1033199.773488] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.773524] ata2.00: cmd 61/08:40:80:18:10/00:00:36:00:00/40 tag 8 ncq 4096 out
[1033199.773526] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.773622] ata2.00: status: { DRDY }
[1033199.773650] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.773685] ata2.00: cmd 61/08:48:00:99:10/00:00:36:00:00/40 tag 9 ncq 4096 out
[1033199.773687] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.773784] ata2.00: status: { DRDY }
[1033199.773811] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.773846] ata2.00: cmd 61/08:50:a8:27:b8/00:00:37:00:00/40 tag 10 ncq 4096 out
[1033199.773848] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.773946] ata2.00: status: { DRDY }
[1033199.773975] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.774011] ata2.00: cmd 61/30:58:60:df:c4/00:00:37:00:00/40 tag 11 ncq 24576 out
[1033199.774013] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.774109] ata2.00: status: { DRDY }
[1033199.774136] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.774171] ata2.00: cmd 61/10:60:98:dc:38/00:00:49:00:00/40 tag 12 ncq 8192 out
[1033199.774173] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.774270] ata2.00: status: { DRDY }
[1033199.774297] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.774333] ata2.00: cmd 61/10:68:40:65:6c/00:00:49:00:00/40 tag 13 ncq 8192 out
[1033199.774335] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.774432] ata2.00: status: { DRDY }
[1033199.774460] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.774495] ata2.00: cmd 61/08:70:d0:e2:9c/00:00:54:00:00/40 tag 14 ncq 4096 out
[1033199.774497] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.783792] ata2.00: status: { DRDY }
[1033199.783823] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.783864] ata2.00: cmd 61/08:78:e0:fa:a0/00:00:54:00:00/40 tag 15 ncq 4096 out
[1033199.783866] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.783965] ata2.00: status: { DRDY }
[1033199.783994] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.784048] ata2.00: cmd 61/08:80:80:18:90/00:00:61:00:00/40 tag 16 ncq 4096 out
[1033199.784051] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.784153] ata2.00: status: { DRDY }
[1033199.784184] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.784223] ata2.00: cmd 61/10:88:a8:18:90/00:00:61:00:00/40 tag 17 ncq 8192 out
[1033199.784226] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.784336] ata2.00: status: { DRDY }
[1033199.784367] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.784404] ata2.00: cmd 61/08:90:90:19:90/00:00:61:00:00/40 tag 18 ncq 4096 out
[1033199.784406] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.784503] ata2.00: status: { DRDY }
[1033199.784531] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.784566] ata2.00: cmd 61/08:98:a0:19:90/00:00:61:00:00/40 tag 19 ncq 4096 out
[1033199.784568] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.784663] ata2.00: status: { DRDY }
[1033199.784691] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.784727] ata2.00: cmd 61/08:a0:d8:19:90/00:00:61:00:00/40 tag 20 ncq 4096 out
[1033199.784729] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.784826] ata2.00: status: { DRDY }
[1033199.784854] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.784889] ata2.00: cmd 61/08:a8:20:1a:90/00:00:61:00:00/40 tag 21 ncq 4096 out
[1033199.784891] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.784986] ata2.00: status: { DRDY }
[1033199.785014] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.785050] ata2.00: cmd 61/08:b0:50:1a:90/00:00:61:00:00/40 tag 22 ncq 4096 out
[1033199.785052] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.785148] ata2.00: status: { DRDY }
[1033199.785175] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.785210] ata2.00: cmd 61/08:b8:a0:1a:90/00:00:61:00:00/40 tag 23 ncq 4096 out
[1033199.785212] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.785308] ata2.00: status: { DRDY }
[1033199.785336] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.785371] ata2.00: cmd 61/08:c0:e8:1a:90/00:00:61:00:00/40 tag 24 ncq 4096 out
[1033199.785373] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.785468] ata2.00: status: { DRDY }
[1033199.785496] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.785532] ata2.00: cmd 61/08:c8:10:1b:90/00:00:61:00:00/40 tag 25 ncq 4096 out
[1033199.785534] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.785629] ata2.00: status: { DRDY }
[1033199.785656] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.785692] ata2.00: cmd 61/08:d0:70:1b:90/00:00:61:00:00/40 tag 26 ncq 4096 out
[1033199.785694] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.785789] ata2.00: status: { DRDY }
[1033199.785818] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.785853] ata2.00: cmd 61/08:d8:90:1b:90/00:00:61:00:00/40 tag 27 ncq 4096 out
[1033199.785855] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.785950] ata2.00: status: { DRDY }
[1033199.785979] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.786014] ata2.00: cmd 61/08:e0:08:1c:90/00:00:61:00:00/40 tag 28 ncq 4096 out
[1033199.786016] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.786113] ata2.00: status: { DRDY }
[1033199.786141] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.786176] ata2.00: cmd 61/08:e8:50:1c:90/00:00:61:00:00/40 tag 29 ncq 4096 out
[1033199.786178] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.786276] ata2.00: status: { DRDY }
[1033199.786303] ata2.00: failed command: WRITE FPDMA QUEUED
[1033199.786339] ata2.00: cmd 61/08:f0:98:1c:90/00:00:61:00:00/40 tag 30 ncq 4096 out
[1033199.786341] res 40/00:a0:d8:19:90/00:00:61:00:00/40 Emask 0x1 (device error)
[1033199.786437] ata2.00: status: { DRDY }
[1033199.786469] ata2: hard resetting link
[1033200.108058] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[1033200.109419] ata2.00: configured for UDMA/133
[1033200.109501] ata2: EH complete
[1033203.874150] ata2.00: exception Emask 0x0 SAct 0x20000000 SErr 0x0 action 0x0
[1033203.874205] ata2.00: irq_stat 0x40000008
[1033203.874240] ata2.00: failed command: READ FPDMA QUEUED
[1033203.874276] ata2.00: cmd 60/08:e8:d8:20:bc/01:00:4c:00:00/40 tag 29 ncq 135168 in
[1033203.874279] res 41/40:08:f0:20:bc/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033203.874376] ata2.00: status: { DRDY ERR }
[1033203.874405] ata2.00: error: { UNC }
[1033203.875746] ata2.00: configured for UDMA/133
[1033203.875786] ata2: EH complete
[1033209.425129] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033209.425170] ata2.00: irq_stat 0x40000008
[1033209.425202] ata2.00: failed command: READ FPDMA QUEUED
[1033209.425244] ata2.00: cmd 60/08:00:d8:20:bc/01:00:4c:00:00/40 tag 0 ncq 135168 in
[1033209.425246] res 41/40:08:b8:21:bc/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033209.425350] ata2.00: status: { DRDY ERR }
[1033209.425381] ata2.00: error: { UNC }
[1033209.446999] ata2.00: configured for UDMA/133
[1033209.447047] ata2: EH complete
[1033216.243696] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033216.243733] ata2.00: irq_stat 0x40000008
[1033216.243764] ata2.00: failed command: READ FPDMA QUEUED
[1033216.243800] ata2.00: cmd 60/08:00:d8:20:bc/01:00:4c:00:00/40 tag 0 ncq 135168 in
[1033216.243802] res 41/40:08:b8:21:bc/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033216.243902] ata2.00: status: { DRDY ERR }
[1033216.243930] ata2.00: error: { UNC }
[1033216.280048] ata2.00: configured for UDMA/133
[1033216.280089] ata2: EH complete
[1033223.420923] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033223.420962] ata2.00: irq_stat 0x40000008
[1033223.420992] ata2.00: failed command: READ FPDMA QUEUED
[1033223.421029] ata2.00: cmd 60/08:00:d8:20:bc/01:00:4c:00:00/40 tag 0 ncq 135168 in
[1033223.421031] res 41/40:08:b8:21:bc/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033223.421131] ata2.00: status: { DRDY ERR }
[1033223.421159] ata2.00: error: { UNC }
[1033223.422509] ata2.00: configured for UDMA/133
[1033223.422549] ata2: EH complete
[1033227.344998] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033227.345035] ata2.00: irq_stat 0x40000008
[1033227.345065] ata2.00: failed command: READ FPDMA QUEUED
[1033227.345103] ata2.00: cmd 60/08:00:d8:20:bc/01:00:4c:00:00/40 tag 0 ncq 135168 in
[1033227.345105] res 41/40:08:a0:21:bc/00:01:4c:00:00/00 Emask 0x409 (media error) <F>
[1033227.345202] ata2.00: status: { DRDY ERR }
[1033227.345231] ata2.00: error: { UNC }
[1033227.372208] ata2.00: configured for UDMA/133
[1033227.372256] sd 1:0:0:0: [sdb] Unhandled sense code
[1033227.372289] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1033227.372347] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1033227.372420] Descriptor sense data with sense descriptors (in hex):
[1033227.372455] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1033227.372559] 4c bc 21 a0
[1033227.372607] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1033227.372669] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 4c bc 20 d8 00 01 08 00
[1033227.372786] end_request: I/O error, dev sdb, sector 1287397792
[1033227.372823] raid1: sdb3: rescheduling sector 1219234016
[1033227.372861] raid1: sdb3: rescheduling sector 1219234264
[1033227.372913] ata2: EH complete
[1033232.987963] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033232.988002] ata2.00: irq_stat 0x40000008
[1033232.988051] ata2.00: failed command: READ FPDMA QUEUED
[1033232.988092] ata2.00: cmd 60/08:00:b8:21:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033232.988095] res 41/40:08:b8:21:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033232.997367] ata2.00: status: { DRDY ERR }
[1033232.997397] ata2.00: error: { UNC }
[1033232.998780] ata2.00: configured for UDMA/133
[1033232.998820] ata2: EH complete
[1033235.629748] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033235.629785] ata2.00: irq_stat 0x40000008
[1033235.629815] ata2.00: failed command: READ FPDMA QUEUED
[1033235.629852] ata2.00: cmd 60/08:00:b8:21:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033235.629854] res 41/40:08:b8:21:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033235.629950] ata2.00: status: { DRDY ERR }
[1033235.629978] ata2.00: error: { UNC }
[1033235.631525] ata2.00: configured for UDMA/133
[1033235.631564] ata2: EH complete
[1033238.263134] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033238.263172] ata2.00: irq_stat 0x40000008
[1033238.263202] ata2.00: failed command: READ FPDMA QUEUED
[1033238.263239] ata2.00: cmd 60/08:00:b8:21:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033238.263241] res 41/40:08:b8:21:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033238.263340] ata2.00: status: { DRDY ERR }
[1033238.263369] ata2.00: error: { UNC }
[1033238.264852] ata2.00: configured for UDMA/133
[1033238.264892] ata2: EH complete
[1033240.846618] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033240.846656] ata2.00: irq_stat 0x40000008
[1033240.846686] ata2.00: failed command: READ FPDMA QUEUED
[1033240.846724] ata2.00: cmd 60/08:00:b8:21:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033240.846726] res 41/40:08:b8:21:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033240.846822] ata2.00: status: { DRDY ERR }
[1033240.846850] ata2.00: error: { UNC }
[1033240.848424] ata2.00: configured for UDMA/133
[1033240.848465] ata2: EH complete
[1033241.610272] raid1: sdb3: redirecting sector 1219234016 to another mirror
[1033244.721776] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033244.721815] ata2.00: irq_stat 0x40000008
[1033244.721845] ata2.00: failed command: READ FPDMA QUEUED
[1033244.721881] ata2.00: cmd 60/f8:00:e0:20:bc/00:00:4c:00:00/40 tag 0 ncq 126976 in
[1033244.721883] res 41/40:f8:f0:20:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033244.721982] ata2.00: status: { DRDY ERR }
[1033244.722011] ata2.00: error: { UNC }
[1033244.723471] ata2.00: configured for UDMA/133
[1033244.723511] ata2: EH complete
[1033248.001638] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033248.001676] ata2.00: irq_stat 0x40000008
[1033248.001706] ata2.00: failed command: READ FPDMA QUEUED
[1033248.001743] ata2.00: cmd 60/f8:00:e0:20:bc/00:00:4c:00:00/40 tag 0 ncq 126976 in
[1033248.001745] res 41/40:f8:f0:20:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033248.001843] ata2.00: status: { DRDY ERR }
[1033248.001871] ata2.00: error: { UNC }
[1033248.039986] ata2.00: configured for UDMA/133
[1033248.040046] ata2: EH complete
[1033252.056749] raid1: sda3: redirecting sector 1219234264 to another mirror
[1033255.405537] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1033255.405576] ata2.00: irq_stat 0x40000008
[1033255.405607] ata2.00: failed command: READ FPDMA QUEUED
[1033255.405644] ata2.00: cmd 60/00:00:e0:23:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033255.405646] res 41/40:00:c0:24:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033255.405744] ata2.00: status: { DRDY ERR }
[1033255.405772] ata2.00: error: { UNC }
[1033255.407159] ata2.00: configured for UDMA/133
[1033255.407201] ata2: EH complete
[1033258.614000] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1033258.614038] ata2.00: irq_stat 0x40000008
[1033258.614070] ata2.00: failed command: READ FPDMA QUEUED
[1033258.614107] ata2.00: cmd 60/00:08:e0:23:bc/02:00:4c:00:00/40 tag 1 ncq 262144 in
[1033258.614109] res 41/40:00:c8:24:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033258.614206] ata2.00: status: { DRDY ERR }
[1033258.614234] ata2.00: error: { UNC }
[1033258.615560] ata2.00: configured for UDMA/133
[1033258.615601] ata2: EH complete
[1033262.539144] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033262.539183] ata2.00: irq_stat 0x40000008
[1033262.539214] ata2.00: failed command: READ FPDMA QUEUED
[1033262.539251] ata2.00: cmd 60/00:00:e0:23:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033262.539254] res 41/40:00:c8:24:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033262.539351] ata2.00: status: { DRDY ERR }
[1033262.539379] ata2.00: error: { UNC }
[1033262.541011] ata2.00: configured for UDMA/133
[1033262.541053] ata2: EH complete
[1033265.597603] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033265.597640] ata2.00: irq_stat 0x40000008
[1033265.597669] ata2.00: failed command: READ FPDMA QUEUED
[1033265.597706] ata2.00: cmd 60/00:00:e0:23:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033265.597709] res 41/40:00:c0:24:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033265.597807] ata2.00: status: { DRDY ERR }
[1033265.597836] ata2.00: error: { UNC }
[1033265.599172] ata2.00: configured for UDMA/133
[1033265.599214] ata2: EH complete
[1033270.089460] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033270.089498] ata2.00: irq_stat 0x40000008
[1033270.089529] ata2.00: failed command: READ FPDMA QUEUED
[1033270.089566] ata2.00: cmd 60/00:00:e0:23:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033270.089568] res 41/40:00:d0:24:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033270.089666] ata2.00: status: { DRDY ERR }
[1033270.089695] ata2.00: error: { UNC }
[1033270.091071] ata2.00: configured for UDMA/133
[1033270.091112] ata2: EH complete
[1033273.272917] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033273.272954] ata2.00: irq_stat 0x40000008
[1033273.272985] ata2.00: failed command: READ FPDMA QUEUED
[1033273.273023] ata2.00: cmd 60/00:00:e0:23:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033273.273025] res 41/40:00:c0:24:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033273.273123] ata2.00: status: { DRDY ERR }
[1033273.273152] ata2.00: error: { UNC }
[1033273.274479] ata2.00: configured for UDMA/133
[1033273.274523] sd 1:0:0:0: [sdb] Unhandled sense code
[1033273.274553] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1033273.274607] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1033273.274672] Descriptor sense data with sense descriptors (in hex):
[1033273.274708] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1033273.274810] 4c bc 24 c0
[1033273.274856] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1033273.274918] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 4c bc 23 e0 00 02 00 00
[1033273.275007] end_request: I/O error, dev sdb, sector 1287398592
[1033273.275041] raid1: sdb3: rescheduling sector 1219234784
[1033273.275074] raid1: sdb3: rescheduling sector 1219235032
[1033273.275109] raid1: sdb3: rescheduling sector 1219235040
[1033273.275144] raid1: sdb3: rescheduling sector 1219235288
[1033273.275195] ata2: EH complete
[1033277.373039] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033277.373081] ata2.00: irq_stat 0x40000008
[1033277.373114] ata2.00: failed command: READ FPDMA QUEUED
[1033277.373157] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033277.373160] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033277.373264] ata2.00: status: { DRDY ERR }
[1033277.373297] ata2.00: error: { UNC }
[1033277.374711] ata2.00: configured for UDMA/133
[1033277.374757] ata2: EH complete
[1033279.939810] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033279.939851] ata2.00: irq_stat 0x40000008
[1033279.939885] ata2.00: failed command: READ FPDMA QUEUED
[1033279.939926] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033279.939929] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033279.940060] ata2.00: status: { DRDY ERR }
[1033279.940092] ata2.00: error: { UNC }
[1033279.941516] ata2.00: configured for UDMA/133
[1033279.941564] ata2: EH complete
[1033282.506575] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033282.506618] ata2.00: irq_stat 0x40000008
[1033282.506651] ata2.00: failed command: READ FPDMA QUEUED
[1033282.506695] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033282.506698] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033282.506801] ata2.00: status: { DRDY ERR }
[1033282.506834] ata2.00: error: { UNC }
[1033282.508200] ata2.00: configured for UDMA/133
[1033282.508230] ata2: EH complete
[1033285.073338] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033285.073376] ata2.00: irq_stat 0x40000008
[1033285.073407] ata2.00: failed command: READ FPDMA QUEUED
[1033285.082671] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033285.082673] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033285.082786] ata2.00: status: { DRDY ERR }
[1033285.082824] ata2.00: error: { UNC }
[1033285.084214] ata2.00: configured for UDMA/133
[1033285.084254] ata2: EH complete
[1033286.158411] raid1: sdb3: redirecting sector 1219234784 to another mirror
[1033290.101290] ata2.00: exception Emask 0x0 SAct 0x12 SErr 0x0 action 0x0
[1033290.101328] ata2.00: irq_stat 0x40000008
[1033290.101359] ata2.00: failed command: READ FPDMA QUEUED
[1033290.101397] ata2.00: cmd 60/f8:20:e0:23:bc/00:00:4c:00:00/40 tag 4 ncq 126976 in
[1033290.101399] res 41/40:f8:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033290.101497] ata2.00: status: { DRDY ERR }
[1033290.101525] ata2.00: error: { UNC }
[1033290.141669] ata2.00: configured for UDMA/133
[1033290.141713] ata2: EH complete
[1033293.907081] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1033293.907120] ata2.00: irq_stat 0x40000008
[1033293.907150] ata2.00: failed command: READ FPDMA QUEUED
[1033293.907188] ata2.00: cmd 60/f8:00:e0:23:bc/00:00:4c:00:00/40 tag 0 ncq 126976 in
[1033293.907190] res 41/40:f8:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033293.907291] ata2.00: status: { DRDY ERR }
[1033293.907319] ata2.00: error: { UNC }
[1033293.908803] ata2.00: configured for UDMA/133
[1033293.908847] ata2: EH complete
[1033297.557221] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1033297.557259] ata2.00: irq_stat 0x40000008
[1033297.557290] ata2.00: failed command: READ FPDMA QUEUED
[1033297.557327] ata2.00: cmd 60/f8:08:e0:23:bc/00:00:4c:00:00/40 tag 1 ncq 126976 in
[1033297.557329] res 41/40:f8:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033297.557425] ata2.00: status: { DRDY ERR }
[1033297.557454] ata2.00: error: { UNC }
[1033297.558912] ata2.00: configured for UDMA/133
[1033297.558954] ata2: EH complete
[1033301.248993] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033301.249031] ata2.00: irq_stat 0x40000008
[1033301.249062] ata2.00: failed command: READ FPDMA QUEUED
[1033301.249099] ata2.00: cmd 60/f8:00:e0:23:bc/00:00:4c:00:00/40 tag 0 ncq 126976 in
[1033301.249101] res 41/40:f8:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033301.249199] ata2.00: status: { DRDY ERR }
[1033301.249227] ata2.00: error: { UNC }
[1033301.250714] ata2.00: configured for UDMA/133
[1033301.250755] ata2: EH complete
[1033304.895642] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033304.895680] ata2.00: irq_stat 0x40000008
[1033304.895710] ata2.00: failed command: READ FPDMA QUEUED
[1033304.895748] ata2.00: cmd 60/f8:00:e0:23:bc/00:00:4c:00:00/40 tag 0 ncq 126976 in
[1033304.895750] res 41/40:f8:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033304.895847] ata2.00: status: { DRDY ERR }
[1033304.895876] ata2.00: error: { UNC }
[1033304.917028] ata2.00: configured for UDMA/133
[1033304.917071] ata2: EH complete
[1033308.664483] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033308.664522] ata2.00: irq_stat 0x40000008
[1033308.664552] ata2.00: failed command: READ FPDMA QUEUED
[1033308.664589] ata2.00: cmd 60/f8:00:e0:23:bc/00:00:4c:00:00/40 tag 0 ncq 126976 in
[1033308.664591] res 41/40:f8:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033308.664689] ata2.00: status: { DRDY ERR }
[1033308.664717] ata2.00: error: { UNC }
[1033308.700553] ata2.00: configured for UDMA/133
[1033308.700597] sd 1:0:0:0: [sdb] Unhandled sense code
[1033308.700628] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1033308.700681] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1033308.700747] Descriptor sense data with sense descriptors (in hex):
[1033308.700782] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1033308.700884] 4c bc 24 c8
[1033308.700932] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1033308.700994] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 4c bc 23 e0 00 00 f8 00
[1033308.701084] end_request: I/O error, dev sdb, sector 1287398600
[1033308.701117] raid1: sdb3: rescheduling sector 1219234784
[1033308.701174] ata2: EH complete
[1033308.781533] raid1: sda3: redirecting sector 1219235032 to another mirror
[1033308.790242] raid1: sda3: redirecting sector 1219235040 to another mirror
[1033308.808310] raid1: sda3: redirecting sector 1219235288 to another mirror
[1033312.682836] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033312.682873] ata2.00: irq_stat 0x40000008
[1033312.682903] ata2.00: failed command: READ FPDMA QUEUED
[1033312.682940] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033312.682942] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033312.683040] ata2.00: status: { DRDY ERR }
[1033312.683068] ata2.00: error: { UNC }
[1033312.684428] ata2.00: configured for UDMA/133
[1033312.684469] ata2: EH complete
[1033315.257926] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033315.257962] ata2.00: irq_stat 0x40000008
[1033315.257992] ata2.00: failed command: READ FPDMA QUEUED
[1033315.258029] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033315.258032] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033315.258131] ata2.00: status: { DRDY ERR }
[1033315.258159] ata2.00: error: { UNC }
[1033315.259508] ata2.00: configured for UDMA/133
[1033315.259547] ata2: EH complete
[1033317.824692] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033317.824728] ata2.00: irq_stat 0x40000008
[1033317.824758] ata2.00: failed command: READ FPDMA QUEUED
[1033317.824795] ata2.00: cmd 60/08:00:c8:24:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1033317.824797] res 41/40:08:c8:24:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1033317.824892] ata2.00: status: { DRDY ERR }
[1033317.824920] ata2.00: error: { UNC }
[1033317.826378] ata2.00: configured for UDMA/133
[1033317.826415] ata2: EH complete
[1033318.857567] raid1: sdb3: redirecting sector 1219234784 to another mirror
[1033326.516709] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033326.516748] ata2.00: irq_stat 0x40000008
[1033326.516777] ata2.00: failed command: READ FPDMA QUEUED
[1033326.516814] ata2.00: cmd 60/00:00:e0:42:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033326.516816] res 41/40:00:80:43:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033326.516914] ata2.00: status: { DRDY ERR }
[1033326.516942] ata2.00: error: { UNC }
[1033326.518347] ata2.00: configured for UDMA/133
[1033326.518388] ata2: EH complete
[1033329.175111] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033329.175152] ata2.00: irq_stat 0x40000008
[1033329.175187] ata2.00: failed command: READ FPDMA QUEUED
[1033329.175230] ata2.00: cmd 60/00:00:e0:42:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033329.175233] res 41/40:00:78:43:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033329.175336] ata2.00: status: { DRDY ERR }
[1033329.175367] ata2.00: error: { UNC }
[1033329.176787] ata2.00: configured for UDMA/133
[1033329.176829] ata2: EH complete
[1033332.438432] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033332.438480] ata2.00: irq_stat 0x40000008
[1033332.438511] ata2.00: failed command: READ FPDMA QUEUED
[1033332.438548] ata2.00: cmd 60/00:00:e0:42:bc/02:00:4c:00:00/40 tag 0 ncq 262144 in
[1033332.438550] res 41/40:00:80:43:bc/00:02:4c:00:00/00 Emask 0x409 (media error) <F>
[1033332.438649] ata2.00: status: { DRDY ERR }
[1033332.438677] ata2.00: error: { UNC }
[1033332.459761] ata2.00: configured for UDMA/133
[1033332.459811] ata2: EH complete
[1033555.892555] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033555.892593] ata2.00: irq_stat 0x40000008
[1033555.892624] ata2.00: failed command: READ FPDMA QUEUED
[1033555.892661] ata2.00: cmd 60/c0:00:08:98:dc/00:00:5f:00:00/40 tag 0 ncq 98304 in
[1033555.892663] res 41/40:c0:10:98:dc/00:00:5f:00:00/00 Emask 0x409 (media error) <F>
[1033555.892761] ata2.00: status: { DRDY ERR }
[1033555.892788] ata2.00: error: { UNC }
[1033555.894164] ata2.00: configured for UDMA/133
[1033555.894205] ata2: EH complete
[1033559.509391] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1033559.509429] ata2.00: irq_stat 0x40000008
[1033559.509459] ata2.00: failed command: READ FPDMA QUEUED
[1033559.509495] ata2.00: cmd 60/c0:00:08:98:dc/00:00:5f:00:00/40 tag 0 ncq 98304 in
[1033559.509497] res 41/40:c0:18:98:dc/00:00:5f:00:00/00 Emask 0x409 (media error) <F>
[1033559.509595] ata2.00: status: { DRDY ERR }
[1033559.509623] ata2.00: error: { UNC }
[1033559.511184] ata2.00: configured for UDMA/133
[1033559.511226] ata2: EH complete
[1034036.573954] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034036.573993] ata2.00: irq_stat 0x40000008
[1034036.574024] ata2.00: failed command: READ FPDMA QUEUED
[1034036.574060] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034036.574063] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034036.574161] ata2.00: status: { DRDY ERR }
[1034036.574189] ata2.00: error: { UNC }
[1034036.575526] ata2.00: configured for UDMA/133
[1034036.575564] ata2: EH complete
[1034039.145276] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034039.145314] ata2.00: irq_stat 0x40000008
[1034039.145344] ata2.00: failed command: READ FPDMA QUEUED
[1034039.145381] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034039.145384] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034039.145482] ata2.00: status: { DRDY ERR }
[1034039.145510] ata2.00: error: { UNC }
[1034039.146926] ata2.00: configured for UDMA/133
[1034039.146966] ata2: EH complete
[1034041.720388] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034041.720426] ata2.00: irq_stat 0x40000008
[1034041.720456] ata2.00: failed command: READ FPDMA QUEUED
[1034041.720493] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034041.720495] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034041.720593] ata2.00: status: { DRDY ERR }
[1034041.720621] ata2.00: error: { UNC }
[1034041.722073] ata2.00: configured for UDMA/133
[1034041.722112] ata2: EH complete
[1034044.345483] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034044.345521] ata2.00: irq_stat 0x40000008
[1034044.345551] ata2.00: failed command: READ FPDMA QUEUED
[1034044.345587] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034044.345589] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034044.345686] ata2.00: status: { DRDY ERR }
[1034044.345714] ata2.00: error: { UNC }
[1034044.347128] ata2.00: configured for UDMA/133
[1034044.347167] ata2: EH complete
[1034046.912201] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034046.912239] ata2.00: irq_stat 0x40000008
[1034046.912270] ata2.00: failed command: READ FPDMA QUEUED
[1034046.912307] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034046.912309] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034046.912406] ata2.00: status: { DRDY ERR }
[1034046.912434] ata2.00: error: { UNC }
[1034046.913844] ata2.00: configured for UDMA/133
[1034046.913910] ata2: EH complete
[1034049.487370] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034049.487408] ata2.00: irq_stat 0x40000008
[1034049.487438] ata2.00: failed command: READ FPDMA QUEUED
[1034049.487476] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034049.487478] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034049.487575] ata2.00: status: { DRDY ERR }
[1034049.487604] ata2.00: error: { UNC }
[1034049.489286] ata2.00: configured for UDMA/133
[1034049.489329] sd 1:0:0:0: [sdb] Unhandled sense code
[1034049.489358] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1034049.489413] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1034049.489479] Descriptor sense data with sense descriptors (in hex):
[1034049.489515] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1034049.489617] 4c bc 36 88
[1034049.489664] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1034049.489726] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 4c bc 36 88 00 00 08 00
[1034049.489815] end_request: I/O error, dev sdb, sector 1287403144
[1034049.489848] raid1: sdb3: rescheduling sector 1219239560
[1034049.489891] ata2: EH complete
[1034052.104131] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034052.104168] ata2.00: irq_stat 0x40000008
[1034052.104199] ata2.00: failed command: READ FPDMA QUEUED
[1034052.104237] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034052.104239] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034052.104337] ata2.00: status: { DRDY ERR }
[1034052.104366] ata2.00: error: { UNC }
[1034052.105767] ata2.00: configured for UDMA/133
[1034052.105806] ata2: EH complete
[1034054.670897] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034054.670935] ata2.00: irq_stat 0x40000008
[1034054.670965] ata2.00: failed command: READ FPDMA QUEUED
[1034054.671001] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034054.671003] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034054.671101] ata2.00: status: { DRDY ERR }
[1034054.671129] ata2.00: error: { UNC }
[1034054.672602] ata2.00: configured for UDMA/133
[1034054.672643] ata2: EH complete
[1034057.245947] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034057.245984] ata2.00: irq_stat 0x40000008
[1034057.246015] ata2.00: failed command: READ FPDMA QUEUED
[1034057.246053] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034057.246055] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034057.246151] ata2.00: status: { DRDY ERR }
[1034057.246179] ata2.00: error: { UNC }
[1034057.247512] ata2.00: configured for UDMA/133
[1034057.247549] ata2: EH complete
[1034059.862727] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034059.862767] ata2.00: irq_stat 0x40000008
[1034059.862798] ata2.00: failed command: READ FPDMA QUEUED
[1034059.862835] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034059.862838] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034059.862935] ata2.00: status: { DRDY ERR }
[1034059.862964] ata2.00: error: { UNC }
[1034059.864294] ata2.00: configured for UDMA/133
[1034059.864334] ata2: EH complete
[1034062.479506] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1034062.479544] ata2.00: irq_stat 0x40000008
[1034062.479575] ata2.00: failed command: READ FPDMA QUEUED
[1034062.479612] ata2.00: cmd 60/08:00:88:36:bc/00:00:4c:00:00/40 tag 0 ncq 4096 in
[1034062.479614] res 41/40:08:88:36:bc/00:00:4c:00:00/00 Emask 0x409 (media error) <F>
[1034062.479710] ata2.00: status: { DRDY ERR }
[1034062.479738] ata2.00: error: { UNC }
[1034062.481373] ata2.00: configured for UDMA/133
[1034062.481413] ata2: EH complete
[1034062.943452] raid1: sdb3: redirecting sector 1219239560 to another mirror
[1035897.099092] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1035897.099130] ata2.00: irq_stat 0x40000008
[1035897.099161] ata2.00: failed command: READ FPDMA QUEUED
[1035897.099198] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035897.099200] res 41/40:e0:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035897.099296] ata2.00: status: { DRDY ERR }
[1035897.099325] ata2.00: error: { UNC }
[1035897.121430] ata2.00: configured for UDMA/133
[1035897.121475] ata2: EH complete
[1035900.553177] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1035900.553214] ata2.00: irq_stat 0x40000008
[1035900.553245] ata2.00: failed command: READ FPDMA QUEUED
[1035900.553283] ata2.00: cmd 60/e0:08:00:18:80/00:00:72:00:00/40 tag 1 ncq 114688 in
[1035900.553285] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035900.553384] ata2.00: status: { DRDY ERR }
[1035900.553411] ata2.00: error: { UNC }
[1035900.554778] ata2.00: configured for UDMA/133
[1035900.554817] ata2: EH complete
[1035904.519998] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035904.520048] ata2.00: irq_stat 0x40000008
[1035904.520082] ata2.00: failed command: READ FPDMA QUEUED
[1035904.520123] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035904.520126] res 41/40:e0:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035904.520228] ata2.00: status: { DRDY ERR }
[1035904.520256] ata2.00: error: { UNC }
[1035904.521684] ata2.00: configured for UDMA/133
[1035904.521723] ata2: EH complete
[1035908.270142] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035908.270180] ata2.00: irq_stat 0x40000008
[1035908.270211] ata2.00: failed command: READ FPDMA QUEUED
[1035908.270249] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035908.270251] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035908.270348] ata2.00: status: { DRDY ERR }
[1035908.270377] ata2.00: error: { UNC }
[1035908.271756] ata2.00: configured for UDMA/133
[1035908.271794] ata2: EH complete
[1035911.995279] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035912.004514] ata2.00: irq_stat 0x40000008
[1035912.004557] ata2.00: failed command: READ FPDMA QUEUED
[1035912.004594] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035912.004596] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035912.004695] ata2.00: status: { DRDY ERR }
[1035912.004722] ata2.00: error: { UNC }
[1035912.067922] ata2.00: configured for UDMA/133
[1035912.067962] ata2: EH complete
[1035917.817079] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035917.817117] ata2.00: irq_stat 0x40000008
[1035917.817147] ata2.00: failed command: READ FPDMA QUEUED
[1035917.817184] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035917.817186] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035917.817283] ata2.00: status: { DRDY ERR }
[1035917.817311] ata2.00: error: { UNC }
[1035917.838568] ata2.00: configured for UDMA/133
[1035917.838613] sd 1:0:0:0: [sdb] Unhandled sense code
[1035917.838643] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1035917.838697] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1035917.838763] Descriptor sense data with sense descriptors (in hex):
[1035917.838800] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1035917.838901] 72 80 18 38
[1035917.838948] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1035917.839008] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 72 80 18 00 00 00 e0 00
[1035917.839096] end_request: I/O error, dev sdb, sector 1920997432
[1035917.839130] raid1: sdb3: rescheduling sector 1852833792
[1035917.839171] ata2: EH complete
[1035924.030243] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035924.030280] ata2.00: irq_stat 0x40000008
[1035924.030310] ata2.00: failed command: READ FPDMA QUEUED
[1035924.030346] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035924.030348] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035924.030446] ata2.00: status: { DRDY ERR }
[1035924.030474] ata2.00: error: { UNC }
[1035924.087876] ata2.00: configured for UDMA/133
[1035924.087918] ata2: EH complete
[1035926.995897] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035926.995934] ata2.00: irq_stat 0x40000008
[1035926.995964] ata2.00: failed command: READ FPDMA QUEUED
[1035926.996001] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035926.996003] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035926.996118] ata2.00: status: { DRDY ERR }
[1035926.996149] ata2.00: error: { UNC }
[1035926.997620] ata2.00: configured for UDMA/133
[1035926.997660] ata2: EH complete
[1035929.925504] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035929.925541] ata2.00: irq_stat 0x40000008
[1035929.925571] ata2.00: failed command: READ FPDMA QUEUED
[1035929.925608] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035929.925610] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035929.925706] ata2.00: status: { DRDY ERR }
[1035929.925735] ata2.00: error: { UNC }
[1035929.927084] ata2.00: configured for UDMA/133
[1035929.927122] ata2: EH complete
[1035933.612824] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035933.612862] ata2.00: irq_stat 0x40000008
[1035933.612892] ata2.00: failed command: READ FPDMA QUEUED
[1035933.612929] ata2.00: cmd 60/08:00:40:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035933.612931] res 41/40:08:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035933.613029] ata2.00: status: { DRDY ERR }
[1035933.613058] ata2.00: error: { UNC }
[1035933.639287] ata2.00: configured for UDMA/133
[1035933.639326] ata2: EH complete
[1035936.521227] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035936.521264] ata2.00: irq_stat 0x40000008
[1035936.521294] ata2.00: failed command: READ FPDMA QUEUED
[1035936.521330] ata2.00: cmd 60/08:00:40:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035936.521333] res 41/40:08:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035936.521428] ata2.00: status: { DRDY ERR }
[1035936.521456] ata2.00: error: { UNC }
[1035936.522779] ata2.00: configured for UDMA/133
[1035936.522816] ata2: EH complete
[1035939.413057] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035939.413095] ata2.00: irq_stat 0x40000008
[1035939.413126] ata2.00: failed command: READ FPDMA QUEUED
[1035939.413163] ata2.00: cmd 60/08:00:40:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035939.413165] res 41/40:08:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035939.413261] ata2.00: status: { DRDY ERR }
[1035939.413289] ata2.00: error: { UNC }
[1035939.414627] ata2.00: configured for UDMA/133
[1035939.414666] ata2: EH complete
[1035942.296483] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035942.296521] ata2.00: irq_stat 0x40000008
[1035942.296551] ata2.00: failed command: READ FPDMA QUEUED
[1035942.296587] ata2.00: cmd 60/08:00:40:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035942.296589] res 41/40:08:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035942.296688] ata2.00: status: { DRDY ERR }
[1035942.296716] ata2.00: error: { UNC }
[1035942.298039] ata2.00: configured for UDMA/133
[1035942.298076] ata2: EH complete
[1035945.183509] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035945.183546] ata2.00: irq_stat 0x40000008
[1035945.183576] ata2.00: failed command: READ FPDMA QUEUED
[1035945.183613] ata2.00: cmd 60/08:00:40:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035945.183615] res 41/40:08:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035945.183712] ata2.00: status: { DRDY ERR }
[1035945.183740] ata2.00: error: { UNC }
[1035945.261228] ata2.00: configured for UDMA/133
[1035945.261269] ata2: EH complete
[1035948.146735] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035948.146772] ata2.00: irq_stat 0x40000008
[1035948.146802] ata2.00: failed command: READ FPDMA QUEUED
[1035948.146840] ata2.00: cmd 60/08:00:40:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035948.146842] res 41/40:08:40:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035948.146938] ata2.00: status: { DRDY ERR }
[1035948.146966] ata2.00: error: { UNC }
[1035948.148367] ata2.00: configured for UDMA/133
[1035948.148410] sd 1:0:0:0: [sdb] Unhandled sense code
[1035948.148439] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1035948.148493] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1035948.148559] Descriptor sense data with sense descriptors (in hex):
[1035948.148595] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1035948.148696] 72 80 18 40
[1035948.148742] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1035948.148803] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 72 80 18 40 00 00 08 00
[1035948.148892] end_request: I/O error, dev sdb, sector 1920997440
[1035948.148944] ata2: EH complete
[1035948.214533] raid1:md2: read error corrected (8 sectors at 1852835904 on sdb3)
[1035949.029334] raid1: sdb3: redirecting sector 1852833792 to another mirror
[1035952.868662] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035952.868701] ata2.00: irq_stat 0x40000008
[1035952.868731] ata2.00: failed command: READ FPDMA QUEUED
[1035952.868767] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035952.868769] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035952.868867] ata2.00: status: { DRDY ERR }
[1035952.868895] ata2.00: error: { UNC }
[1035952.895534] ata2.00: configured for UDMA/133
[1035952.895575] ata2: EH complete
[1035956.163725] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035956.163763] ata2.00: irq_stat 0x40000008
[1035956.163793] ata2.00: failed command: READ FPDMA QUEUED
[1035956.163830] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035956.163832] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035956.163931] ata2.00: status: { DRDY ERR }
[1035956.163959] ata2.00: error: { UNC }
[1035956.165533] ata2.00: configured for UDMA/133
[1035956.165575] ata2: EH complete
[1035961.880610] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035961.880647] ata2.00: irq_stat 0x40000008
[1035961.880677] ata2.00: failed command: READ FPDMA QUEUED
[1035961.880714] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035961.880716] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035961.880813] ata2.00: status: { DRDY ERR }
[1035961.880842] ata2.00: error: { UNC }
[1035961.882167] ata2.00: configured for UDMA/133
[1035961.891395] ata2: EH complete
[1035966.022444] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035966.022481] ata2.00: irq_stat 0x40000008
[1035966.022511] ata2.00: failed command: READ FPDMA QUEUED
[1035966.022548] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035966.022550] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035966.022648] ata2.00: status: { DRDY ERR }
[1035966.022677] ata2.00: error: { UNC }
[1035966.024047] ata2.00: configured for UDMA/133
[1035966.024091] ata2: EH complete
[1035970.214272] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035970.214309] ata2.00: irq_stat 0x40000008
[1035970.214339] ata2.00: failed command: READ FPDMA QUEUED
[1035970.214376] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035970.214378] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035970.214475] ata2.00: status: { DRDY ERR }
[1035970.214503] ata2.00: error: { UNC }
[1035970.215833] ata2.00: configured for UDMA/133
[1035970.215871] ata2: EH complete
[1035973.747696] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035973.747734] ata2.00: irq_stat 0x40000008
[1035973.747765] ata2.00: failed command: READ FPDMA QUEUED
[1035973.747802] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1035973.747804] res 41/40:e0:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035973.747904] ata2.00: status: { DRDY ERR }
[1035973.747931] ata2.00: error: { UNC }
[1035973.749271] ata2.00: configured for UDMA/133
[1035973.749314] sd 1:0:0:0: [sdb] Unhandled sense code
[1035973.749344] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1035973.749397] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1035973.749464] Descriptor sense data with sense descriptors (in hex):
[1035973.749499] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1035973.749601] 72 80 18 38
[1035973.749647] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1035973.749708] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 72 80 18 00 00 00 e0 00
[1035973.749796] end_request: I/O error, dev sdb, sector 1920997432
[1035973.749830] raid1: sdb3: rescheduling sector 1852833792
[1035973.749875] ata2: EH complete
[1035981.323046] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035981.323084] ata2.00: irq_stat 0x40000008
[1035981.323115] ata2.00: failed command: READ FPDMA QUEUED
[1035981.323151] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035981.323153] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035981.323249] ata2.00: status: { DRDY ERR }
[1035981.323278] ata2.00: error: { UNC }
[1035981.324746] ata2.00: configured for UDMA/133
[1035981.324786] ata2: EH complete
[1035984.223168] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035984.223207] ata2.00: irq_stat 0x40000008
[1035984.223237] ata2.00: failed command: READ FPDMA QUEUED
[1035984.223273] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035984.223275] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035984.223374] ata2.00: status: { DRDY ERR }
[1035984.223402] ata2.00: error: { UNC }
[1035984.224904] ata2.00: configured for UDMA/133
[1035984.224945] ata2: EH complete
[1035987.131614] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035987.131653] ata2.00: irq_stat 0x40000008
[1035987.131683] ata2.00: failed command: READ FPDMA QUEUED
[1035987.131719] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035987.131722] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035987.131820] ata2.00: status: { DRDY ERR }
[1035987.131848] ata2.00: error: { UNC }
[1035987.207466] ata2.00: configured for UDMA/133
[1035987.207508] ata2: EH complete
[1035990.123383] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035990.123420] ata2.00: irq_stat 0x40000008
[1035990.123450] ata2.00: failed command: READ FPDMA QUEUED
[1035990.123487] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035990.123489] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035990.123588] ata2.00: status: { DRDY ERR }
[1035990.123616] ata2.00: error: { UNC }
[1035990.125279] ata2.00: configured for UDMA/133
[1035990.125320] ata2: EH complete
[1035992.989131] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035992.989169] ata2.00: irq_stat 0x40000008
[1035992.989199] ata2.00: failed command: READ FPDMA QUEUED
[1035992.989235] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035992.989237] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035992.989334] ata2.00: status: { DRDY ERR }
[1035992.989362] ata2.00: error: { UNC }
[1035993.062065] ata2.00: configured for UDMA/133
[1035993.062106] ata2: EH complete
[1035995.965301] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1035995.965339] ata2.00: irq_stat 0x40000008
[1035995.965369] ata2.00: failed command: READ FPDMA QUEUED
[1035995.965406] ata2.00: cmd 60/08:00:38:18:80/00:00:72:00:00/40 tag 0 ncq 4096 in
[1035995.965408] res 41/40:08:38:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1035995.965506] ata2.00: status: { DRDY ERR }
[1035995.965534] ata2.00: error: { UNC }
[1035995.966942] ata2.00: configured for UDMA/133
[1035995.966982] sd 1:0:0:0: [sdb] Unhandled sense code
[1035995.967012] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1035995.967067] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1035995.967134] Descriptor sense data with sense descriptors (in hex):
[1035995.967169] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1035995.967270] 72 80 18 38
[1035995.967316] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1035995.967378] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 72 80 18 38 00 00 08 00
[1035995.967465] end_request: I/O error, dev sdb, sector 1920997432
[1035995.967513] ata2: EH complete
[1035996.008330] raid1:md2: read error corrected (8 sectors at 1852835896 on sdb3)
[1035999.037750] raid1: sdb3: redirecting sector 1852833792 to another mirror
[1036002.658503] ata2.00: exception Emask 0x0 SAct 0x5 SErr 0x0 action 0x0
[1036002.658542] ata2.00: irq_stat 0x40000008
[1036002.658572] ata2.00: failed command: READ FPDMA QUEUED
[1036002.658610] ata2.00: cmd 60/e0:00:00:18:80/00:00:72:00:00/40 tag 0 ncq 114688 in
[1036002.658612] res 41/40:e0:30:18:80/00:00:72:00:00/00 Emask 0x409 (media error) <F>
[1036002.658709] ata2.00: status: { DRDY ERR }
[1036002.658738] ata2.00: error: { UNC }
[1036002.688193] ata2.00: configured for UDMA/133
[1036002.688237] ata2: EH complete
[1036697.993405] ata2.00: exception Emask 0x0 SAct 0x4 SErr 0x0 action 0x0
[1036697.993433] ata2.00: irq_stat 0x40000008
[1036697.993457] ata2.00: failed command: READ FPDMA QUEUED
[1036697.993482] ata2.00: cmd 60/00:10:c8:d8:3a/01:00:4d:00:00/40 tag 2 ncq 131072 in
[1036697.993483] res 41/40:00:40:d9:3a/00:01:4d:00:00/00 Emask 0x409 (media error) <F>
[1036697.993560] ata2.00: status: { DRDY ERR }
[1036697.993582] ata2.00: error: { UNC }
[1036697.994832] ata2.00: configured for UDMA/133
[1036697.994860] ata2: EH complete
[1036767.154518] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1036767.154561] ata2.00: irq_stat 0x40000008
[1036767.154596] ata2.00: failed command: READ FPDMA QUEUED
[1036767.154639] ata2.00: cmd 60/00:08:e0:6a:88/02:00:6b:00:00/40 tag 1 ncq 262144 in
[1036767.154642] res 41/40:00:60:6b:88/00:02:6b:00:00/00 Emask 0x409 (media error) <F>
[1036767.154743] ata2.00: status: { DRDY ERR }
[1036767.154773] ata2.00: error: { UNC }
[1036767.187127] ata2.00: configured for UDMA/133
[1036767.187170] ata2: EH complete
[1036770.163032] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036770.163071] ata2.00: irq_stat 0x40000008
[1036770.163101] ata2.00: failed command: READ FPDMA QUEUED
[1036770.163139] ata2.00: cmd 60/00:00:e0:6a:88/02:00:6b:00:00/40 tag 0 ncq 262144 in
[1036770.163141] res 41/40:00:60:6b:88/00:02:6b:00:00/00 Emask 0x409 (media error) <F>
[1036770.163238] ata2.00: status: { DRDY ERR }
[1036770.163267] ata2.00: error: { UNC }
[1036770.164713] ata2.00: configured for UDMA/133
[1036770.164756] ata2: EH complete
[1036970.091943] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1036970.091981] ata2.00: irq_stat 0x40000008
[1036970.092025] ata2.00: failed command: READ FPDMA QUEUED
[1036970.092065] ata2.00: cmd 60/00:00:e0:88:4f/01:00:80:00:00/40 tag 0 ncq 131072 in
[1036970.092068] res 41/40:00:48:89:4f/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1036970.092175] ata2.00: status: { DRDY ERR }
[1036970.101419] ata2.00: error: { UNC }
[1036970.130716] ata2.00: configured for UDMA/133
[1036970.130760] ata2: EH complete
[1036973.837852] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1036973.837890] ata2.00: irq_stat 0x40000008
[1036973.837921] ata2.00: failed command: READ FPDMA QUEUED
[1036973.837958] ata2.00: cmd 60/00:08:e0:88:4f/01:00:80:00:00/40 tag 1 ncq 131072 in
[1036973.837960] res 41/40:00:48:89:4f/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1036973.838057] ata2.00: status: { DRDY ERR }
[1036973.838086] ata2.00: error: { UNC }
[1036973.839456] ata2.00: configured for UDMA/133
[1036973.839495] ata2: EH complete
[1036977.776188] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036977.776225] ata2.00: irq_stat 0x40000008
[1036977.776256] ata2.00: failed command: READ FPDMA QUEUED
[1036977.776294] ata2.00: cmd 60/00:00:e0:88:4f/01:00:80:00:00/40 tag 0 ncq 131072 in
[1036977.776296] res 41/40:00:48:89:4f/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1036977.776393] ata2.00: status: { DRDY ERR }
[1036977.776421] ata2.00: error: { UNC }
[1036977.797586] ata2.00: configured for UDMA/133
[1036977.797629] ata2: EH complete
[1036982.138142] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036982.138180] ata2.00: irq_stat 0x40000008
[1036982.138210] ata2.00: failed command: READ FPDMA QUEUED
[1036982.138247] ata2.00: cmd 60/00:00:e0:88:4f/01:00:80:00:00/40 tag 0 ncq 131072 in
[1036982.138249] res 41/40:00:48:89:4f/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1036982.138347] ata2.00: status: { DRDY ERR }
[1036982.138376] ata2.00: error: { UNC }
[1036982.139781] ata2.00: configured for UDMA/133
[1036982.139822] ata2: EH complete
[1036986.521694] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036986.521732] ata2.00: irq_stat 0x40000008
[1036986.521762] ata2.00: failed command: READ FPDMA QUEUED
[1036986.521799] ata2.00: cmd 60/00:00:e0:88:4f/01:00:80:00:00/40 tag 0 ncq 131072 in
[1036986.521801] res 41/40:00:48:89:4f/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1036986.521898] ata2.00: status: { DRDY ERR }
[1036986.521926] ata2.00: error: { UNC }
[1036986.523240] ata2.00: configured for UDMA/133
[1036986.523281] ata2: EH complete
[1036990.721857] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036990.721894] ata2.00: irq_stat 0x40000008
[1036990.721925] ata2.00: failed command: READ FPDMA QUEUED
[1036990.721961] ata2.00: cmd 60/00:00:e0:88:4f/01:00:80:00:00/40 tag 0 ncq 131072 in
[1036990.721963] res 41/40:00:48:89:4f/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1036990.722061] ata2.00: status: { DRDY ERR }
[1036990.722089] ata2.00: error: { UNC }
[1036990.723467] ata2.00: configured for UDMA/133
[1036990.723510] sd 1:0:0:0: [sdb] Unhandled sense code
[1036990.723540] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1036990.723593] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1036990.723658] Descriptor sense data with sense descriptors (in hex):
[1036990.723693] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1036990.723795] 80 4f 89 48
[1036990.723842] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1036990.723903] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 80 4f 88 e0 00 01 00 00
[1036990.723990] end_request: I/O error, dev sdb, sector 2152696136
[1036990.724046] raid1: sdb3: rescheduling sector 2084532448
[1036990.724081] raid1: sdb3: rescheduling sector 2084532696
[1036990.724127] ata2: EH complete
[1036994.347014] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036994.347051] ata2.00: irq_stat 0x40000008
[1036994.347081] ata2.00: failed command: READ FPDMA QUEUED
[1036994.347118] ata2.00: cmd 60/08:00:48:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1036994.347121] res 41/40:08:48:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1036994.347217] ata2.00: status: { DRDY ERR }
[1036994.347245] ata2.00: error: { UNC }
[1036994.348732] ata2.00: configured for UDMA/133
[1036994.348773] ata2: EH complete
[1036996.980447] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036996.980485] ata2.00: irq_stat 0x40000008
[1036996.980516] ata2.00: failed command: READ FPDMA QUEUED
[1036996.980553] ata2.00: cmd 60/08:00:48:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1036996.980555] res 41/40:08:48:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1036996.980652] ata2.00: status: { DRDY ERR }
[1036996.980680] ata2.00: error: { UNC }
[1036996.982120] ata2.00: configured for UDMA/133
[1036996.982159] ata2: EH complete
[1036999.597211] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1036999.597249] ata2.00: irq_stat 0x40000008
[1036999.597279] ata2.00: failed command: READ FPDMA QUEUED
[1036999.597316] ata2.00: cmd 60/08:00:48:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1036999.597318] res 41/40:08:48:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1036999.597417] ata2.00: status: { DRDY ERR }
[1036999.597445] ata2.00: error: { UNC }
[1036999.598826] ata2.00: configured for UDMA/133
[1036999.598866] ata2: EH complete
[1037002.280617] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037002.280655] ata2.00: irq_stat 0x40000008
[1037002.280686] ata2.00: failed command: READ FPDMA QUEUED
[1037002.280722] ata2.00: cmd 60/08:00:48:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037002.280724] res 41/40:08:48:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037002.280820] ata2.00: status: { DRDY ERR }
[1037002.280848] ata2.00: error: { UNC }
[1037002.282243] ata2.00: configured for UDMA/133
[1037002.282282] ata2: EH complete
[1037004.855773] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037004.855811] ata2.00: irq_stat 0x40000008
[1037004.855841] ata2.00: failed command: READ FPDMA QUEUED
[1037004.855878] ata2.00: cmd 60/08:00:48:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037004.855880] res 41/40:08:48:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037004.855977] ata2.00: status: { DRDY ERR }
[1037004.856022] ata2.00: error: { UNC }
[1037004.857697] ata2.00: configured for UDMA/133
[1037004.857737] ata2: EH complete
[1037007.539202] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037007.539239] ata2.00: irq_stat 0x40000008
[1037007.539269] ata2.00: failed command: READ FPDMA QUEUED
[1037007.539305] ata2.00: cmd 60/08:00:48:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037007.539307] res 41/40:08:48:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037007.539405] ata2.00: status: { DRDY ERR }
[1037007.539433] ata2.00: error: { UNC }
[1037007.540935] ata2.00: configured for UDMA/133
[1037007.540978] sd 1:0:0:0: [sdb] Unhandled sense code
[1037007.541008] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1037007.541061] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1037007.541127] Descriptor sense data with sense descriptors (in hex):
[1037007.541163] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1037007.541266] 80 4f 89 48
[1037007.541312] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1037007.541373] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 80 4f 89 48 00 00 08 00
[1037007.541462] end_request: I/O error, dev sdb, sector 2152696136
[1037007.541513] ata2: EH complete
[1037007.553987] raid1:md2: read error corrected (8 sectors at 2084534600 on sdb3)
[1037010.147584] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037010.147622] ata2.00: irq_stat 0x40000008
[1037010.147652] ata2.00: failed command: READ FPDMA QUEUED
[1037010.147687] ata2.00: cmd 60/08:00:50:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037010.147690] res 41/40:08:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037010.147786] ata2.00: status: { DRDY ERR }
[1037010.147815] ata2.00: error: { UNC }
[1037010.149217] ata2.00: configured for UDMA/133
[1037010.149256] ata2: EH complete
[1037012.722722] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037012.722761] ata2.00: irq_stat 0x40000008
[1037012.722791] ata2.00: failed command: READ FPDMA QUEUED
[1037012.722827] ata2.00: cmd 60/08:00:50:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037012.722829] res 41/40:08:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037012.722928] ata2.00: status: { DRDY ERR }
[1037012.722956] ata2.00: error: { UNC }
[1037012.724371] ata2.00: configured for UDMA/133
[1037012.724411] ata2: EH complete
[1037014.642430] raid1: sdb3: redirecting sector 2084532448 to another mirror
[1037018.572972] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1037018.573009] ata2.00: irq_stat 0x40000008
[1037018.573039] ata2.00: failed command: READ FPDMA QUEUED
[1037018.573076] ata2.00: cmd 60/f8:00:e0:88:4f/00:00:80:00:00/40 tag 0 ncq 126976 in
[1037018.573078] res 41/40:f8:58:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037018.582357] ata2.00: status: { DRDY ERR }
[1037018.582387] ata2.00: error: { UNC }
[1037018.583965] ata2.00: configured for UDMA/133
[1037018.584025] ata2: EH complete
[1037022.414801] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1037022.414838] ata2.00: irq_stat 0x40000008
[1037022.414869] ata2.00: failed command: READ FPDMA QUEUED
[1037022.414906] ata2.00: cmd 60/f8:08:e0:88:4f/00:00:80:00:00/40 tag 1 ncq 126976 in
[1037022.414908] res 41/40:f8:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037022.415006] ata2.00: status: { DRDY ERR }
[1037022.415034] ata2.00: error: { UNC }
[1037022.416389] ata2.00: configured for UDMA/133
[1037022.416432] ata2: EH complete
[1037026.289960] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1037026.289996] ata2.00: irq_stat 0x40000008
[1037026.290027] ata2.00: failed command: READ FPDMA QUEUED
[1037026.290064] ata2.00: cmd 60/f8:00:e0:88:4f/00:00:80:00:00/40 tag 0 ncq 126976 in
[1037026.290066] res 41/40:f8:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037026.290164] ata2.00: status: { DRDY ERR }
[1037026.290192] ata2.00: error: { UNC }
[1037026.291532] ata2.00: configured for UDMA/133
[1037026.291573] ata2: EH complete
[1037030.056715] ata2.00: exception Emask 0x0 SAct 0x3 SErr 0x0 action 0x0
[1037030.056754] ata2.00: irq_stat 0x40000008
[1037030.056784] ata2.00: failed command: READ FPDMA QUEUED
[1037030.056820] ata2.00: cmd 60/f8:08:e0:88:4f/00:00:80:00:00/40 tag 1 ncq 126976 in
[1037030.056823] res 41/40:f8:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037030.056920] ata2.00: status: { DRDY ERR }
[1037030.056948] ata2.00: error: { UNC }
[1037030.058281] ata2.00: configured for UDMA/133
[1037030.058325] ata2: EH complete
[1037033.978137] ata2.00: exception Emask 0x0 SAct 0x7 SErr 0x0 action 0x0
[1037033.978175] ata2.00: irq_stat 0x40000008
[1037033.978205] ata2.00: failed command: READ FPDMA QUEUED
[1037033.978242] ata2.00: cmd 60/f8:00:e0:88:4f/00:00:80:00:00/40 tag 0 ncq 126976 in
[1037033.978244] res 41/40:f8:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037033.978342] ata2.00: status: { DRDY ERR }
[1037033.978371] ata2.00: error: { UNC }
[1037034.016493] ata2.00: configured for UDMA/133
[1037034.016539] ata2: EH complete
[1037037.832030] ata2.00: exception Emask 0x0 SAct 0x4 SErr 0x0 action 0x0
[1037037.832067] ata2.00: irq_stat 0x40000008
[1037037.832097] ata2.00: failed command: READ FPDMA QUEUED
[1037037.832134] ata2.00: cmd 60/f8:10:e0:88:4f/00:00:80:00:00/40 tag 2 ncq 126976 in
[1037037.832137] res 41/40:f8:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037037.832234] ata2.00: status: { DRDY ERR }
[1037037.832262] ata2.00: error: { UNC }
[1037037.833633] ata2.00: configured for UDMA/133
[1037037.833674] sd 1:0:0:0: [sdb] Unhandled sense code
[1037037.833704] sd 1:0:0:0: [sdb] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
[1037037.833758] sd 1:0:0:0: [sdb] Sense Key : Medium Error [current] [descriptor]
[1037037.833825] Descriptor sense data with sense descriptors (in hex):
[1037037.833861] 72 03 11 04 00 00 00 0c 00 0a 80 00 00 00 00 00
[1037037.833962] 80 4f 89 50
[1037037.834008] sd 1:0:0:0: [sdb] Add. Sense: Unrecovered read error - auto reallocate failed
[1037037.834070] sd 1:0:0:0: [sdb] CDB: Read(10): 28 00 80 4f 88 e0 00 00 f8 00
[1037037.834159] end_request: I/O error, dev sdb, sector 2152696144
[1037037.834192] raid1: sdb3: rescheduling sector 2084532448
[1037037.834233] ata2: EH complete
[1037038.363651] raid1: sdb3: redirecting sector 2084532696 to another mirror
[1037043.077715] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037043.077752] ata2.00: irq_stat 0x40000008
[1037043.077782] ata2.00: failed command: READ FPDMA QUEUED
[1037043.077819] ata2.00: cmd 60/08:00:50:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037043.077821] res 41/40:08:50:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037043.077917] ata2.00: status: { DRDY ERR }
[1037043.077945] ata2.00: error: { UNC }
[1037043.096485] ata2.00: configured for UDMA/133
[1037043.096527] ata2: EH complete
[1037046.357715] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037046.357752] ata2.00: irq_stat 0x40000008
[1037046.357782] ata2.00: failed command: READ FPDMA QUEUED
[1037046.357818] ata2.00: cmd 60/08:00:58:89:4f/00:00:80:00:00/40 tag 0 ncq 4096 in
[1037046.357820] res 41/40:08:58:89:4f/00:00:80:00:00/00 Emask 0x409 (media error) <F>
[1037046.357918] ata2.00: status: { DRDY ERR }
[1037046.357946] ata2.00: error: { UNC }
[1037046.389177] ata2.00: configured for UDMA/133
[1037046.389218] ata2: EH complete
[1037049.335351] raid1: sda3: redirecting sector 2084532448 to another mirror
[1037072.108409] ata2.00: exception Emask 0x0 SAct 0x1d SErr 0x0 action 0x0
[1037072.108448] ata2.00: irq_stat 0x40000008
[1037072.108478] ata2.00: failed command: READ FPDMA QUEUED
[1037072.108516] ata2.00: cmd 60/00:00:c0:ed:6f/02:00:80:00:00/40 tag 0 ncq 262144 in
[1037072.108518] res 41/40:00:f8:ee:6f/00:02:80:00:00/00 Emask 0x409 (media error) <F>
[1037072.108617] ata2.00: status: { DRDY ERR }
[1037072.108645] ata2.00: error: { UNC }
[1037072.110051] ata2.00: configured for UDMA/133
[1037072.110098] ata2: EH complete
[1037081.568055] ata2.00: qc timeout (cmd 0x2f)
[1037081.568096] ata2: failed to read log page 10h (errno=-5)
[1037081.568132] ata2.00: exception Emask 0x1 SAct 0x7fffffff SErr 0x0 action 0x6 frozen
[1037081.568183] ata2.00: irq_stat 0x40000008
[1037081.568213] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.568250] ata2.00: cmd 61/08:00:20:18:10/00:00:04:00:00/40 tag 0 ncq 4096 out
[1037081.568252] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.568348] ata2.00: status: { DRDY }
[1037081.568377] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.568412] ata2.00: cmd 61/08:08:d0:18:10/00:00:04:00:00/40 tag 1 ncq 4096 out
[1037081.568414] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.568511] ata2.00: status: { DRDY }
[1037081.568539] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.568574] ata2.00: cmd 61/08:10:58:19:10/00:00:04:00:00/40 tag 2 ncq 4096 out
[1037081.568576] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.568670] ata2.00: status: { DRDY }
[1037081.568699] ata2.00: failed command: READ FPDMA QUEUED
[1037081.568734] ata2.00: cmd 60/00:18:c0:ed:6f/02:00:80:00:00/40 tag 3 ncq 262144 in
[1037081.568737] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.568832] ata2.00: status: { DRDY }
[1037081.568860] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.568896] ata2.00: cmd 61/10:20:88:19:10/00:00:04:00:00/40 tag 4 ncq 8192 out
[1037081.568898] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.568995] ata2.00: status: { DRDY }
[1037081.569023] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.569067] ata2.00: cmd 61/08:28:48:18:10/00:00:0b:00:00/40 tag 5 ncq 4096 out
[1037081.569069] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.569167] ata2.00: status: { DRDY }
[1037081.569195] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.569231] ata2.00: cmd 61/08:30:80:18:10/00:00:0b:00:00/40 tag 6 ncq 4096 out
[1037081.569233] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.569328] ata2.00: status: { DRDY }
[1037081.569357] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.569392] ata2.00: cmd 61/08:38:80:19:10/00:00:0b:00:00/40 tag 7 ncq 4096 out
[1037081.569394] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.569490] ata2.00: status: { DRDY }
[1037081.569518] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.569553] ata2.00: cmd 61/08:40:68:1a:10/00:00:0b:00:00/40 tag 8 ncq 4096 out
[1037081.569555] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.569652] ata2.00: status: { DRDY }
[1037081.569679] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.569715] ata2.00: cmd 61/08:48:38:1e:10/00:00:0b:00:00/40 tag 9 ncq 4096 out
[1037081.569717] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.569812] ata2.00: status: { DRDY }
[1037081.569840] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.569877] ata2.00: cmd 61/08:50:28:9c:10/00:00:0b:00:00/40 tag 10 ncq 4096 out
[1037081.569879] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.569975] ata2.00: status: { DRDY }
[1037081.579207] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.579249] ata2.00: cmd 61/08:58:18:3a:50/00:00:11:00:00/40 tag 11 ncq 4096 out
[1037081.579251] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.579352] ata2.00: status: { DRDY }
[1037081.579381] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.579420] ata2.00: cmd 61/08:60:80:18:10/00:00:36:00:00/40 tag 12 ncq 4096 out
[1037081.579424] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.579523] ata2.00: status: { DRDY }
[1037081.579553] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.579593] ata2.00: cmd 61/08:68:10:19:10/00:00:36:00:00/40 tag 13 ncq 4096 out
[1037081.579595] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.579696] ata2.00: status: { DRDY }
[1037081.579724] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.579759] ata2.00: cmd 61/08:70:00:99:10/00:00:36:00:00/40 tag 14 ncq 4096 out
[1037081.579761] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.579857] ata2.00: status: { DRDY }
[1037081.579886] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.579921] ata2.00: cmd 61/10:78:88:98:32/00:00:49:00:00/40 tag 15 ncq 8192 out
[1037081.579923] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.580038] ata2.00: status: { DRDY }
[1037081.580068] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.580107] ata2.00: cmd 61/08:80:38:18:50/00:00:49:00:00/40 tag 16 ncq 4096 out
[1037081.580111] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.580211] ata2.00: status: { DRDY }
[1037081.580238] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.580274] ata2.00: cmd 61/08:88:50:18:50/00:00:49:00:00/40 tag 17 ncq 4096 out
[1037081.580276] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.580372] ata2.00: status: { DRDY }
[1037081.580399] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.580435] ata2.00: cmd 61/08:90:10:18:90/00:00:49:00:00/40 tag 18 ncq 4096 out
[1037081.580437] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.580533] ata2.00: status: { DRDY }
[1037081.580561] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.580596] ata2.00: cmd 61/08:98:60:18:50/00:00:54:00:00/40 tag 19 ncq 4096 out
[1037081.580598] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.580694] ata2.00: status: { DRDY }
[1037081.580722] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.580757] ata2.00: cmd 61/a8:a0:08:c4:8c/00:00:54:00:00/40 tag 20 ncq 86016 out
[1037081.580760] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.580855] ata2.00: status: { DRDY }
[1037081.580883] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.580919] ata2.00: cmd 61/38:a8:f8:39:9c/00:00:54:00:00/40 tag 21 ncq 28672 out
[1037081.580921] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581019] ata2.00: status: { DRDY }
[1037081.581047] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.581082] ata2.00: cmd 61/10:b0:f8:48:9c/00:00:54:00:00/40 tag 22 ncq 8192 out
[1037081.581084] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581178] ata2.00: status: { DRDY }
[1037081.581206] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.581240] ata2.00: cmd 61/70:b8:48:9d:9e/00:00:54:00:00/40 tag 23 ncq 57344 out
[1037081.581242] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581338] ata2.00: status: { DRDY }
[1037081.581365] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.581400] ata2.00: cmd 61/08:c0:08:18:10/00:00:58:00:00/40 tag 24 ncq 4096 out
[1037081.581402] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581498] ata2.00: status: { DRDY }
[1037081.581526] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.581561] ata2.00: cmd 61/08:c8:a8:1a:10/00:00:58:00:00/40 tag 25 ncq 4096 out
[1037081.581563] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581657] ata2.00: status: { DRDY }
[1037081.581686] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.581721] ata2.00: cmd 61/08:d0:08:18:90/00:00:61:00:00/40 tag 26 ncq 4096 out
[1037081.581723] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581819] ata2.00: status: { DRDY }
[1037081.581847] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.581881] ata2.00: cmd 61/08:d8:00:19:90/00:00:61:00:00/40 tag 27 ncq 4096 out
[1037081.581883] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.581981] ata2.00: status: { DRDY }
[1037081.582008] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.582044] ata2.00: cmd 61/08:e0:58:1a:90/00:00:61:00:00/40 tag 28 ncq 4096 out
[1037081.582046] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.582143] ata2.00: status: { DRDY }
[1037081.582170] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.582205] ata2.00: cmd 61/08:e8:98:1c:90/00:00:61:00:00/40 tag 29 ncq 4096 out
[1037081.582207] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.582302] ata2.00: status: { DRDY }
[1037081.582330] ata2.00: failed command: WRITE FPDMA QUEUED
[1037081.582366] ata2.00: cmd 61/08:f0:08:1d:90/00:00:61:00:00/40 tag 30 ncq 4096 out
[1037081.582368] res 40/00:a0:08:c4:8c/00:00:54:00:00/40 Emask 0x1 (device error)
[1037081.582464] ata2.00: status: { DRDY }
[1037081.582496] ata2: hard resetting link
[1037082.124067] ata2: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[1037082.231185] ata2.00: configured for UDMA/133
[1037082.231271] ata2: EH complete
[1037086.749141] ata2.00: exception Emask 0x0 SAct 0x8000000 SErr 0x0 action 0x0
[1037086.749181] ata2.00: irq_stat 0x40000008
[1037086.749215] ata2.00: failed command: READ FPDMA QUEUED
[1037086.749251] ata2.00: cmd 60/00:d8:c0:ed:6f/02:00:80:00:00/40 tag 27 ncq 262144 in
[1037086.749254] res 41/40:00:f8:ee:6f/00:02:80:00:00/00 Emask 0x409 (media error) <F>
[1037086.749351] ata2.00: status: { DRDY ERR }
[1037086.749379] ata2.00: error: { UNC }
[1037086.785422] ata2.00: configured for UDMA/133
[1037086.785465] ata2: EH complete
[1037090.192525] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037090.192562] ata2.00: irq_stat 0x40000008
[1037090.192593] ata2.00: failed command: READ FPDMA QUEUED
[1037090.192630] ata2.00: cmd 60/00:00:c0:ed:6f/02:00:80:00:00/40 tag 0 ncq 262144 in
[1037090.192632] res 41/40:00:f0:ee:6f/00:02:80:00:00/00 Emask 0x409 (media error) <F>
[1037090.192729] ata2.00: status: { DRDY ERR }
[1037090.192757] ata2.00: error: { UNC }
[1037090.194082] ata2.00: configured for UDMA/133
[1037090.194122] ata2: EH complete
[1037117.826952] ata2.00: exception Emask 0x0 SAct 0x2 SErr 0x0 action 0x0
[1037117.826990] ata2.00: irq_stat 0x40000008
[1037117.827020] ata2.00: failed command: READ FPDMA QUEUED
[1037117.827058] ata2.00: cmd 60/00:08:e0:b3:73/01:00:80:00:00/40 tag 1 ncq 131072 in
[1037117.827060] res 41/40:00:80:b4:73/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1037117.827159] ata2.00: status: { DRDY ERR }
[1037117.827187] ata2.00: error: { UNC }
[1037117.828736] ata2.00: configured for UDMA/133
[1037117.828779] ata2: EH complete
[1037121.048522] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037121.048559] ata2.00: irq_stat 0x40000008
[1037121.048589] ata2.00: failed command: READ FPDMA QUEUED
[1037121.048627] ata2.00: cmd 60/00:00:e0:b3:73/01:00:80:00:00/40 tag 0 ncq 131072 in
[1037121.048629] res 41/40:00:88:b4:73/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1037121.048729] ata2.00: status: { DRDY ERR }
[1037121.048757] ata2.00: error: { UNC }
[1037121.070132] ata2.00: configured for UDMA/133
[1037121.070174] ata2: EH complete
[1037124.277153] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037124.277191] ata2.00: irq_stat 0x40000008
[1037124.277222] ata2.00: failed command: READ FPDMA QUEUED
[1037124.277258] ata2.00: cmd 60/00:00:e0:b3:73/01:00:80:00:00/40 tag 0 ncq 131072 in
[1037124.277260] res 41/40:00:80:b4:73/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1037124.277358] ata2.00: status: { DRDY ERR }
[1037124.277386] ata2.00: error: { UNC }
[1037124.279047] ata2.00: configured for UDMA/133
[1037124.279088] ata2: EH complete
[1037127.927309] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037127.936541] ata2.00: irq_stat 0x40000008
[1037127.936575] ata2.00: failed command: READ FPDMA QUEUED
[1037127.936639] ata2.00: cmd 60/00:00:e0:b3:73/01:00:80:00:00/40 tag 0 ncq 131072 in
[1037127.936642] res 41/40:00:88:b4:73/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1037127.936740] ata2.00: status: { DRDY ERR }
[1037127.936768] ata2.00: error: { UNC }
[1037127.938219] ata2.00: configured for UDMA/133
[1037127.938259] ata2: EH complete
[1037130.835765] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037130.835803] ata2.00: irq_stat 0x40000008
[1037130.835833] ata2.00: failed command: READ FPDMA QUEUED
[1037130.835871] ata2.00: cmd 60/00:00:e0:b3:73/01:00:80:00:00/40 tag 0 ncq 131072 in
[1037130.835873] res 41/40:00:80:b4:73/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1037130.835971] ata2.00: status: { DRDY ERR }
[1037130.835999] ata2.00: error: { UNC }
[1037130.837615] ata2.00: configured for UDMA/133
[1037130.837657] ata2: EH complete
[1037142.719617] ata2.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x0
[1037142.719655] ata2.00: irq_stat 0x40000008
[1037142.719685] ata2.00: failed command: READ FPDMA QUEUED
[1037142.719722] ata2.00: cmd 60/00:00:e0:58:75/01:00:80:00:00/40 tag 0 ncq 131072 in
[1037142.719724] res 41/40:00:e0:58:75/00:01:80:00:00/00 Emask 0x409 (media error) <F>
[1037142.719823] ata2.00: status: { DRDY ERR }
[1037142.719852] ata2.00: error: { UNC }
[1037142.721282] ata2.00: configured for UDMA/133
[1037142.721322] ata2: EH complete

Na, da haben wir ja einiges an Lese/Schreib-Fehler auf ata2.
Tausche mal die Kabel. Sata Kabel werden gern ma locker bzw. die billigen gehn auch mal kaputt.
Was sagen die S.M.A.R.T-Werte der Platte?

SMART bringt keine Fehler. Ich wende mich mal an Hetzner, eventuell können die was machen.

Zitat von @AS-N00:

SMART bringt keine Fehler. Ich wende mich mal an Hetzner, eventuell können die was machen.

Moin,

Du könntest noch ein ddrescue /dev/sda /dev/null auf die Platte loslassen und schauen, ob es Bereiche gibt, in denen das System deutlich mehr Zeit benötigt als in anderen. Das passiert z.B. wenn korrigierbare lesefehler auf der Platte sind. Diese wirken sich auf smart nicht so arg aus, bremsen das System aber sehr stark aus.

lks

Zitat von @AS-N00:

SMART bringt keine Fehler. Ich wende mich mal an Hetzner, eventuell können die was machen.

Ich wollte ja schon heute in der Früh antworten:
Ich wette 'nen Fuffi, Du hostest bei Hetzner; und der Fehler kommt wegen einer Platte, die am A§%"! ist.

1. ich hoffe, Du hast ein Backup.
2. Deine Platte ist hinüber
3. Support bräuchte ein paar Stunden, um das selbst zu checken; daher schick' denen gleich den obrigen Auszug mit in das Ticket.
4. Ich habe früher auch tartarus benutzt; mittlerweile habe ich eine effizientere Möglichkeit gefunden, Backups täglich zu erstellen, und vor allem den Restore zu verkürzen...

Lonesome Walker
(der fast seinen ganzen Server-Park bei Hetzner hat...)

Naja, Backup habe ich ja (noch) nicht, da das ganze nie zu Ende durchläuft. Ich kann maximal den Server auf einen anderen spiegeln, das sollt gehen.

@Lochkartenstanzer hat ja schon ddrescue erwähnt. Damit kannst du nicht nur die Plattenperformance testen, sondern auch alle noch lesbaren Sektoren backupen. Besser vorm Serverwechsel etwas mit ddrescue gesichert zu haben als gar nix mit tar.

Zitat von @Cthluhu:

@Lochkartenstanzer hat ja schon ddrescue erwähnt. Damit kannst du nicht nur die Plattenperformance testen, sondern auch alle
noch lesbaren Sektoren backupen.

Ja, das auch. Aber mit dd-rescue kann man auch sehr gut schauen, wo die Platte "stockt". Meist fällt der "aktuelle Durchsatz" rapide extrem unter den durchschnittlichen Durchsatz, wenn Probleme der stelle vorhanden sind. wenn man natürlich statt devnull natürlich ein iscsi-device nimmt, hat man gleichzeitig ein backup.

.

lks

Zitat von @Lochkartenstanzer:
Aber mit dd-rescue kann man auch sehr gut schauen, wo die Platte "stockt". Meist fällt der
"aktuelle Durchsatz" rapide extrem unter den durchschnittlichen Durchsatz, wenn Probleme der stelle vorhanden sind.
wenn man natürlich statt devnull natürlich ein iscsi-device nimmt, hat man gleichzeitig ein backup.

Ich wollte drauf hinaus, dass man seine eventuell schon defekte Platte nicht mit einem "leerlauf" von ddrescue stressen sollte, wenn man dabei quasi gratis ein backup bekommt.

Kann ich mit ddrescue direkt auf den Backup-FTP sichern?

Zitat von @AS-N00:

Kann ich mit ddrescue direkt auf den Backup-FTP sichern?

Glaube ich nicht. Ich würde einfach einen günstigen zweiten root-Server bei hetzner mieten (gibts schon ab 20€), vorzugsweise im gleichen RZ und da die datei einfach über einen einem ssh/vpn-tunnel schaufeln. dd-rescue kann über stdout auf pipes schreiben.:

dd-rescue /dev/sda - | nc zweiter-server port

dazu muß natürlich auf dem zweiten serve rein passendes "nc-l port | dd of=zielimage" laufen.

lks

Zitat von @AS-N00:
Kann ich mit ddrescue direkt auf den Backup-FTP sichern?

Direkt geht das nicht. Du kannst aber FTP-Freigaben ganz normal mounten. Frag einfach eine Suchmaschine deiner Wahl nach "mount ftp". Dann kannst du mit ddrescue auch auf FTP-Freigaben sichern.