SUMMARY: Sun Fire x2270 AHCI watchdog timeout

[Bertold Kolics]

Hi,

Thanks to all who responded (Sean Franklin and Peter van Gemert).

SUMMARY:
Sean said that it may help to upgrade to the latest patch cluster. This is
already the case.

Peter suggested looking at
http://bugs.opensolaris.org/view_bug.do?bug_id=6728187. Based on this bug
report, I e-mailed the responsible engineer (Ying Tian) who confirmed that
this issue is actually documented in a related bug.

The related bug is unfortunately not published (6903307: Interrupt problem on
Wasp platform) and - obviously - not resolved yet. (Wasp is the codename for
Sun Fire x2270 systems).
I expect Sun to fix this issue and release a patch, but I have no information
on when that would happen.

Bertold


ORIGINAL MESSAGE:
I have Sun Fire x2270 system running Solaris 10 10/09 and using 4 internal
SATA disks. The disks in this system are mirrored 4-way using ZFS. The system
locks up every 2-3 days. When this happens, I can't login from the console (I
can only enter the login name, but I never get to the password prompt).

After power cycling the server,
- fmdump does not show any errors,
- /var/crash/<hostname> is empty,
- ZFS utilities don't indicate any disk errors,
- the service processor's event log has no relevant records,
- and the below lines can be seen in /var/adm/messages (i.e. these are the
last messages in the log before the reboot):

Dec  5 22:55:56 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 2 satapkt 0xfffffe9a07ea2540 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 0 satapkt 0xfffffe9a07ea21c0 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 0 satapkt 0xfffffe9a07ea0380 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 1 satapkt 0xfffffe9a07e71b60 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 1 satapkt 0xffffffffaec87b68 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 1 satapkt 0xfffffe996cdb4e08 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 1 satapkt 0xfffffe996cdbac48 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 3 satapkt 0xfffffe996ec23b60 timed out
Dec  5 22:56:11 x2270-17 ahci: [ID 517647 kern.warning] WARNING: ahci0:
watchdog port 3 satapkt 0xfffffe9a07e56d28 timed out

The system is on the latest firmware/BIOS/service processor release available
from Sun.

---
Bertold Kolics <bertold.kolics at unboundid.com>
Phone: +1.512.904.9130 x106, Fax: +1.512.519.4352