VMware ESXi 5 Error 'ALERT: LinScsi: SCSILinuxCmdDone:2220:Attempted double completion' with IBM 6 Gb Serial Attached SCSI Adapter - IBM Servers

Source

RETAIN tip: H207646

Symptom

IBM systems configured with an IBM 6 Gb SAS HBA, Option part number 46M0907, and running VMware ESXi 5.0 operating system, may encounter an unexpected System Halt resulting in a stop error or a Stop Error on a Purple Screen (PSOD).

VMware stop error screen capture and the support log files may show an error similar to the following:

ALERT: LinScsi: SCSILinuxCmdDone:2220:Attempted double completion

Affected Configurations

The system can be any of the following IBM servers:

• System x3100 M4, type 2582, any model
• System x3200 M2, type 4367, any model
• System x3200 M2, type 4368, any model
• System x3200 M2, type 9233, any model
• System x3200 M3, type 7327, any model
• System x3200 M3, type 7328, any model
• System x3250 M2, type 4190, any model
• System x3250 M2, type 4191, any model
• System x3250 M2, type 4194, any model
• System x3250 M3, type 4251, any model
• System x3250 M3, type 4252, any model
• System x3250 M3, type 4261, any model
• System x3350, type 4192, any model
• System x3350, type 4193, any model
• System x3400 M2, type 7836, any model
• System x3400 M2, type 7837, any model
• System x3400 M3, type 7378, any model
• System x3400 M3, type 7379, any model
• System x3400, type 7973, any model
• System x3400, type 7974, any model
• System x3400, type 7975, any model
• System x3400, type 7976, any model
• System x3455, type 7940, any model
• System x3455, type 7941, any model
• System x3455, type 7984, any model
• System x3455, type 7986, any model
• System x3500 M2, type 7839, any model
• System x3500 M3, type 7380, any model
• System x3500 M4, type 7383, any model
• System x3500, type 7977, any model
• System x3550 M2, type 4198, any model
• System x3550 M2, type 7946, any model
• System x3550 M3, type 4254, any model
• System x3550 M3, type 7944, any model
• System x3550 M4, type 5459, any model
• System x3550 M4, type 7914, any model
• System x3550, type 1013, any model
• System x3550, type 1913, any model
• System x3550, type 7978, any model
• System x3620 M3, type 7376, any model
• System x3630 M3, type 7377, any model
• System x3630 M4, type 7158, any model
• System x3650 M2, type 4199, any model
• System x3650 M2, type 7947, any model
• System x3650 M3, type 4255, any model
• System x3650 M3 HF, type 5454, any model
• System x3650 M3, type 7945, any model
• System x3650 M4, type 7915, any model
• System x3650, type 1914, any model
• System x3650, type 7979, any model
• System x3655, type 7943, any model
• System x3655, type 7985, any model
• System x3690 X5, type 7147, any model
• System x3690 X5, type 7148, any model
• System x3690 X5, type 7149, any model
• System x3690 X5, type 7192, any model
• System x3755 M3, type 7164, any model
• System x3850 M2, type 7141, any model
• System x3850 M2, type 7144, any model
• System x3850 M2, type 7233, any model
• System x3850 M2, type 7234, any model
• System x3850 X5, type 7143, any model
• System x3850 X5, type 7145, any model
• System x3850 X5, type 7146, any model
• System x3850 X5, type 7191, any model
• System x3950 M2, type 7141, any model
• System x3950 M2, type 7144, any model
• System x3950 M2, type 7233, any model
• System x3950 M2, type 7234, any model
• System x3950 X5, type 7143, any model
• System x3950 X5, type 7145, any model
• iDataPlex dx360 M3 Server, type 6391, any model

The system is configured with at least one of the following operating systems:

• VMware ESXi 5.0, any Update
• VMware ESXi 5.1, any Update
• VMware vSphere Hypervisor 5.0 with IBM Customization Installable, any Update
• VMware vSphere Hypervisor 5.1 with IBM Customization Installable, any Update

The system is configured with one or more of the following IBM options:

• IBM 6 Gigabit SAS Host Bus Adapter, option 46M0907, any replacement part number
  

Note: This does not imply that the network operating system will work under all combinations of hardware and software.

Please see the compatibility page for more information: http://www.ibm.com/systems/info/x86servers/serverproven/compat/us/

Solution

The fix for this issue is available.

Follow the instructions listed in VMware's Knowledge Base Article "ESXi/ESX host stops responding and displays a purple diagnostic screen with the error: Failed at vmkdrivers/src_9/vmklinux_9/vmware/linux_scsi.c:2221 -- NOT REACHED (2013655)" that can be found at the following URL::

• kb.vmware.com/KB/2013655

Workaround

Restarting the server will clear the condition.

Additional Information

The specific symptom observed is due to a VMware ESXi software defect where a level-triggered interrupt handler may be invoked on two (2) different CPUs in parallel at the same time, resulting in a number of failures.

The issue may manifest as a double-completion of a SCSI command or network packet, or as a memory corruption in the structures.

Note: This issue does not occur if the hardware or drivers use Edge-triggered legacy interrupts or Message Signaled Interrupts (MSI) or Message Signaled Interrupts eXtended (MSI-X), which has been enabled in the 'mpt2sas' driver version 15.x or later.