Firmware Upgrade to version 12.12.0-0098 or 12.12.0-0111 causes virtual disk loss - IBM ServeRAID M5000 Series
RETAIN tip: H206542
If the IBM ServeRAID M5014, M5015, or M5025 SAS/SATA Controller is upgraded to firmware version 12.12.0-0098 or 12.12.0-0111, from firmware 12.0.1-0097, or earlier levels, users might see the following message at Power On Self Test (POST):
All of the disks from your previous configuration are gone. If this is an unexpected message, then please power off your system and check your cables to ensure all disks are present. Please press any key to continue, or 'C' to load the configuration utility.
If the user then enters the configuration utility, all the disks will show as 'Unconfigured Good.'
The system can be any of the following IBM servers:
The system is configured with one or more of the following IBM options:
This tip is not software specific.
The 12.12.0-0098 and 12.12.0-0111 firmware for the ServeRAID M5000 Series SAS/SATA controller is affected.
The system has the symptom described above.
This issue is resolved in the ServeRAID M5000 Series SAS/SATA firmware update version 12.12.0-0126, or later levels.
The update is now available by selecting the appropriate Product Group, type of System, Product name, Product machine type, and Operating system on IBM Support's Fix Central web page, at the following URL:
If users encounter the symptom and message, the configuration will need to be recreated to retrieve data. To recreate the configuration, perform the following steps:
Note: Knowledge of previous configuration is required.
Once data has been retrieved from the recreated array, the array should be recreated. This is because the bad stripe table has been lost and will need to be recreated from scratch.
If the symptom message was not displayed after updating from version 12.0.1-0097, or an earlier level, to 12.12.0-0098 or 12.12.0-0111:
Immediately flash the firmware to level 12.12.0-0126. (Only the firmware needs to be flashed. The system itself does not require an immediate power cycle. The system still is exposed to the issue while it is at level 12.12.0-0111.
Note: Systems with firmware 12.0.1-0097, or earlier levels, can be flashed safely up to level 12.12.0-0126.
The issue stems from the firmware upgrade operation where users are upgrading IBM ServeRAID M5000 Series code from a very old firmware package to the latest firmware package.
The RAID configuration was created in 12.0.1-0097, or later the controller was upgraded to 12.12.0-0098 or 12.12.0-0111, using the required interim 12.12.0-0085 firmware upgrade.
Firmware 12.0.1-0097 does not support CacheCade, and therefore the reserved bits that later versions of firmware will use for CacheCade are set by default to '0xFF' in the metadata. After users upgrade to 12.12.0-0098 or 12.12.0-0111, the next metadata read (such as startup after restart) recognizes the '0xFF' as valid for a non-CacheCade volume and behaves properly.
However, if a logical disk state change occurs (such as consistency check, cache properties change, learn cycle, or rebuild), then the firmware updates the metadata, but makes an improperly qualified decision also to set the CacheCade flags to 'enabled' and 'cacheable.'
At the next restart, the firmware will read and consolidate the drive metadata. As it is interpreting the CacheCade information, it now finds '0xFD' instead of the previous '0xFF.' This tells firmware that CacheCade is enabled and that the CacheCade record contains valid data.
However, since the metadata originally was created by level 12.0.1.0097, the area that is now the CacheCade record is not initialized properly, and the validity check of this information will fail. This results in the volume being lost.
The ServeRAID M5000 series firmware version 12.12.0-0126 will allow users to flash from firmware 12.0.1-0097, or earlier versions, to a later version without experiencing the describe symptom.
Applicable countries and regions
Document id: MIGR-5091589