March 31, 2020
For educational institutions
⟶ Updated 2 months ago ⟶
List of edits
HCL MIM Joined
HCL confirmed no alerts in K2 for Database or Storage,
HCL Storage team joined
HCL validates hard Drives for one of the K2 based DB server - k2fndsql02. The drives were found to be healthy
HCL & Disney Storage teams start looking into the VMAX array (K2T1SAN01)
Keystone database failover initiated
Keystone databased failed over from K2 to K3. Application service restarts and manual work required to present Keystone services on the new database instance.
Storage team confirms that both A & B Side of the fabric is down.
Keystone failover completed. Application validations remain underway.
"DPEP Shopdisney, Shop Marvel, Build-A-Band, Tax Services for Disney+ and EPSN+ still impacted as other servers affected by storage issue remain affected. ESPN Publishing / content editing still affected, other servers affected by storage issue remain affected."
SR# 16711805 opened with EMC
DPEP impact, with exception of ShopDisney, declared resolved.
Dispatch is calling the CE to request them to be on site. No ETA yet.
Hour and a half ETA for the tech to arrive on site.
DPEP Tax Service (Disney+, ESPN+) recovered after failover to standby database.
DPEP ShopDisneyParks recovered after failover to standby database.
EMC Engineer arrives on site to investigate the VMAX array
confirms that 4 sps faulted and need to be replaced, 3 are weak
About & Feedback