Periods
HCL MIM JoinedHCL confirmed no alerts in K2 for Database or Storage,HCL Storage team joinedHCL validates hard Drives for one of the K2 based DB server - k2fndsql02. The drives were found to be healthyHCL & Disney Storage teams start looking into the VMAX array (K2T1SAN01)Keystone database failover initiatedKeystone databased failed over from K2 to K3. Application service restarts and manual work required to present Keystone services on the new database instance.Storage team confirms that both A & B Side of the fabric is down.Keystone failover completed. Application validations remain underway."DPEP Shopdisney, Shop Marvel, Build-A-Band, Tax Services for Disney+ and EPSN+ still impacted as other servers affected by storage issue remain affected.
ESPN Publishing / content editing still affected, other servers affected by storage issue remain affected."SR# 16711805 opened with EMCDPEP impact, with exception of ShopDisney, declared resolved.Dispatch is calling the CE to request them to be on site. No ETA yet.Hour and a half ETA for the tech to arrive on site.DPEP Tax Service (Disney+, ESPN+) recovered after failover to standby database.DPEP ShopDisneyParks recovered after failover to standby database.EMC Engineer arrives on site to investigate the VMAX arrayconfirms that 4 sps faulted and need to be replaced, 3 are weak
Comments