Labels

Veeam: Preparing replica VM Error: The operation has timed out with vCenter's Hardware Alarm

Received a noticed from the vCenter.
Alarm alarm.HostErrorAlarm on Host : A.B.C.D is Gray

Target: A.B.C.D
Stateless event alarm

Alarm Definition:
([Event alarm expression: Host error] OR [Event alarm expression: Host warning])

Event details:
Error detected on A.B.C.D in Pak Tin: Agent can't send heartbeats: Host is down


One datastore was inaccessible:


At the same time, notices from the Veeam
[Failed] Replication: Machine-01 (1 machines) 1 failed

Preparing replica VM Error: The operation has timed out
Error: The operation has timed out
 
 
Not only the Replication Failed, it affected the VM(s) of another Virtual Disk on the ESX server.
 
Ping the ESX Server:
icmp_seq=0 ttl=64 time=0.852 ms


Ping the VM(s)
Request timed out
 
Destination host unreachable
 
 
 
Changed the Server to be Maintenance Mode, then rebooted it.
 
To the Computer Room, checking the Hardware Health of the ESX Server:




 
One RAID1 failed fully. There was no the Virtual Disk 1:

 
Replaced the Hard Disk that had the slot showing wrong led, then "Degraded", the RAID did not back to work:
 
 
Finally, required to replace another Hard Disk. Then, a new RAID1 building:


All the VM(s) of another Virtual Disk on the Server were back to normal. 
 
As the VM(s) of the failed RAID1 were testing machines, it did not affect any services.



References
 
 



Update

Labels: