How-To: Manually Repair a VMware Replica created by Veeam

KB ID: 1773
Products: Veeam Backup & Replication
Version: 6.x, 7.x, 8.x
Published:
Last Modified: 2016-09-21

Challenge

This article explains how to manually revert a replica to its base disks allow it to be remapped to a replication job and used as a seed in the case that the replicas snapshot files become corrupt.
 
NOTE: The actions take here should never be performed on a production server as a data loss could occur. These actions are only to be taken on a replica as Veeam has the ability to bring the replica up to date.
 
The following are error messages that may prompt the use of this KB article:
• A replication job may fail with a message such as “Unable to repair replica VM.”
• When the replication job attempt to create a snapshot on the replica it fails with “File or folder already exists.” In this case most often there is a loose file that is named like a snapshot but not associated with the replica. E.g. a file named DC01-0000001.VMDK, and when VMware goes to create the first snapshot on the replica it can’t because the file it was going to create already existed.
•Replication job fails with “Invalid Snapshot Configuration,” and you are able to determine that the error is coming from the replica by checking the replicas Tasks & Events.
•Replication job fails “CID mismatch error: The parent virtual disk has been modified since the child was created,” and you are able to determine that the error is coming from the replica by checking the replicas Tasks & Events.

Cause

An old or orphaned Snapshot file is linked to the vmx, and a new Snapshot is trying to use that file name.

Solution

Please be aware that as an alternative to performing the steps below, you may first attempt to clone the faulty replica within VMware, if it succeeds map the Replication job to the clone of the replica.
 
 
Note: Prior to beginning:
•Stop all replication jobs to target location of the replica in question.
•Manually check each target side proxy for stuck replica hotadded disks. (Consider switching the target proxies to use Network transport mode to prevent this if it becomes a problem). See KB1775 for details.
 
──────────────────────────────────────────────────────────
Gather Information
──────────────────────────────────────────────────────────
 
1. Edit the Replica
2. Note what disk files correlate to each SCSI ID.
      Example:
      [Datastore1] DC01_replica\DC01-00000023.vmdk     on SCSI0:0
      [Datastore1] DC01_replica\DC01_1-00000023.vmdk on SCSI0:1
      [Datastore2] DC01_replica\DC01-00000023.vmdk     on SCSI0:2
 
──────────────────────────────────────────────────────────
Prepare the Replica
──────────────────────────────────────────────────────────
1. Open the Snapshot manager and starting with the oldest snapshot delete the snapshots one at a time. The intention here is to get as much new information in to the base disks as possible. At some point there will be a snapshot that will not remove.
2. If there are any snapshots left in the snapshot manager try using the Delete All option in snapshot manager.
3. Use the consolidate function to consolidate any orphaned snapshots.
 
──────────────────────────────────────────────────────────
Preparing Veeam Backup & Replication
──────────────────────────────────────────────────────────
Within the Veeam console under Replicas find the replica that you will be repair and right-click it, from the context menu choose “Remove from replicas…”
 
After you use the “Remove from replicas…” function it will remove the VM from the Replication job.
You will have to manually add the VM back to the replication job.
 
──────────────────────────────────────────────────────────
Detach Snapshot Disks and Attach Base Disks
──────────────────────────────────────────────────────────
1. Edit the replica, and select each of the disks and click remove. It will put a strikethrough the drive and show the word (removing).
2. After selecting all the disks for removal, press OK.
3. Edit the replica again, now reattach the base disks to the replica, choose to add an existing disk and then navigate to the location of the base disks for the replica. Attach them to the same SCSI nodes that were noted earlier.
 
──────────────────────────────────────────────────────────
Datastore Cleanup
──────────────────────────────────────────────────────────
1. Using datastore browser go to the folder of the replica.
2. Most likely there will be many files, keep in mind that the only files that are required are:
 •VMX
 •VMXF
 •NVRAM
 •VMDK for each disk.
So for example here is a folder precleanup post repair.

User-added image

We can remove the following files:

User-added image

Leaving the VMX, VMXF, NVRAM, and the VMDK for each disk. Removing the associated snapshot files that are no longer needed.
 
──────────────────────────────────────────────────────────
Test the replica
──────────────────────────────────────────────────────────
1. Create a snapshot on the replica.
2. Remove the snapshot.
3. If no error occurs, map to the replica in a replication job and see if the job runs successfully.


 

5 / 5 (73 votes cast)

Report a typo on this page:

Please select a spelling error or a typo on this page with your mouse and press CTRL + Enter to report this mistake to us. Thank you!

Orphus system