Backup/Replication jobs fail with:
Below is a list of possible solutions to this issue sorted by what transport mode was being using when this error occurred.
Note: There are many causes for VDDK 13, this list is not intended to be all encompassing.
Using Transport Mode: Network Mode
- Solution 1:
In some instances, you may receive this error when permissions are not correctly set. To confirm, please follow the steps outlined in the following KB article to test ports, permissions, and DNS resolution
- Solution 1:
Stuck Hotadded Disks – Review all virtual proxies for disks attached that do not belong to the VM in question, remove the disks not owned by this VM without deleting from the datastore. Once deleted, consolidate snapshots on the affected VMs.
- Solution 2:
Orphaned Snapshots – Consolidate snapshots on affected VMs
- Solution 3:
Permissions - Please configure the account leveraged to access the vCenter as an Administrator within vCenter
- Solution 4:
Automount – In some cases, it may be necessary to perform an automount scrub to clear any existing mount points that are no longer in the system.
Run the following via CMD Prompt on the proxy server:
- Solution 5:
Patching – Please ensure that all VMware and Veeam components are fully up to date.
- Solution 6:
In some rare instances, performing a storage vMotion has been known to resolve the issue due to a locked VM file on the datastore where the VM files reside.
- Solution 7:
In some rare instances, restarting the vCenter appliance or alternatively restarting the ESXi management agents (https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1003490) may yield positive results if all above testing does not resolve the issue.
- Solution 8:
Veeam Proxy has a Veeam replica with the same bios UUID within the vCenter Server. The following can be observed in
[time stamp] < threadID> Info VM VeeamProxy _replica(vm-100001) has the same bios uuid as proxy VeeamProxy.local in the DB
[time stamp] < threadID> vdl| [vddk] time stamp error - [Originator@6876 sub=transport] Cannot use mode hotadd to access [datastore_name] VM_name/VM_name.vmdk: Cannot mount using this method. (Mounting VM vm-101 using transport hotadd failed : Cannot access datastore for one of the disks of Virtual Machine VM_name..)
The behavior is observed when a Veeam Proxy is replicated with Veeam B&R, the replication process preserves the original VM bios UUID for restore purposes. To work around the issue setup a dedicated VM as a Veeam Proxy, replicating Veeam Proxies is not usually necessary due to ease of deployment.
When receiving VDDK Error 13 when leveraging DirectSAN access mode, please confirm that the LUNs are presented to the proxy correctly and have the proper permissions. For assistance deploying & troubleshooting DirectSAN please follow the below KB articles:
- Manual Hotadd - http://www.veeam.com/kb1184
- Hotadd Requirements - http://www.veeam.com/kb1054
- Deploy an additional standalone proxy to isolate failures to a single specified proxy
- To isolate a specific transport mode as the point of failure, you may also test the other transport modes to ensure that connectivity is correctly established and backup jobs work as intended via the other transport mode.
Backup via Standalone host – Configure backup job to backup via Standalone host rather than through vCenter; this will isolate vCenter as the point of failure. If backup via standalone host is successful, you can attempt restarting the vCenter as well as the management agents on the host(s) where the proxies/VM(s) reside.
Information: Hotadd will only work when the proxy is on the same host as the object being backed up
Additional Troubleshooting (vSphere 5.5):
When attempting to hotadd leveraging a standalone host configuration (that is managed by a vCenter object) with vSphere 5.5 you will receive VDDK Error 13, as well as the error listed below:
Error message: [00680 error 'transport'] Reconfigure attempt failed for VM "2" with Vmomi::MethodFault::Exception ("vim.fault.HostAccessRestrictedToManagementServer")\n
To resolve this particular issue, please leverage Network Mode or Direct SAN transport mode as this configuration is not supported due to limitations of VMware
Information: For more information regarding ‘HostAccessRestrictedToManagementServer’ please see below VMware documentation.