https://login.veeam.com/en/oauth?client_id=nXojRrypJ8&redirect_uri=https%3A%2F%2Fwww.veeam.com%2Fservices%2Fauthentication%2Fredirect_url&response_type=code&scope=profile&state=eyJmaW5hbFJlZGlyZWN0TG9jYXRpb24iOiJodHRwczovL3d3dy52ZWVhbS5jb20va2IyMDcwIiwiaGFzaCI6IjI5MmFjODYzLWYxMWItNDgxNi1iZjczLWZlNjM4MjYyMzhjOSJ9
Backup to DataDomain over DDboost hangs
Challenge
You are using DDBoost connection to a DataDomain device.
Backup to the DataDomain device starts to hang.
In the log of Veeam agent that is writing the data to the device you can see agent crash dump is generated after trying to open backup file for read/write access:
[TIMESTAMP] < thread_id> stg| Opening DDBoost storage [[DFC-datadomain] veeamddboost:/Job_name/Job_nameTIMESTAMP.vbk] for read/write access.
<output omitted>
[TIMESTAMP] < thread_id> cli| Trying to generate crash dump
[TIMESTAMP] < thread_id> cli| Writing dump. Dump path: C:\ProgramData\Veeam\Backup\Job_name\VA_crash_X.mdmp.
In the same log DDboost library logs error Err: 5012:
[TIMESTAMP] < thread_id> DDBoost| ERR |in use. Err: 5012
[TIMESTAMP] < thread_id> DDBoost| >> |Failed to close file '[DFC- datadomain] veeamddboost:/ Job_name/Job_nameTIMESTAMP.vbk ( file_size )'
[TIMESTAMP] < thread_id> DDBoost| >> |An exception was thrown from thread [thread_id]
Backup to the DataDomain device starts to hang.
In the log of Veeam agent that is writing the data to the device you can see agent crash dump is generated after trying to open backup file for read/write access:
[TIMESTAMP] < thread_id> stg| Opening DDBoost storage [[DFC-datadomain] veeamddboost:/Job_name/Job_nameTIMESTAMP.vbk] for read/write access.
<output omitted>
[TIMESTAMP] < thread_id> cli| Trying to generate crash dump
[TIMESTAMP] < thread_id> cli| Writing dump. Dump path: C:\ProgramData\Veeam\Backup\Job_name\VA_crash_X.mdmp.
In the same log DDboost library logs error Err: 5012:
[TIMESTAMP] < thread_id> DDBoost| ERR |in use. Err: 5012
[TIMESTAMP] < thread_id> DDBoost| >> |Failed to close file '[DFC- datadomain] veeamddboost:/ Job_name/Job_nameTIMESTAMP.vbk ( file_size )'
[TIMESTAMP] < thread_id> DDBoost| >> |An exception was thrown from thread [thread_id]
Cause
As seen in the generated crash dump, the issue is caused by a crash of libDDBoost.dll library from EMC that Veeam B&R uses to communicate with the device:
*** ERROR: Symbol file could not be found. Defaulted to export symbols for libDDBoost.dll -
rax=0000814dfd58178e rbx=00000000017f46b4 rcx=00000000015c48c8
rdx=0000000000000001 rsi=0000000000000000 rdi=0000000000331b36
rip=0000000180093677 rsp=00000000013ac640 rbp=00000000015c48c8
r8=0000000001401380 r9=0000000000000242 r10=0000000060020000
r11=00000000013ac9b0 r12=0000000000000004 r13=000000018017dfb8
r14=0000000000000000 r15=0000000000001000
iopl=0 nv up ei pl nz na pe nc
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202
libDDBoost!ddp_snapshot_list+0x779e7:
00000001`80093677 4d8b4608 mov r8,qword ptr [r14+8] ds:00000000`00000008=????????????????
As advised by EMC, this is related to a bug in DDBoost plugin version 2.6.5.0 or earlier that may cause libDDBoost.dll to crash on ddp_read call.
*** ERROR: Symbol file could not be found. Defaulted to export symbols for libDDBoost.dll -
rax=0000814dfd58178e rbx=00000000017f46b4 rcx=00000000015c48c8
rdx=0000000000000001 rsi=0000000000000000 rdi=0000000000331b36
rip=0000000180093677 rsp=00000000013ac640 rbp=00000000015c48c8
r8=0000000001401380 r9=0000000000000242 r10=0000000060020000
r11=00000000013ac9b0 r12=0000000000000004 r13=000000018017dfb8
r14=0000000000000000 r15=0000000000001000
iopl=0 nv up ei pl nz na pe nc
cs=0033 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010202
libDDBoost!ddp_snapshot_list+0x779e7:
00000001`80093677 4d8b4608 mov r8,qword ptr [r14+8] ds:00000000`00000008=????????????????
As advised by EMC, this is related to a bug in DDBoost plugin version 2.6.5.0 or earlier that may cause libDDBoost.dll to crash on ddp_read call.
Solution
The issue will be resolved with the release of DDBoost SDK 2.6.5.1 by EMC. The necessary compatible DDOS version for the fix is DDOS 5.4.6.0, and it would also need to be released.
The new version of the plugin will be used in Veeam B&R version 9. On earlier versions of Veeam B&R, DDOS, and DDBoost Plugin, connect to DataDomain device over CIFS protocol to work around the issue.
The new version of the plugin will be used in Veeam B&R version 9. On earlier versions of Veeam B&R, DDOS, and DDBoost Plugin, connect to DataDomain device over CIFS protocol to work around the issue.
More information
Please apply to this section of product user guide for more information about adding CIFS/SMB (shared folder) -based repository to Veeam B&R.
KB ID:
2070
Product:
Veeam Backup & Replication
Version:
8.x
Published:
2015-10-08
Last Modified:
2020-08-13
Couldn't find what you were looking for?
Below you can submit an idea for a new knowledge base article.
Report a typo on this page:
Please select a spelling error or a typo on this page with your mouse and press CTRL + Enter to report this mistake to us. Thank you!
Please select a spelling error or a typo on this page with your mouse and press CTRL + Enter to report this mistake to us. Thank you!
Spelling error in text
Knowledge base content request
How can we assist you today?
How can we assist you today?
Happy Holidays!
Chat is offline now. Please fill out the form and we will call you back.
Technical
General and Licensing
Renewal
Sales
Partnership
Do you have an issue or need post-sales technical assistance?
*if you need help choosing the right product, please select "Sales" chat
Do you need guidance on the website, upgrade hints or help with your licenses/accounts?
Questions regarding your Veeam contract renewal? Contact us and learn how you can maximize your savings
Do you need additional license, pricing details, product information or have any other sales-related question?
Would you like to become our partner or do you need assistance as our existing partner?
Start chat
We apologize, but this chat is not available at the moment
Start chat
We apologize, but this chat is not available at the moment
Start chat
We apologize, but this chat is not available at the moment
Start chat
We apologize, but this chat is not available at the moment
Privacy Notice. By submitting, you agree that your personal data will be managed by Veeam in accordance with the Privacy Policy.
Back
Thank you for your request!
Veeam representative will get back to you shortly.
Stay up to date with Veeam product updates, latest news, and recent content.
By subscribing, you agree to receive communications about Veeam products, services and events. Your personal data will be managed by Veeam in accordance with the Privacy Policy. You can unsubscribe at any time.