Error Data Pipeline -> Dynamics Plugin with Dataverse connector

[vivien57]

Hello Everyone,

I've had an error that I don't understand.

I have a "Copy Data" component that connects to a dataverse data model (CRM Dynamics) and copies the data to another DB.

The configuration of the component is fine, as is the authentication.

However, during the pipeline run I got an error that I don't understand

Error detail :

"'Type=System.IO.FileNotFoundException,Message=Could not load file or assembly 'Microsoft.IdentityModel.Clients.ActiveDirectory, Version=3.19.8.16603, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. The system cannot find the file specified.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,'"

Do you have any ideas?

Thank in advance,

Have a nice day,

Vivien

[fudoki22 · Accepted solution]

Hi Vivien,

I have been using copy data to push data from SQL to Dynamics and have found the errors generated when copy data fails often to be obscure.

For example - 
ErrorCode=DynamicsOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Dynamics operation failed with error code: -2147204784, error message: Sql error: Generic SQL error. CRM ErrorCode: -2147204784 Sql ErrorCode: -2146232060 Sql Number: 515.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,''Type=System.ServiceModel.FaultException`1[[Microsoft.Xrm.Sdk.OrganizationServiceFault, Microsoft.Xrm.Sdk, Version=9.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35]],Message=The creator of this fault did not specify a Reason.,Source=Microsoft.DataTransfer.ClientLibrary.DynamicsPlugin,'

Generic SQL error in this case turned out to be a timeout when trying to pull data from a large entity in dataverse into SQL (attachment I think from memory)

In your case given you seem to simply be trying to push connection data from dataverse to a DB, I would suggest trying to use a query and restrict the query to a handful of rows (connection can be quite large in my experience)
e.g. (change the entity to whichever is relevant for you)

Hope it helps
--Mike

[v-nuoc-msft]

Hi @vivien57 

Thanks enriqueqs for the feedback. I've done some checking but haven't received any confirmation that this is a known issue.

For cases like this, the issue could be on the data source itself and/or the connector.

This connector is not owned by the team behind Data Pipeline (or Power BI), so the best way to require assistance is to open a support ticket so you can reach the connector owner (and data source owner) directly. Below is the link to the support channel so you can raise a support ticket:

https://support.fabric.microsoft.com/support 

Thank you for your understanding.

If you have any other questions, you are welcome to continue asking in this forum.

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[enriqueqs]

I am having the same isssue with one of my flows, I guess it is an issue in microsoft side. I hope they fix it soon

[v-nuoc-msft]

Hi @vivien57 

The Microsoft.IdentityModel.Clients.ActiveDirectory assembly missing error is not limited to the Microsoft Fabric pipeline. This error may also occur in other environments that use this assembly.

The error message "Could not load file or assembly 'Microsoft.IdentityModel.Clients.ActiveDirectory" means that the system could not find or load the specified assembly Microsoft.IdentityModel.Clients.ActiveDirectory or one of its dependencies at runtime. This is usually caused by one of the following reasons:

Assembly missing: The specified assembly file does not exist in the expected directory.

Version mismatch: The version of the assembly referenced by the project does not match the version that actually exists.

Dependency missing: Other libraries or files that the assembly depends on are missing.

Path problem: The path to the assembly file is not configured correctly, causing the system to be unable to find the file.

To resolve this issue you need to properly install and reference the Microsoft.IdentityModel.Clients.ActiveDirectory assembly.

The following links are common solutions to this problem:

Microsoft.IdentityModel.Clients.ActiveDirectory could not load | Microsoft Community Hub

asp.net - Could not load file or assembly 'Microsoft.IdentityModel.Clients.ActiveDirectory, Version=...

[Solved] Could not load file or assembly 'Microsoft.IdentityModel.Clients.ActiveDirectory, Version=2...

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[enriqueqs]

None of the links are applicable to a copy activity, since as users we cannot change the configuration (or packages) in fabric

[vivien57]

Hello,

Thanks for the feedback,

I don't understand because I use the copy data component in the simplest way and in SaaS mode... I don't understand how something could be missing.

I'm getting a lot of errors with the Copy Data component, and in my opinion it's having stability problems.

Have a nice day,

Vivien