How long should it take to copy users from Microsoft 365?

[Stinkys]

G'day all o/

I have configured a pipeline data copy with a Microsoft 365 connection. The M365 connection is using a service principle secret on the App Registration that was created when the Workspace identity was created. The app registration has consent for Directory.Read.All API. The application is also registered in Graph Data Connect, configured to use the Fabric capacity with the Lakehouse destination, and with the added dataset BasicDataSet_v0.User_v1. The Graph Data Connect application has been approved.

Everything appears to pass the input checks when I run the pipeline, but it seemingly runs forever without showing any signs of pulling any users from directory.

How long would you expect this process to run for in a small organisation with well less than 1k users?

[Nero]

I had same issue, I left my pipeline to run for 3 days and it still returned no user data and eventually just timed-out.

I'm wondering if the issue is due to my Fabric tenancy being in a different region (Australia East) from my Azure tenancy (Australia SouthEast).

During the Fabric free trial (which seems to be region-agnostic) I had managed to get this pipeline to work and it completed in less than 30 mins.

I would be keen to know the solution if you can figure it out. As a temporary solution I have been able to write python code in a notebook that can reach the MS Graph API using the service principal - (i.e. not using GraphDataConnect) and pull some user data that way.

[Stinkys]

The same thought had crossed my mind. My Power BI data is listed as Australia Southeast. My Fabric capacity is in Australia East. DevOps has our region as US East 2 which must have been setup in error.

[Stinkys]

Spent a few days on this now and running out of steam. Here are my environment logistics to see if anyone can assist with debugging why I can't copy users from M365.

App Registration & Connection

App registration created and defined service principal for the Connection...

I understand that explicit API permissions on the App registration are not required as these are handled by Graph Data Connect.

Graph Data Connect

Graph Data Connect created in Azure with the appropriate scope for all users all columns in User_v1 recordset...

Graph Data Connect Approved

Graph Data Connect is enabled for tenant...

Application is approved with the defined scope for User_v1 dataset...

Pipeline & Copy Data

Connection status is online...

Test connection succeeds where Preview times out...

I have been able to preview results previously, although it would intermittently fail as above.

Any experts in chat able to point me in the right direction??

[v-kongfanf-msft]

Hi @Stinkys ,

To create an Microsoft 365 connection and copy data, the following conditions must first be met.

Secondly, check the running log of the corresponding pipeline for any prompts, like below:

For more details, you can refer to below document:

How to create a Microsoft 365 connection - Microsoft Fabric | Microsoft Learn

Configure Microsoft 365 in a copy activity - Microsoft Fabric | Microsoft Learn

Best Regards,
Adamk Kong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Stinkys]

I'm at a bit of a loss with this one. Following this guide Step-by-step: (Microsoft Fabric) Gather a detailed dataset on SharePoint Sites using MGDC | Microsof... and substituting SharePoint for Microsoft365 with Userv1 table, I can step through and create all of the App + Graph Data Connect resources just fine. Again it's approved by my tenant admin, the connector tests OK with the application ID & secret, I am able to pull the column mappings, but when running the pipeline it doesn't show any data transfer and runs indefinitely.

[Stinkys]

Thanks for the response @v-kongfanf-msft 

As you can see here it looks like no data is transferring over 25+ minutes. So there must be a configuration issue somewhere.

Retracing my steps with your info provided, I would like to confirm with you if the app registration *needs* to be configured as a web app, and where can I find reference for the Redirect URI's if required? The second link to create an Entra ID application seems to redirect me to the wrong page.