topic Re: Fabric Data Engineering Cosmos Mongo DB source in Pipelines

Fabric Data Engineering Cosmos Mongo DB source

NickA01 — Fri, 16 Feb 2024 16:16:47 GMT

Hi All:

I've started work on a project where the data is in a Cosmos Mongo DB ( RU) account.
I've managed to get connectivity working in synapse but I'd very much like to use Fabric Data pipelines & flows.
I cannot see a native source connection for Cosmos Mongo DB in Fabric and wondeting if there's any work around.

Thanks in advance.

Re: Fabric Data Engineering Cosmos Mongo DB source

Anonymous — Fri, 16 Feb 2024 18:17:19 GMT

Hi NickA01
Thanks for using Fabric Community.
Microsoft Fabric supports Azure Cosmos DB for NoSQL connections. You can set up your connection in a data pipeline. However, this might not be directly applicable if you’re specifically using the MongoDB API.
For more information please refer to these links:

https://learn.microsoft.com/en-us/fabric/data-factory/connector-mongodb-overview
Set up your Azure Cosmos DB for NoSQL connection - Microsoft Fabric | Microsoft Learn
Configure Azure Cosmos DB for NoSQL in a copy activity - Microsoft Fabric | Microsoft Learn

Hope this helps. Please let me know if you have any further queries.

Re: Fabric Data Engineering Cosmos Mongo DB source

NickA01 — Sat, 17 Feb 2024 07:52:17 GMT

Anonymous Thanks but that dosen't answer my question.
The fabric Cosmos connector is for the No-SQL version of Cosmos, not the Mongo version and the native mongo connectors will not connect to a Cosmos Mongo Analytics Store.

I have managed to hack this but properly supported connection (in the same manner as Synapse) would be more benificial.
Here the start of my M query
Blank Query
let
Source = DocumentDB.Contents("https://<cosmosMongoAccountName>.documents.azure.com:443/", "<cosmosMongo DB Name>", "<collection name>"),
#"Expanded Document" = Table.ExpandRecordColumn(Source, "Document",<list out the fileds here>

Re: Fabric Data Engineering Cosmos Mongo DB source

Anonymous — Sat, 17 Feb 2024 16:38:50 GMT

Hi NickA01
Currently Mongo DB connectors are not yet available in Fabric.

Appreciate if you could share the feedback on our feedback channel, which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Feedback Link: https://ideas.fabric.microsoft.com/

I hope this information is helpful. Please let me know if you have any other questions.

Re: Fabric Data Engineering Cosmos Mongo DB source

Anonymous — Tue, 20 Feb 2024 10:47:08 GMT

Hi NickA01
We haven’t heard from you on the last response and was just checking back to see if you got a chance to create the idea. Otherwise, will respond back with the more details and we will try to help.
Thanks

Re: Fabric Data Engineering Cosmos Mongo DB source

NickA01 — Tue, 20 Feb 2024 11:28:44 GMT

I've just done this however, I had to put it under Synapse as FAbric is not an option.

Re: Fabric Data Engineering Cosmos Mongo DB source

BlindEye9 — Thu, 14 Mar 2024 18:56:24 GMT

I am having the same issue where I was able to use the MongoDB API in Data Factory and Synapse but it was not available in Fabric. Could you please post the instructions on what your hack was, or possibly make a video on it? It would be a great help

Re: Fabric Data Engineering Cosmos Mongo DB source

NickA01 — Fri, 15 Mar 2024 06:04:13 GMT

Hi .

Its already in the above post.

New DataFlow Gen2
Blank Query
Start with this...

let
Source = DocumentDB.Contents("https://<cosmosMongoAccountName>.documents.azure.com:443/", "<cosmosMongo DB Name>", "<collection name>"),
#"Expanded Document" = Table.ExpandRecordColumn(Source, "Document",<list out the fileds here>

Re: Fabric Data Engineering Cosmos Mongo DB source

BlindEye9 — Fri, 15 Mar 2024 12:10:01 GMT

Thanks NickA01 . Yesterday, I was playing around with this a bit and it turns out you can use the MongoDB default connector as well in Fabric, in place of the Azure CosmosDB for MongoDB connector that I have been using in Synapse and Data Factory, like you have

Re: Fabric Data Engineering Cosmos Mongo DB source

Marusyk — Wed, 10 Apr 2024 14:46:23 GMT

could you please suggest how you did this? Did you use https://<cosmosMongoAccountName>.documents.azure.com:443/ or https://<cosmosMongoAccountName>.mongo.cosmos.azure.com:443/ as a server name?

Re: Fabric Data Engineering Cosmos Mongo DB source

Marusyk — Wed, 10 Apr 2024 14:59:11 GMT

how do you use that, I'm getting the error: The data source kind doesn't support the credential type. Data source kind: DocumentDB. Credential type: UsernamePassword.

Re: Fabric Data Engineering Cosmos Mongo DB source

BlindEye9 — Wed, 10 Apr 2024 15:31:03 GMT

{"server":"<cosmosMongoAccountName>.mongo.cosmos.azure.com:<PortNumber>"}

The <PortNumber> will be in the Connection Strings tab of your CosmosDB workspace on Azure.

Mine was 10255, as you can see below.

Re: Fabric Data Engineering Cosmos Mongo DB source

Marusyk — Wed, 10 Apr 2024 17:09:45 GMT

works. thank you very much