Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
wahmed20
Resolver I
Resolver I

Getting data from elasticsearch

What is a good way to get data from elasticsearch into fabric [DataGen2]?

2 REPLIES 2
wahmed20
Resolver I
Resolver I

@HimanshuS-msft In the Setting there is managed gateway

wahmed20_1-1685621416486.png

in which there is connection type elastic. I created that 

 

wahmed20_0-1685621166647.png

then in my data pipeline , I use copy data

wahmed20_2-1685621531896.png

In the source when I test connection it gives error

wahmed20_3-1685621605948.png

The error is

wahmed20_4-1685621714720.png

 

HimanshuS-msft
Community Support
Community Support

Hello @wahmed20 ,
Looking at the data flow gen2 and data facory , I do not see any connetor for Elasticsearch . 
But we do have the REST connector and we can use that to pull data using data facory pipeline . 

HimanshuSmsft_1-1685553796054.png

 

I will also like you t o point to this implementation . 

https://stackoverflow.com/questions/66991666/azure-data-factory-rest-api-paging-with-elasticsearch

Thanks 
Himanshu 



 

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Prices go up Feb. 11th.

JanFabricDE_carousel

Fabric Monthly Update - January 2025

Explore the power of Python Notebooks in Fabric!

JanFabricDW_carousel

Fabric Monthly Update - January 2025

Unlock the latest Fabric Data Warehouse upgrades!

JanFabricDF_carousel

Fabric Monthly Update - January 2025

Take your data replication to the next level with Fabric's latest updates!