Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
wahmed20
Resolver I
Resolver I

Getting data from elasticsearch

What is a good way to get data from elasticsearch into fabric [DataGen2]?

2 REPLIES 2
wahmed20
Resolver I
Resolver I

@HimanshuS-msft In the Setting there is managed gateway

wahmed20_1-1685621416486.png

in which there is connection type elastic. I created that 

 

wahmed20_0-1685621166647.png

then in my data pipeline , I use copy data

wahmed20_2-1685621531896.png

In the source when I test connection it gives error

wahmed20_3-1685621605948.png

The error is

wahmed20_4-1685621714720.png

 

HimanshuS-msft
Community Support
Community Support

Hello @wahmed20 ,
Looking at the data flow gen2 and data facory , I do not see any connetor for Elasticsearch . 
But we do have the REST connector and we can use that to pull data using data facory pipeline . 

HimanshuSmsft_1-1685553796054.png

 

I will also like you t o point to this implementation . 

https://stackoverflow.com/questions/66991666/azure-data-factory-rest-api-paging-with-elasticsearch

Thanks 
Himanshu 



 

Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.

Fabric Hack Slide Banner

Hack Together: The Microsoft Fabric AI Global Hack

Learn from experts, get hands-on experience, and win awesome prizes.