Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
tomtan
Employee
Employee

How to achive clickhouse connection with direct query?

Hi Experts,

 

My requirement is that I have a clickhouse with lots of data, and I want to leverage PBI to connect to it to do direct query.

 

I did check lots of the web information on the solution. Finnally what I learned is that we could use clickhouse odbc for the connection. Howerver, due to the quantity of data, it is impossible to full load the table and maybe I need to enable direct query for it.

tomtan_0-1682234240737.png

The challenge is that the default odbc connector doesn't provide direct query option. I also checked the web and it seems that the solution is to develop our own connector leverage Forks · microsoft/DataConnectors · GitHub

 

Question:

1. What is the suggest way for PBI to connect to clickhouse and enable direct query?

2. Is there any shared clickhouse connector for PBI to support direct query?

 

Thanks.

 

3 REPLIES 3
belyaevvo
New Member

You can use power bi custom connector like this https://github.com/belyaevvo/ClickHouseConnector

amitchandak
Super User
Super User

@tomtan , How much is data volume, Are you on the premium version? Make sure you load data in service using the deployment pipeline, you should use a large dataset format in the premium  workspace

 

Power BI Incremental Refresh Pro; Premium Deployment pipeline - https://youtu.be/nIxTRdeCYSE

 

 

Thanks. We have data with each day 30M+ rows and we need to cover 1 year's data. So total rows would be 10B. We don't yet use premium version but if it works then we could swich to it. But as I know the load mode may not be able to support such volume data, and thus maybe we need direct query instead.

Helpful resources

Announcements
Fabcon_Europe_Social_Bogo

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.