HDFS data in Power BI Desktop

[ace424]

Hello,

I have succesfully imported data that was in my local HDFS instance and I am able to visualize it in Power BI. When I specified the data source as "HDFS" and provided the server (and directory) path, it showed a pop up containing the path and the files in binary format, I was then able to retrieve the required data from the csv's.

But in this scenario, it loaded ALL my data into Power BI (that is what I am assuming), what happens if the data in HDFS which I wish to analyze and visualize in Power BI, is much much more than what Power BI can hold and process locally? Is there a limit on how much 'big data' can be processed using Power BI Desktop or Cloud?

[matuchote4]

Hi! May I ask you how did you transform the binary content into the csv format? Are you using the HDFS connector? What it the URL that you are using to access the folder/file in the HDFS?

Thanks in advance

[v-chuncz-msft]

@ace424,

You may take a look at the thread below.

http://community.powerbi.com/t5/Desktop/Size-limit-of-a-file-pbx/td-p/41371