Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! It's time to submit your entry. Live now!

Reply
flintstone
Helper II
Helper II

Merging two data set

‎06-27-2020 11:45 AM

I have two dataset in data warehousing. Each dataset has 890K rows and 100 columns each.  Using a laptop with 40GB memory, I am merging both dataset into a new dataset using Directquery Inner Join using a Inquiry No. column that appears in both dataset. The intention is to continously stream the data from data warehousing on 10 minute interval to a real time visualistion and prediction in Power bi Pro. I am doing this remote from my house via forticlient VPN. However, either one of 2 outcomes happens. Firstly, the merging is not completed and stops when it consumes the entire memory. Secondly, a timeout server message appears. What should I do? Is powerbi pro is solution? Should I use Azure databricks or Apache Spark /Kafka?     

Labels:
Message 1 of 4
646 Views
0
3 REPLIES 3
parry2k
Super User
Super User

‎06-27-2020 12:18 PM

@flintstone why you are merging? Why not just set the relationship between two tables and create measures to achieve the result. 



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Message 2 of 4
638 Views
flintstone
Helper II
Helper II
In response to parry2k

‎06-28-2020 01:07 AM

I created the relationship between the 2 tables but there is a message saying that the relationship cannot be created because there are null values in the common column

Message 3 of 4
584 Views
0
flintstone
Helper II
Helper II
In response to flintstone

‎06-28-2020 01:08 AM

I used the merging because I wanted to create an inner join between the 2 tables. Isnt that the purpose of the merging? If no, what is the merging used for?

 

Message 4 of 4
583 Views
0

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! It's time to submit your entry.

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

View All