Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Try your skills in the Power BI Dataviz World Championship! Round one ends June 26. Join now

Reply
flintstone
Helper II
Helper II

Merging two data set

‎06-27-2020 11:45 AM

I have two dataset in data warehousing. Each dataset has 890K rows and 100 columns each.  Using a laptop with 40GB memory, I am merging both dataset into a new dataset using Directquery Inner Join using a Inquiry No. column that appears in both dataset. The intention is to continously stream the data from data warehousing on 10 minute interval to a real time visualistion and prediction in Power bi Pro. I am doing this remote from my house via forticlient VPN. However, either one of 2 outcomes happens. Firstly, the merging is not completed and stops when it consumes the entire memory. Secondly, a timeout server message appears. What should I do? Is powerbi pro is solution? Should I use Azure databricks or Apache Spark /Kafka?     

Labels:
Message 1 of 4
753 Views
0
3 REPLIES 3
parry2k
Super User
Super User

‎06-27-2020 12:18 PM

@flintstone why you are merging? Why not just set the relationship between two tables and create measures to achieve the result. 



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Message 2 of 4
745 Views
flintstone
Helper II
Helper II
In response to parry2k

‎06-28-2020 01:07 AM

I created the relationship between the 2 tables but there is a message saying that the relationship cannot be created because there are null values in the common column

Message 3 of 4
691 Views
0
flintstone
Helper II
Helper II
In response to flintstone

‎06-28-2020 01:08 AM

I used the merging because I wanted to create an inner join between the 2 tables. Isnt that the purpose of the merging? If no, what is the merging used for?

 

Message 4 of 4
690 Views
0

Helpful resources

Announcements
Fabric Data Days is here Carousel

Fabric Data Days 2026

Don't miss out on Data Days, June 15 through August 7. Learn Fabric, Power BI, SQL, AI and more.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

View All