Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Learn from the best! Meet the four finalists headed to the FINALS of the Power BI Dataviz World Championships! Register now

Reply
flintstone
Helper II
Helper II

Merging two data set

‎06-27-2020 11:45 AM

I have two dataset in data warehousing. Each dataset has 890K rows and 100 columns each.  Using a laptop with 40GB memory, I am merging both dataset into a new dataset using Directquery Inner Join using a Inquiry No. column that appears in both dataset. The intention is to continously stream the data from data warehousing on 10 minute interval to a real time visualistion and prediction in Power bi Pro. I am doing this remote from my house via forticlient VPN. However, either one of 2 outcomes happens. Firstly, the merging is not completed and stops when it consumes the entire memory. Secondly, a timeout server message appears. What should I do? Is powerbi pro is solution? Should I use Azure databricks or Apache Spark /Kafka?     

Labels:
Message 1 of 4
680 Views
0
3 REPLIES 3
parry2k
Super User
Super User

‎06-27-2020 12:18 PM

@flintstone why you are merging? Why not just set the relationship between two tables and create measures to achieve the result. 



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Message 2 of 4
672 Views
flintstone
Helper II
Helper II
In response to parry2k

‎06-28-2020 01:07 AM

I created the relationship between the 2 tables but there is a message saying that the relationship cannot be created because there are null values in the common column

Message 3 of 4
618 Views
0
flintstone
Helper II
Helper II
In response to flintstone

‎06-28-2020 01:08 AM

I used the merging because I wanted to create an inner join between the 2 tables. Isnt that the purpose of the merging? If no, what is the merging used for?

 

Message 4 of 4
617 Views
0

Helpful resources

Announcements
New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Power BI Update Carousel

Power BI Community Update - March 2026

Check out the March 2026 Power BI update to learn about new features.

View All