Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

July 7 - July 17 | Round 2 of the Power BI Dataviz World Championships. Don't miss your chance! Learn more

Reply
flintstone
Helper II
Helper II

Merging two data set

‎06-27-2020 11:45 AM

I have two dataset in data warehousing. Each dataset has 890K rows and 100 columns each.  Using a laptop with 40GB memory, I am merging both dataset into a new dataset using Directquery Inner Join using a Inquiry No. column that appears in both dataset. The intention is to continously stream the data from data warehousing on 10 minute interval to a real time visualistion and prediction in Power bi Pro. I am doing this remote from my house via forticlient VPN. However, either one of 2 outcomes happens. Firstly, the merging is not completed and stops when it consumes the entire memory. Secondly, a timeout server message appears. What should I do? Is powerbi pro is solution? Should I use Azure databricks or Apache Spark /Kafka?     

Labels:
Message 1 of 4
795 Views
0
3 REPLIES 3
parry2k
Super User
Super User

‎06-27-2020 12:18 PM

@flintstone why you are merging? Why not just set the relationship between two tables and create measures to achieve the result. 



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Message 2 of 4
787 Views
flintstone
Helper II
Helper II
In response to parry2k

‎06-28-2020 01:07 AM

I created the relationship between the 2 tables but there is a message saying that the relationship cannot be created because there are null values in the common column

Message 3 of 4
733 Views
0
flintstone
Helper II
Helper II
In response to flintstone

‎06-28-2020 01:08 AM

I used the merging because I wanted to create an inner join between the 2 tables. Isnt that the purpose of the merging? If no, what is the merging used for?

 

Message 4 of 4
732 Views
0

Helpful resources

Announcements
FabCon and SQLCon Barcelona 2026

FabCon & SQLCon – Barcelona 2026

Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.

60 days of Data Days Carousel

Data Days 2026

Join Fabric Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

View All