Don't Load Data Until All 3 Sources Are Ready

[peterg0417]

Hey all,

I'm wonering whether this is possible (preferrably in DataFlows, but whatever is the easiest method will do).

I'm currently extracting data from 3 different sources (or Lines of Business). They are either Excel or CSV sheets. Each Line of Business (or LOB) prepares the data for us quarterly. Right now, I have Quarter 3 data ready for LOB #1, but still waiting on LOB #2 and #3. 

Their data is pulled in as a query in Dataflows, it is transformed, and then appended into 1 table/query. That final query is the only query that is loaded/refreshed into Power BI report.

Is there a way to prevent Quarter 3 data from loading until all 3 LOB's have Quarter 3 data? 

Thx

[lukiz84]

You would need to know which of the data is always the first to have the latest data... possible?

[peterg0417]

Do you mean which LOB is the first to have the data? No. It varies.

I'm wondering if grouping by DateKey (eg. 2022-09-30) and then distinct count LOB would work, but I can't figure the logic out. I tried creating a Calculated table in Desktop with JUST the Date key from my data table, like so:

But it's not working. 

This is the result I was expecting to get:

My thought process is that I can use the "Count of LOB" column as a filter for the entire report, to only show data when it equals 3.

[Aburar_123 · Accepted solution]

Hi @peterg0417 ,

Please write the calculated column like Dist_count_LOB = CALCULATE(DISTINCTCOUNT('GPM Data'[LOB]))

[lukiz84]

Good idea. DISTINTCOUNT always returns 3 because you did not connect the date to LOB.

Can you share the Structure of your LOB table?

[peterg0417]

They are though.