Forum Discussion
Dataflow Gen2 Staging
Hi robert-murray , Use staging for reusable steps Like step 1 and step 4 for intermediate steps dont use staging
You could use ADLS or Datamart for cross workspaces
In same workspace you could go for linked tables
If this post helped please do give a kudos and accept this as a solution
Thanks In Advance
Hi robert-murray , Use staging for reusable steps Like step 1 and step 4 for intermediate steps dont use staging
You could use ADLS or Datamart for cross workspaces
In same workspace you could go for linked tables
If this post helped please do give a kudos and accept this as a solution
Thanks In Advance
Hi Akash,
Thanks for the reply. What are your thoughts on steps 5 to 8? In particular, as I go from Query 7 (the last query that I actually do anything in) to Query 8 which is just a reference to 7. I know I need enable staging for query 8 or I won't be able to link to it from other dataflows. So should I consider 7 intermediate and not stage?
The changes you suggested have improved Refresh times so thank you! Sure wish Microsoft would release some updated Best Practices because most of what is out there is clearly written for Gen1...
Hi robert-murray Treat 7 as intermediate unless if you are accesing its output to other workflows maybe