Forum Discussion
Dataflow timeout using ODBC Athena
Hi Yulia Yan
I managed to get dataflows created by breaking them down to yearly reports , with each report having approx 30 million rows , and dataflows are 2019,2020,2021,2022,2023,and 2024 , 2019,2020,2021,2022,2023 dataflows are static data so am only refreshing 2024 data . I then craeted a dataflow on linked dataflows , and appended the dataflows in a datflow named full. Now when I refersh this it takes about 1 hour , but is always doing a full refresh , I am working in a premium workspace and changed the compute engine setting to on . I have one date time column , so I wanted to try and use the incremental refresh , but it fails when I attempt to do that. It is not the end of the worl If I have to do a full refersh every morning , but I am struggling to work out why incremental refresh is failing , I have it set to 7 years of data , 3 days append , and refresh full days only. The final issue I have and the biggest issue , is taht I need to add this dataframe into my powerbi report , but it is not giving me any option to set it as direct query .