I am trying to create dimension tables for my star schema in the dataflow in Fabric. However, my compuation is timing out at the "Remove duplicates" step. Then i tried to use Group By on all the columns in order to get to a table with all unique rows. Same issue.
The exact same dataflow works in the legacy dataflow setup (in the Power BI workspaces) however it is failing in the MS Fabric trial tenant. Please help! My M query is below. The point of failure is highlighted in orange.
let
Source = Table.Combine({#"T - DIM - Person Pid", #"T - DIM - Person Opl"}),
Custom1 = Table.TransformColumnNames(Source,fnRenameColumns),
#"Added custom" = Table.TransformColumnTypes(Table.AddColumn(Custom1, "Person Index", each [Full Name] & [Employee Num] & [Location Type] & [Primary Capability] & [Employee Career Stage] & [Home Global Region Name] & [Current Global Region Name] & [Home Country Name] & [Current Country Name] & [Person Type] & [Employee Business Unit] & [Derived End Country] & [Employee Job Description] & [Career Stage Level] & [Home Metro Name] & [Current Metro Name] & [Capability Type Pda] & [Capability Group Pda] & [Craft Pda] & (if [Cs Id] = null then "" else [Cs Id]) & [Capability Group Pda Collapsed]), {{"Person Index", type text}}),
#"Inserted conditional column" = Table.AddColumn(#"Added custom", "Location Type Sorting", each if [Location Type] = "Local" then 1 else if [Location Type] = "Traveler" then 2 else if [Location Type] = "India" then 3 else if [Location Type] = "No Person Footprint" then 4 else 999),
#"Changed column type" = Table.TransformColumnTypes(#"Inserted conditional column", {{"Location Type Sorting", Int64.Type}}),
#"Inserted conditional column 1" = Table.AddColumn(#"Changed column type", "Capability Group Pda Collapsed Sorting", each if [Capability Group Pda Collapsed] = "Engineering" then 1 else if [Capability Group Pda Collapsed] = "Product" then 2 else if [Capability Group Pda Collapsed] = "Strategy" then 3 else if [Capability Group Pda Collapsed] = "Experience" then 4 else if [Capability Group Pda Collapsed] = "Non-Core Capabilities" then 5 else if [Capability Group Pda Collapsed] = "No Person Footprint" then 6 else 999),
#"Changed column type 1" = Table.TransformColumnTypes(#"Inserted conditional column 1", {{"Capability Group Pda Collapsed Sorting", Int64.Type}}),
#"Removed duplicates" = Table.Distinct(#"Changed column type 1", {"Person Index"}),
#"Added index" = Table.AddIndexColumn(#"Removed duplicates", "Index", 1, 1, Int64.Type),
#"Removed columns" = Table.RemoveColumns(#"Added index", {"Person Index"}),
#"Renamed columns" = Table.RenameColumns(#"Removed columns", {{"Index", "Person Index"}})
in
#"Renamed columns"
Hi @arjunjalan ,
Dataflows' UI validation logic has a built-in timeout of 10 minutes. It is possible that some queries, take longer than that, especially if the cannot fold.
Did you try to split your entities into multiple dataflows to see if it works?
Community Support Team_Caitlyn