mirrored snowflake
7 TopicsHow are teams structuring Microsoft Fabric Warehouse for scalable ELT and reporting workloads?
I’m looking at architecture patterns for Microsoft Fabric Warehouse in environments where multiple data sources, transformation jobs, and Power BI workloads all depend on the same platform. A typical flow might look like: Source systems → ingestion → staging → transformations → Fabric Warehouse → semantic models → Power BI I’m particularly interested in how teams are handling: staging vs curated schemas ELT transformations inside the Warehouse incremental loading patterns data quality checks before publishing CI/CD across dev, test, and production workload separation for engineering vs reporting monitoring failed loads and long-running queries deciding when to use Warehouse vs Lakehouse for the same solution For teams running Fabric Warehouse at scale, what architecture patterns have worked best for keeping the platform maintainable and avoiding duplicated transformations?78Views0likes5CommentsHow are teams using AI agents to automate modern data warehouse workflows?
I am exploring how AI agents can help improve data warehouse operations by automating repetitive tasks and assisting data teams with faster decision-making. Some areas I am interested in: Automating data pipeline monitoring and issue detection AI-assisted SQL generation and optimization Automatically identifying data quality issues Triggering workflows based on business events or data changes Generating documentation and insights from warehouse metadata With platforms like Microsoft Fabric Data Warehouse, how are teams approaching AI integration? Are you using: Fabric pipelines with AI-powered automation? Copilot or LLM-based assistants for warehouse development? Custom AI agents connected with data warehouse APIs? Would love to hear real-world architecture patterns and best practices from data engineers working with Fabric.Solved111Views2likes7CommentsPowerBI with Snowflake released refresh error: 'Implementation' are not valid Snowflake options.
PBI Version: 2.149.1252.0 64-bit (November 2025) After I imported table from Snowflake, in PowerQuery source, there will show a param named Implementation="2.0" Then refresh in PBI Desktop succeeded, but after I release it to PBI server, it shows error while refreshing: 'Implementation' are not valid Snowflake options. Valid options are: 'ConnectionTimeout, CommandTimeout, CreateNavigationProperties, Role' Complete Error msg: Data source error: {"error":{"code":"DM_GWPipeline_Gateway_MashupDataAccessError","pbi.error":{"code":"DM_GWPipeline_Gateway_MashupDataAccessError","parameters":{},"details":[{"code":"DM_ErrorDetailNameCode_UnderlyingErrorCode","detail":{"type":1,"value":"-2147467259"}},{"code":"DM_ErrorDetailNameCode_UnderlyingErrorMessage","detail":{"type":1,"value":"'Implementation' are not valid Snowflake options. Valid options are: 'ConnectionTimeout, CommandTimeout, CreateNavigationProperties, Role'"}},{"code":"DM_ErrorDetailNameCode_UnderlyingHResult","detail":{"type":1,"value":"-2147467259"}},{"code":"Microsoft.Data.Mashup.ValueError.Reason","detail":{"type":1,"value":"Expression.Error"}}],"exceptionCulprit":1}}}Solved4KViews0likes5CommentsMigrating Snowflake data to Fabric Datawarehouse
Hi Team, I would like to migrate around 15TB of SQL Tables data from the Snowflake to Fabric. Its one time activity. I have below questions. Could you please help me with below questions? We have 2 options to migrate . What is the best option? Option1:Mirroring the warehouse , once mirrored then deleting it and then copying the data to finalwarehouse for write access. Option2: using Data factory copy activity. Do we need to use data gateway in my connection for migrating 15TB of data, my snowflake is accessible for Fabric. do we still need Data gateway? When should we go for Data gateway? Thanks,Solved3.3KViews0likes6CommentsMirroring Snowflake with a Managed Identity?
What are the options to authenticate into Snowflake when mirroring into Fabric? At the moment, the Fabric tutorials point to Snowflake Username & Password authentication. Also, "Entra (single sign on (SSO)) are supported". However, Snowflake will require MFA in the future. Doesn't this mean, these options are invalid in the future? Can we use Managed Identity to authenticate into Snowflake? Fabric Rest API Create Mirrored Database seems to hint into this direction, but I cannot make these various parts fit together. Is it possible to use Service Principal to connect into Snowflake?Solved4.7KViews1like10Commentsencountering duplicate entries in our Power BI report
Hi, We are encountering duplicate entries in our Power BI report and would like guidance on how to load data into dimension and fact tables, as well as how to manage this in the Power BI report. For example, consider the address type dimension, which has 20 different addresses, all of which are active. How can we effectively display these addresses in the fact table and the Power BI table report? we are getting corssjoin report in the report. Here’s an example of our current data structure: Customer Dimension (Parent Table): cust_sk, cust_id, cust_name, start_date, end_date, current_flag 1, 10, 'ABC', 03/25/2025, null, 'Y' 2, 11, 'TDH', 03/25/2025, null, 'Y' Product Dimension (Child Table): prod_sk, cust_sk, prod_id, prod_name, start_date, end_date, current_flag 80, 1, 20, 'Dove', 03/25/2025, null, 'Y' 81, 2, 21, 'RAM', 03/25/2025, null, 'Y' address Dimension (Child Table): address_sk, cust_sk, address_id, address_name,address_type, start_date, end_date, current_flag 91, 1, 30, 'test1 street', 'P',03/25/2025, null, 'Y' 91, 1, 30, 'test2 street', 'T',03/25/2025, null, 'Y' 91, 1, 30, 'test3 street', 'S',03/25/2025, null, 'Y' 91, 1, 30, 'test4 street', 'M',03/25/2025, null, 'Y' 91, 1, 30, 'test5 street', 'O',03/25/2025, null, 'Y' 91, 2, 30, 'test street', 'P',03/25/2025, null, 'Y' Sales Fact (Fact Table): sales_sk, cust_sk, prod_sk, address_sk, start_date, end_date, current_flag 61, 1, 80, 91, 03/25/2025, null, 'Y' 62, 1, 80, 91, 03/25/2025, null, 'Y' 63, 1, 80, 91, 03/25/2025, null, 'Y' 64, 1, 80, 91, 03/25/2025, null, 'Y' 65, 1, 80, 91, 03/25/2025, null, 'Y' 66, 2, 81, 92, 03/25/2025, null, 'Y' Thank you Thank youSolved3KViews0likes7CommentsSnowflake Mirrored Tables Throttled for 24 hours
My Snowflake keeps randomly being throttled. At times this seems to last for 24 hours. We only load data into Snowflake once per day but the mirroring may not resume until several hours after the snowflake load jobs have completed. While I am ok with the mirroring being throttled to some extent, the fact that it does not resume until several hours after the load has completed in snowflake, is making the mirroring capability unreliable and of little use for us.Solved1.5KViews0likes3Comments