data warehouse
243 Topics"The remote certificate is invalid" error on pipeline Fabric job to copy parquet files from AWS S3
When I try to copy parquet files from AWS S3 bucket with "copy data" job on pipelline function, this error show up: "The file operation is failed. A WebException with status TrustFailure was thrown. The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel. The remote certificate is invalid according to the validation procedure. Activity ID: ******" The test connection results OK. The shortcut function works well too. But we need to copy the data from S3 with pipeline function, the shortcut don't help us. We try with connection type "Amazon S3 Compatible" too and we get the same error. Some one can help or are getting this error too? Thanks!1.3KViews0likes2CommentsMirroring of postgres data in fabric
Hi, I want to use data from my postgres database in fabric. Fabric offers a way to mirror data but currently it is not available for postgres database. I have another way to use this data by loading it into a warehouse inside fabric, but this means I will be replicating my data. Is there any other way that would allow me to use this data in fabric without replicating it.Solved4.2KViews0likes7CommentsLakehouse permissions not workign with Entra ID Groups
I have granted an Azure Entra ID group read access to the lakehouse/databases but the users within that group cannot login and see the data. When I grant the individual user read access they can login and query the tables. Reaching out to Anonymous to see if we can get some updates.Solved2.4KViews0likes7CommentsDirect Lake fallback to Direct Query due to SQL security?
Hi, I am wondering if Direct Lake mode will keep working if I apply granular SQL access control (GRANT, DENY, REVOKE) on a SQL Analytics Endpoint or Data Warehouse? I am also wondering if Direct Lake mode will keep working if I apply SQL Row Level Security on a SQL Analytics Endpoint or Data Warehouse? Thanks! 😀3.7KViews0likes6CommentsHelp Making Sense of Capacity Units in the Fabric Capacity Metrics report
Greetings, community. I am trying to evaluate the Fabric usage in our organization in relation to Microsoft's new pricing announcement. I am using the Fabric Capacity metrics report but am finding it less-than-helpful in terms of connecting the data provided to Fabric Capacity Units. We have a Power BI Premium P1 SKU with F64. The report shows everything in Capacity Units in Seconds: CU (s) Our total CU usage is show as <10%. My question is: does that 10% translate to 10% of the 64 CU included with our P1 plan? The report doesn't explicitly identify the actual number of capacity units in use and/or used. I read the documentation for the report, which didn't really clarify either.15KViews0likes6CommentsFOR JSON Path in Fabric Warehouse
Hi, I have noticed that the FOR JSON statement is not supported in Fabric Synapse, and was wondering if there is any alternative to it? I am working on a Stored Procedure that will be used in a pipeline in Data Factory, and one of the things I want the SP to do is to pass several parameters to the next pipeline that will be executed. I have the parameters in table format and have previously in SQL Server turned them into JSON-format with FOR JSON Path-statement, but this is not supported in Fabric. That is why I was wondering if there is a similar statement that is available in Fabric, and if not, what are some possible work-arounds?7.1KViews1like10CommentsFabric shortcut - is it possible in warehouse?
Hi All, Shortcuts is possible in Lakehouse (and KQL - I have not tried this). But is NOT possible to create a shortcut in Warehouse. So if a DIM is required across multiple warehouses, then I need to load it to each warehouse resulting in data duplication and data consistency issues. Question: How is the single copy of data applicable in the above scenario? I can create a view in one warehouse based on a table in another warehouse. This can avoid the above problem of duplicate DIMs. Or link the whole warehouse A to the warehouse B - which is not ideal as the whole of warehouse A tables will be exposed to warehouse B. Also it is not persisted - when you exit the warehouse view, the link is dropped. Not having the ability to create a shortcut in Warehouse is a major drawback in Shortcut capability. Any thoughts how this can be hadled using shortcuts?Solved13KViews0likes9CommentsHow to access Fabric Warehouse from Fabric Notebooks?
Hi, I am trying to access Fabric Datawarehouse table from Fabric notebooks. I am copying ABFS path of Datawarehouse table from its properties as under the hood table in datawarehouse is a delta table. And then passed below query - df = spark.read.format("delta").load("abfss://My [email protected]/test_dw.Datawarehouse/Tables/dbo/Date") It's getting failed with the following error - IllegalArgumentException: Illegal character in authority at index 8: abfss://My [email protected]. I tried passing below query but again same error. df = spark.read.format("delta").load("abfss://My%[email protected]/test_dw.Datawarehouse/Tables/dbo/Date") Just wondering is it possible to read and write to warehouse tables from notebooks in Fabric? We have similar option in Synapse in which we can read/write data warehouse tables using .synapsesql option using Notebooks. https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/writing-data-using-azure-synapse-dedicated-sql-pool-connector/ba-p/3535930Solved29KViews2likes9Comments