data integration
271 TopicsUnlink Microsoft Onelake
Hi everyone. I'm facing an issue when I try to unlink my Dataverse Link to Fabric link. I cannot add new tables, cannot unlink, create a new one. When I try to unlink, it shows this: If I go to 'details', it shows this: And if I go to 'manage tables', I face this error: I know that in all these cases I need to contact the support team, but I'd like to give a shot here before. Any guesses of what could be causing that? I tried to link, unlink, I even deleted the workspace and tried to set up in a new one, but it shows that it already exists: "Your tables are already linked with Microsoft Fabric".Solved3.6KViews0likes6CommentsDynamics 365 F&O - Fabric Integration
Hi All, I am trying to integrate Dynamics 365 F&O data to Fabric. I replicated the entities in Dynamics 365 F&O to Dataverse. They come as virtual tables in Datavese. I am trying to use 'Link to Fabric' in Dataverse platform and shortcut in Fabric as well. But those do not replicate the virtual tables that had been brought to Dataverse. Does anyone know how to solve this problem?Solved6.5KViews0likes13CommentsCopilot for Fabric how to get estimates of input tokens for a single request
We are thinking of adopting copilot for our data science team but we want to do some cost analysis before we start using it. So as per the fabric documentation copilot cost depends on the number of input tokens and number of output tokens and both types of tokens consume different CUs. But now the problem is we cannot estimate the input tokens for a single request because as per this blog: "Fabric Copilot Pricing: An End-to-End example", "A single user input prompt can result in multiple requests being sent from Fabric Copilot to Azure OpenAI. As per the example in the blog the prompt; “Load Customers from my Lakehouse into DataFrames” would generate 7 requests to Azure Open AI, with 4,967 input tokens and 227 output tokens." Now I want to understand, how come this single promopt with 7 words consume 4967 tokens. More importantly, how can we estimate that how many input tokens are gonna be consumed for a single request that we send to copilot. Because, as per the example in blog it can be different and it does not only depend on how many tokens are there in user's input.4.4KViews0likes6CommentsFOR JSON Path in Fabric Warehouse
Hi, I have noticed that the FOR JSON statement is not supported in Fabric Synapse, and was wondering if there is any alternative to it? I am working on a Stored Procedure that will be used in a pipeline in Data Factory, and one of the things I want the SP to do is to pass several parameters to the next pipeline that will be executed. I have the parameters in table format and have previously in SQL Server turned them into JSON-format with FOR JSON Path-statement, but this is not supported in Fabric. That is why I was wondering if there is a similar statement that is available in Fabric, and if not, what are some possible work-arounds?7.1KViews1like10CommentsHow to access Fabric Warehouse from Fabric Notebooks?
Hi, I am trying to access Fabric Datawarehouse table from Fabric notebooks. I am copying ABFS path of Datawarehouse table from its properties as under the hood table in datawarehouse is a delta table. And then passed below query - df = spark.read.format("delta").load("abfss://My [email protected]/test_dw.Datawarehouse/Tables/dbo/Date") It's getting failed with the following error - IllegalArgumentException: Illegal character in authority at index 8: abfss://My [email protected]. I tried passing below query but again same error. df = spark.read.format("delta").load("abfss://My%[email protected]/test_dw.Datawarehouse/Tables/dbo/Date") Just wondering is it possible to read and write to warehouse tables from notebooks in Fabric? We have similar option in Synapse in which we can read/write data warehouse tables using .synapsesql option using Notebooks. https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/writing-data-using-azure-synapse-dedicated-sql-pool-connector/ba-p/3535930Solved29KViews2likes9CommentsNot able to connect to ADLS with shortcut in Lakehouse/One Lake (given all roles, no vnet)
Dear community, I am testing the use case of Fabric for a client of mine, instead of going with the regular Azure SQL Server + Azure Data Factory stack. I have been able to connect sources and push data to the ADLS gen 2, which was originally a blob storage but I have converted it to an ADLS gen 2. I have searched the forums and tried everything. I have given all the roles I could find to be relevant (I am already the Owner but I also gave myself the blob stroage owner, contributor and reader). There is no vnet configured as well. Still, I cannot get the data loaded into the lakehouse in Fabric. I have tried both the dataflow gen 2 (which gives me invalid credentials error) and the shortcut option, which was my preferred option. With the shortcut I am able to connect to the ADLS with my account credentials but then I get the following error: Error 403 - This request is not authorized to perform this operation. What do I need to do to get this sorted? I want to test my use case to see if I can proceed with Fabric instead of the regular Azure SQL tools. Kind regards, JesperSolved8KViews0likes8CommentsHow do you store DateTimeTimezone without DATETIMEOFFSET?
Greetings, community. I am working to move some Gen 1 dataflows over and have the data stored in a Fabric data warehouse. The data has date/time values with user-specific timezone offsets listed (2024-02-07T09:15:00-07:00). Given that Fabric DW doesn't have the DATETIMEOFFSET data type, I'm not sure what the best alternative approach is to handle different time zones. Anyone have suggestions?2.1KViews1like5CommentsLinked Service Fabric Lake House
I'm trying to sink my data from Azure Synapse into Microsoft Fabric, so the first thing that I must do is create the Linked Service for Fabric Lakehouse in Azure Synapse Analytics. There are a few options to enter in the Fabric Workspace name. But there is a problem with the Lakehouse Name. The lakehouse name is not giving me any options to enter (I have several lakehouses in fabric) and automatically gave me the error 'Failed to load artifacts'. Any solution?2.5KViews0likes4Comments