general question
5 TopicsCopy Job Not Saving
I want to know how everyone is dealing with this. I have a Copy Job that brings over 30+ tables from one lakehouse to another and has column mappings. I find that when I try to edit the mapping of one table after running the Copy Job and then hitting the Apply button, I receive a validation model error message even though I only edited a single table and then the mappings of the other tables disappear and I have to redo the mappings for all 30+ tables. If I try to add another table from the source, all my mappings from the previous sources will disappear as well and I have to redo it. I was hoping that I could hold onto the JSON code and paste in the old mappings but there's no way to edit the Copy Job JSON file only to view it. How is everyone editing their Copy Jobs?1.9KViews1like3CommentsIssue selecting “all columns except a few” in Fabric Copy Job from PostgreSQL
I’m using a Fabric Copy Job to extract data from a PostgreSQL database. The source is a table with many columns, and I’m selecting columns via the UI column selector, not by providing a custom SQL query or using SELECT *. What I’m trying to do is effectively select all columns except two specific ones. However, when configuring the column selection in the UI, the copy job only loads the first 26 columns that appear before the first column I skip. Any columns that come after that skipped column are not loaded at all, even if they are explicitly checked/selected in the UI. As a result, it’s not possible to exclude just a couple of fields while keeping the rest of the schema intact unless every column is manually enumerated. Has anyone encountered this behavior before? Is this a known limitation or bug in Fabric Copy Jobs? Is there a supported way to exclude a small number of columns when copying from PostgreSQL without manually listing every column? Any guidance or workarounds would be appreciated.Solved3.3KViews1like5CommentsParameterizing copy job that uses a rest connection
Hi, I'm trying to use the copy job feature specifying a rest connection, after selected it from OneLake catalog. For a particular Base URL I'd like to specify a dynamic content for the relative URL to pass the table name as a parameter. I want to use the copy job to get data from a Dynamics 365 Business Central solution by the Rest API connector. As the Base URL I can indicate the OData link of the BC API service, but for the Relative URL I cannot specify a table name parameter as a dynamic content and therefore I need to create one copy job for each BC table to read and not only one copy job. Now, any suggests to me, please? Many thanks3.8KViews0likes6CommentsAuthentication method for copy job and OData connector as a source
Hi, I need to use a copy job in order to manage full and incremental data load from a Dynamics Business Central source by the OData connector, but it seems that this connector doesn't support the Organizational account authentication. I think that it is a great limitation and I don't understand the reason. I don't want to use a Dataflow gen2. Why does OData connector not support the Organizational account authentication, please? F.e. BC requires a such authentication type. Thanks3.4KViews0likes4CommentsCopy Job
For a workspace on my organization , the license is set as my trail license. The orgranization have an F2 capacity. However, when i use the capacity metrics for my organization, a copy job inside my trail license workspace is also listed there with CU , duration and tag billable. Will this be included in the bill for the whole organization even though the worksopace with that copy job have my trail license ?8.6KViews0likes5Comments