<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>topic Pipeline Copy Activity unable to copy delta table to local SQL server in Data Engineering</title>
    <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4894700#M13904</link>
    <description>&lt;P&gt;Hey there!&lt;BR /&gt;So I'm trying to copy a delta table from my Fabric lakehouse to my local SQL Server, and hitting a weird date issue. Back before Fabric updated things, this was a simple 2-minute job - now it's a headache!&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;My delta table has a ReportDate column as DATE type. The copy activity seems to read it as DATETIME (with timestamp), even though "Preview data" shows it correctly (Checked the schema and it is DATE). This fails with conversion errors. The error is&amp;nbsp;&lt;SPAN&gt;"Exception occurred when converting value '03/07/2022 00:00:00' for column name 'ReportDate' from type 'Date' (precision:, scale:) to type 'DateTime' (precision:255, scale:255)."&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;AI suggested using a SQL query with CAST(ReportDate AS DATE) in the source. But that gives me a different error about invalid 'LakehouseSql' connection type. Again AI suggested to use SQL Endpoint connect, I Tried creating a SQL endpoint connection, but copy activity won't use it. Just to make sure it is not a connection issue, I removed "ReportDate" run the activity. it successfuly copy the data.&amp;nbsp;So it's definitely this date column causing the issue.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;A friend suggested enabling staging - and it actually works! But copying 2.6 million records takes ~30 minutes, which feels way too slow.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Anyone else run into this Fabric date conversion problem? Any better solutions than the slow staging approach?&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Thanks for any ideas!&lt;BR /&gt;Turra Worku&lt;/P&gt;</description>
    <pubDate>Fri, 05 Dec 2025 22:44:07 GMT</pubDate>
    <dc:creator>TWorku</dc:creator>
    <dc:date>2025-12-05T22:44:07Z</dc:date>
    <item>
      <title>Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4894700#M13904</link>
      <description>&lt;P&gt;Hey there!&lt;BR /&gt;So I'm trying to copy a delta table from my Fabric lakehouse to my local SQL Server, and hitting a weird date issue. Back before Fabric updated things, this was a simple 2-minute job - now it's a headache!&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;My delta table has a ReportDate column as DATE type. The copy activity seems to read it as DATETIME (with timestamp), even though "Preview data" shows it correctly (Checked the schema and it is DATE). This fails with conversion errors. The error is&amp;nbsp;&lt;SPAN&gt;"Exception occurred when converting value '03/07/2022 00:00:00' for column name 'ReportDate' from type 'Date' (precision:, scale:) to type 'DateTime' (precision:255, scale:255)."&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;AI suggested using a SQL query with CAST(ReportDate AS DATE) in the source. But that gives me a different error about invalid 'LakehouseSql' connection type. Again AI suggested to use SQL Endpoint connect, I Tried creating a SQL endpoint connection, but copy activity won't use it. Just to make sure it is not a connection issue, I removed "ReportDate" run the activity. it successfuly copy the data.&amp;nbsp;So it's definitely this date column causing the issue.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;&lt;P&gt;A friend suggested enabling staging - and it actually works! But copying 2.6 million records takes ~30 minutes, which feels way too slow.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Anyone else run into this Fabric date conversion problem? Any better solutions than the slow staging approach?&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Thanks for any ideas!&lt;BR /&gt;Turra Worku&lt;/P&gt;</description>
      <pubDate>Fri, 05 Dec 2025 22:44:07 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4894700#M13904</guid>
      <dc:creator>TWorku</dc:creator>
      <dc:date>2025-12-05T22:44:07Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4896110#M13932</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="299153" data-lia-user-login="TWorku" class="lia-mention lia-mention-user"&gt;TWorku&lt;/a&gt;,&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;You’re copying a &lt;STRONG&gt;Delta table from Fabric Lakehouse&lt;/STRONG&gt; to a &lt;STRONG&gt;local SQL Server&lt;/STRONG&gt;.&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;The table has a &lt;STRONG&gt;ReportDate column of type DATE&lt;/STRONG&gt;.&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;&lt;STRONG&gt;Copy activity fails&lt;/STRONG&gt; because the system interprets it as &lt;STRONG&gt;DATETIME&lt;/STRONG&gt; with a timestamp&lt;/P&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Alternatives :&amp;nbsp;&lt;/P&gt;&lt;H4&gt;&lt;STRONG&gt;1) Use Mapping in Copy Activity&lt;/STRONG&gt;&lt;/H4&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;In the &lt;STRONG&gt;Copy Activity’s Mapping tab&lt;/STRONG&gt;, explicitly map the source column to the target column:&lt;/P&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;Source: ReportDate (Date)&lt;/P&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;Target: ReportDate (Date)&lt;/P&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;/LI&gt;&lt;LI&gt;&lt;P&gt;This often forces proper conversion without staging.&lt;/P&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;H4&gt;&lt;STRONG&gt;2) Use Dataflow / Data Transformation&lt;/STRONG&gt;&lt;/H4&gt;&lt;UL&gt;&lt;LI&gt;&lt;P&gt;Instead of straight Copy Activity, create a &lt;STRONG&gt;Dataflow or Wrangling Dataflow&lt;/STRONG&gt; to &lt;STRONG&gt;cast the column explicitly&lt;/STRONG&gt;:&lt;/P&gt;&lt;/LI&gt;&lt;/UL&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;Hope it can help you!&lt;/P&gt;&lt;P&gt;Best regards,&lt;/P&gt;&lt;P&gt;Antoine&lt;/P&gt;</description>
      <pubDate>Mon, 08 Dec 2025 15:27:32 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4896110#M13932</guid>
      <dc:creator>AntoineW</dc:creator>
      <dc:date>2025-12-08T15:27:32Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4896116#M13934</link>
      <description>&lt;P&gt;Thank you for your response Antoine. It is mapped correctly as you suggested. it won't work without enabling staging. I did not want to use Dataflow.&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Mon, 08 Dec 2025 15:37:28 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4896116#M13934</guid>
      <dc:creator>TWorku</dc:creator>
      <dc:date>2025-12-08T15:37:28Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4898005#M13969</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="299153" data-lia-user-login="TWorku" class="lia-mention lia-mention-user"&gt;TWorku&lt;/a&gt;,&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;P&gt;Thank you for reaching out to the Microsoft Fabric Community Forum. Also, thanks to &lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="1307272" data-lia-user-login="AntoineW" class="lia-mention lia-mention-user"&gt;AntoineW&lt;/a&gt;, for those inputs on this thread.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;P&gt;What is happening here is that Fabric is currently exposing DATE columns from the Lakehouse as high-precision DateTime metadata during the copy process, even though the data itself contains only dates. SQL Server rejects that implicit conversion, which explains why removing the column works and why staging succeeds staging normalizes the type before loading. To avoid the slower staging path and keep your earlier performance, you can override the column type just within the Copy Activity: go to Source → Schema and Type, change ReportDate to String, and then ensure in Mapping that the target remains a DATE column. This bypasses Fabric’s incorrect DateTime handling and allows the load to succeed quickly.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;P&gt;Microsoft’s documentation confirms that Copy Activity fully supports manual type conversion and explicit column mapping, including String → Date conversions when default inference fails. You can find these details here:&lt;BR /&gt;1. &lt;A href="https://learn.microsoft.com/en-us/fabric/data-factory/data-type-conversion-copy-activity" target="_blank"&gt;https://learn.microsoft.com/en-us/fabric/data-factory/data-type-conversion-copy-activity&lt;/A&gt;&amp;nbsp;&lt;BR /&gt;2. &lt;A href="https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-schema-and-type-mapping?" target="_blank"&gt;https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-schema-and-type-mapping?&lt;/A&gt;&amp;nbsp;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;P&gt;The Fabric Lakehouse Connector documentation also confirms that Lakehouse → SQL Server is a supported pipeline path, so this workaround aligns with Microsoft best practices.&lt;BR /&gt;&lt;A href="https://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-fabric-lakehouse?tabs=data-factory" target="_blank"&gt;https://learn.microsoft.com/en-us/azure/data-factory/connector-microsoft-fabric-lakehouse?tabs=data-factory&lt;/A&gt;&amp;nbsp;&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;P&gt;Hope that clarifies. Let us know if you have any doubts regarding this. We will be happy to help.&lt;/P&gt;
&lt;P&gt;Thank you for using the Microsoft Fabric Community Forum.&lt;/P&gt;</description>
      <pubDate>Wed, 10 Dec 2025 04:40:51 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4898005#M13969</guid>
      <dc:creator>v-kpoloju-msft</dc:creator>
      <dc:date>2025-12-10T04:40:51Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4900315#M14020</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="299153" data-lia-user-login="TWorku" class="lia-mention lia-mention-user"&gt;TWorku&lt;/a&gt;,&lt;BR /&gt;&lt;BR /&gt;Just checking in to see if the issue has been resolved on your end. If the earlier suggestions helped, that’s great to hear! And if you’re still facing challenges, feel free to share more details happy to assist further.&lt;/P&gt;
&lt;P&gt;Thank you.&lt;/P&gt;
&lt;P&gt;&lt;LI-WRAPPER&gt;&lt;/LI-WRAPPER&gt;&lt;/P&gt;</description>
      <pubDate>Fri, 12 Dec 2025 04:27:32 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4900315#M14020</guid>
      <dc:creator>v-kpoloju-msft</dc:creator>
      <dc:date>2025-12-12T04:27:32Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4900684#M14041</link>
      <description>&lt;P&gt;Good morning&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="902865" data-lia-user-login="v-kpoloju-msft" class="lia-mention lia-mention-user"&gt;v-kpoloju-msft&lt;/a&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Thanks for your reply. Our implemented flow is: merge data into a warehouse via a stored procedure, then copy it to the local SQL server. The copy step averages 3 minutes. We are committed to not changing source data types. Yes, this means an extra table and activity to manage, but it's the most suitable solution we have.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Fri, 12 Dec 2025 14:26:59 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4900684#M14041</guid>
      <dc:creator>TWorku</dc:creator>
      <dc:date>2025-12-12T14:26:59Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4903563#M14098</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="299153" data-lia-user-login="TWorku" class="lia-mention lia-mention-user"&gt;TWorku&lt;/a&gt;,&lt;/P&gt;
&lt;P&gt;Thank you for the clarification that makes complete sense, and your approach is valid.&lt;BR /&gt;&lt;BR /&gt;What you are seeing aligns with current Fabric behaviour: when copying directly from a Lakehouse, DATE columns can be exposed as high-precision DateTime metadata at runtime, which causes SQL Server conversion failures. By merging the data into a Warehouse first, the schema is normalized to strict relational types, which is why the subsequent copy to local SQL Server runs successfully and within an expected time frame.&lt;BR /&gt;&lt;BR /&gt;Given your requirement to keep source data types unchanged, this Warehouse-based pattern is a solid and supported design choice. While it does introduce an additional object to manage, it avoids the staging performance penalty and provides predictable copy behaviour. Until the Lakehouse Copy metadata handling is improved, this is one of the most reliable solutions for production workloads.&lt;BR /&gt;&lt;BR /&gt;&lt;/P&gt;
&lt;P&gt;Hope that clarifies. Let us know if you have any doubts regarding this. We will be happy to help.&lt;/P&gt;
&lt;P&gt;Thank you for using the Microsoft Fabric Community Forum.&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Wed, 17 Dec 2025 05:48:45 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4903563#M14098</guid>
      <dc:creator>v-kpoloju-msft</dc:creator>
      <dc:date>2025-12-17T05:48:45Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4906700#M14213</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="299153" data-lia-user-login="TWorku" class="lia-mention lia-mention-user"&gt;TWorku&lt;/a&gt;,&lt;BR /&gt;&lt;BR /&gt;Just checking in to see if the issue has been resolved on your end. If the earlier suggestions helped, that’s great to hear! And if you’re still facing challenges, feel free to share more details happy to assist further.&lt;/P&gt;
&lt;P&gt;Thank you.&lt;/P&gt;
&lt;P&gt;&lt;LI-WRAPPER&gt;&lt;/LI-WRAPPER&gt;&lt;/P&gt;</description>
      <pubDate>Mon, 22 Dec 2025 05:25:00 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4906700#M14213</guid>
      <dc:creator>v-kpoloju-msft</dc:creator>
      <dc:date>2025-12-22T05:25:00Z</dc:date>
    </item>
    <item>
      <title>Re: Pipeline Copy Activity unable to copy delta table to local SQL server</title>
      <link>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4908398#M14270</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="javascript:void(0)" data-lia-user-mentions="" data-lia-user-uid="299153" data-lia-user-login="TWorku" class="lia-mention lia-mention-user"&gt;TWorku&lt;/a&gt;,&lt;BR /&gt;&lt;BR /&gt;Just wanted to follow up. If the shared guidance worked for you, that’s wonderful hopefully it also helps others looking for similar answers. If there’s anything else you'd like to explore or clarify, don’t hesitate to reach out.&lt;/P&gt;
&lt;P&gt;Thank you.&lt;/P&gt;
&lt;P&gt;&lt;LI-WRAPPER&gt;&lt;/LI-WRAPPER&gt;&lt;/P&gt;</description>
      <pubDate>Thu, 25 Dec 2025 05:11:51 GMT</pubDate>
      <guid>https://community.fabric.microsoft.com/t5/Data-Engineering/Pipeline-Copy-Activity-unable-to-copy-delta-table-to-local-SQL/m-p/4908398#M14270</guid>
      <dc:creator>v-kpoloju-msft</dc:creator>
      <dc:date>2025-12-25T05:11:51Z</dc:date>
    </item>
  </channel>
</rss>

