Forum Discussion
DataFlow Gen2 - Errors while publishing details to warehouse
- 1 year ago
Hi DRSH_9876 ,
Thanks for getting back and for sharing the detailed screenshots of your Dataflow and the error logs.
Regarding the missing Publish button, in Dataflow Gen2 with CI/CD enabled (Git integration), the Publish option is replaced by Save and Run. It looks like this setting was enabled when you created the Dataflow, which is why you’re seeing the Save and Run button instead.
As for the error you’re encountering, it’s challenging to pinpoint the root cause based on the screenshots alone. Since you’ve mentioned facing a similar error during the Copy Data activity in your pipelines, this suggests the issue might be originating from the data source itself - possibly related to the CSV file formatting or structure.
Please verify the consistency of the CSV files, especially the second line where the error occurs, to ensure the columns align with the header and data format expectations.
If the issue persists or requires more detailed troubleshooting, raising a support ticket with Microsoft Fabric support would be the best option to get dedicated help:
https://support.fabric.microsoft.com/supportIf you have already raised a support ticket, please feel free to share any insights or solutions provided by the support team here. This would greatly help others in the community who might be facing similar issues.
Best Regards,
Vinay,
Fabric Community Support.
Hi!
Could you share more information about your Dataflow? How many queries is it trying to load to the Warehouse? Are they using automatic settings? are you able to reproduce this behavior in a different Dataflow? if yes, could you please share the repro steps so we can test on our side?
- DRSH_98761 year agoRegular Visitor
While saving and Running to Lakehouse it creates error log. Publish button is not visible ,as an alternative save n Run is the option givenError Log
- v-veshwara-msft1 year agoCommunity Support
Hi DRSH_9876 ,
Thanks for getting back and for sharing the detailed screenshots of your Dataflow and the error logs.
Regarding the missing Publish button, in Dataflow Gen2 with CI/CD enabled (Git integration), the Publish option is replaced by Save and Run. It looks like this setting was enabled when you created the Dataflow, which is why you’re seeing the Save and Run button instead.
As for the error you’re encountering, it’s challenging to pinpoint the root cause based on the screenshots alone. Since you’ve mentioned facing a similar error during the Copy Data activity in your pipelines, this suggests the issue might be originating from the data source itself - possibly related to the CSV file formatting or structure.
Please verify the consistency of the CSV files, especially the second line where the error occurs, to ensure the columns align with the header and data format expectations.
If the issue persists or requires more detailed troubleshooting, raising a support ticket with Microsoft Fabric support would be the best option to get dedicated help:
https://support.fabric.microsoft.com/supportIf you have already raised a support ticket, please feel free to share any insights or solutions provided by the support team here. This would greatly help others in the community who might be facing similar issues.
Best Regards,
Vinay,
Fabric Community Support.- v-veshwara-msft1 year agoCommunity Support
Hi DRSH_9876 ,
We’re following up once more regarding your query. Could you please confirm if the issue has been resolved? If you raised a support ticket, we’d appreciate it if you could share any updates or insights from the support team.
If the issue has been resolved, we kindly request you to share the resolution or key details here to help others in the community.
For any future questions or assistance, feel free to create a new thread in the Microsoft Fabric Community Forum - we’ll be happy to help.
We may consider closing this thread if there is no response.Thank you for being part of the Microsoft Fabric Community.