topic Re: Dataflow Gen 2 not posting Salesforce Data to Lakehouse in Data Engineering

Dataflow Gen 2 not posting Salesforce Data to Lakehouse

Ashley_Helms — Wed, 11 Sep 2024 18:31:00 GMT

We have a data lakehouse and we are trying to ingest information from salesforce. The dataflow gen 2 is set up, permissions are working and everything is showing as though it's running correcetly with the data destination being the lakehouse. However, for some reason when I go to preview the table in the lakehouse i'm getting an error. I then tried the same thing in a different lakehouse - still get an error. Just to continue troubleshooting I rerouted the same dataflowgen2 into a fabric warehouse and now my table is populating.

Does anyone have any insight on what I could be doing wrong? We haven't seen this issue previously with ingesting salesforce data.

Re: Dataflow Gen 2 not posting Salesforce Data to Lakehouse

Anonymous — Thu, 12 Sep 2024 01:35:21 GMT

Hi @Ashley_Helms

Your question belongs to Data Engineering, I have transferred your question to the corresponding forum, an engineer will deal with you later, please be patient.

https://community.fabric.microsoft.com/t5/Data-Engineering/bd-p/ac_dataengineering

Best Regards,
Community Support Team _ Ailsa Tao

Re: Dataflow Gen 2 not posting Salesforce Data to Lakehouse

Anonymous — Thu, 12 Sep 2024 09:43:50 GMT

Hi, @Ashley_Helms

I understand your problem, but in order to reproduce your problem to determine if it's a issue or not, can you please provide a more detailed step-by-step procedure for testing, such as whether there were any data modifications or other actions prior to these two releases.

When I was testing if there is a “-” character in the table, after publishing, the data in Lakehouse will not show up properly.

It would be nice if you could give tables without sensitive data to test.

Best Regards,
Yang
Community Support Team

Re: Dataflow Gen 2 not posting Salesforce Data to Lakehouse

Ashley_Helms — Thu, 12 Sep 2024 16:28:22 GMT

No data modifications. I'm importing the entire object from salesforce. The dataflow gen 2 publishes and shows that it refreshes and wrote to lakehouse without error but when I try to open it this is the screen I get. If I switch the data load to go to the warehouse, it works.

Re: Dataflow Gen 2 not posting Salesforce Data to Lakehouse

Anonymous — Thu, 19 Sep 2024 03:12:17 GMT

Hi, @Ashley_Helms

After testing it multiple times, the first image you gave will appear after publishing to the newly created Lakehouse and refreshing the page (only once in four or five tests), but when you click Refresh, the data will be displayed normally, and it will still not reproduce your situation. You can retest to see if something goes wrong, I guess it's an occasional error.

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly -- How to provide sample data in the Power BI Forum