Forum Discussion

prom's avatar
prom
Frequent Visitor
2 years ago

Dataflow Gen2 from on prem Oracle - burning CU like crazy

Hello @all   We need to transfer data from on-prem Oracle table to the Lakehouse. As of tuday, in Fabric, is it only possible using DF Gen2 (copy pipeline doesn't support on-prem gw yet).    We a...
Dataflows
General Comment
General Question
pqian_MSFT's avatar
pqian_MSFT
Microsoft Employee
2 years ago

prom one thing you could try is disable staging for your entities, it should at least complete without running twice.

 

We are aware of an issue that may slow down ingestion into LH if your data contains large strings (>4k in a cell) or column that is primarily nulls. If that is what you are running into, then the next GW patch will have this fix and it should speed it up by another 40%.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi prom ,

We haven’t heard from you on the last response and was just checking back to see if we answered your query.
Otherwise, will respond back with the more details and we will try to help .

  • prom's avatar
    prom
    Frequent Visitor
    2 years ago

    Hello,

     

    I'm using ADF CP pipeline with lakehouse destination for now. It works pretty well with on-prem IR. But still waiting for native fabric functionality with equal througput and performance.

     

     

    Regards

    Prom