Forum Discussion

PieterVeenstra's avatar
PieterVeenstra
New Member
5 months ago
Solved

Custom connectors in Fabric Dataflows

I've got the following setup: Lakehouse that is filled by data from a custom api.    The custom api asks for a username and password and then returns the access token. The access token expires whe...
  • PieterVeenstra's avatar
    4 months ago

    I have found a slighlty easier solution. I am importing data into about 10 table from a dodgy API. Some of the tables need frequent updates, other can do with updates on a daily basis. I split my dataflows into 10 dataflows each handling one table. Then through scheduling them cleverly (the daily ones go through the night and the important ones during the day on a more frequent schedule) I managed to get all the data processed.