Forum Discussion

Ashwath_Bala_S's avatar
Ashwath_Bala_S
Helper II
2 years ago
Solved

Transforming Data Through SQL Endpoint for Enhanced Power BI Dashboards

Hi,  I am getting tables as Shortcut Tables into Fabric Workspace, from Dataverse. (Data is imported as shortcut tables) I would like to perform transformations like handling null values,creating m...
data engineering
Data Integration
data science
one lake
power bi
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Ashwath_Bala_S 
    Thanks for explaining your ask further.
    1) You are right about the first approach.

    2)The process cannot be automated. But you can run the notebooks at desired time intervals. After the data gets refreshed in Dataverse, you can schedule to run notebook which would run on daily basis.



    You can also use the notebook activity which can be scheduled for desired time intervals. Please refer to this document for more information : Link1


    Based on both your approaches, the first option is better one.

    Hope this helps. Please let us know if you have any further questions.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Ashwath_Bala_S 
Thanks for using Fabric Community.
If you do not need to transform the data, what you are doing works great. If you need to transform the data, you could use a Spark notebook or add a Warehouse so that you could store the enriched data. You should be able to query the data by creating a shortcut and you would only save any enriched/updated data into Onelake as a new table.
Hope this helps. Please let us know if you have any further questions.

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Ashwath_Bala_S 
    We haven’t heard from you on the last response and was just checking back to see if your query got resolved.
    Otherwise, will respond back with the more details and we will try to help.
    Thanks

    • Ashwath_Bala_S's avatar
      Ashwath_Bala_S
      Helper II
      2 years ago

      Hi Anonymous ,

      Yeah, my query got resolved.

      Thanks for the assistance.