Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
PowerNewUser
Helper I
Helper I

Loading an existing dataset/semantic model to Lakehouse

I have a dashboard that has been created by another department and I need to pull some of the data from it into our lake house. We are currently doing it manually where we export the data of a visual and import it in using a dataflow gen2. 

 

I have been given contributor access to the other department workspace - however have not found a way to pull that data into my lake house. Any suggestions? I tried the dataflow connector but dont see the dataset in question in my list (it is a regular power bi dashboard importing data from a source and published to a premium workspace)

1 ACCEPTED SOLUTION

Adding what I did for reference- 

  1. added a notebook with following code 
# import fabric
from sempy import fabric as FabricDataFrame
# read the table 
df_tables_ReqInfo = FabricDataFrame.read_table(workspace ="....." , dataset="....." , table="...")
# drop any extra columns
df_tables_OffersHireData.drop(['....', '.....'], axis = 1, inplace=True)
# write to lakehouse
df_tables_OffersHireData.to_lakehouse_table(name="....", mode="overwrite" )

2. Created an enviroment to preload the semantic-link library and set it to as default for workspace - this is required if you want to call the notebook in a pipeline as pip is not allowed at that time. 

View solution in original post

4 REPLIES 4
GilbertQ
Super User
Super User

Hi @PowerNewUser 

 

You can use a notebook to query data from another parvia semantic model and then load that into your lake house Here is an example. Fabric Semantic Link and Use Cases





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

@GilbertQ  Seems to be promising - however am not experienced with the notebooks/PySpark - will try. Any other direct alternatives?

Adding what I did for reference- 

  1. added a notebook with following code 
# import fabric
from sempy import fabric as FabricDataFrame
# read the table 
df_tables_ReqInfo = FabricDataFrame.read_table(workspace ="....." , dataset="....." , table="...")
# drop any extra columns
df_tables_OffersHireData.drop(['....', '.....'], axis = 1, inplace=True)
# write to lakehouse
df_tables_OffersHireData.to_lakehouse_table(name="....", mode="overwrite" )

2. Created an enviroment to preload the semantic-link library and set it to as default for workspace - this is required if you want to call the notebook in a pipeline as pip is not allowed at that time. 

@PowerNewUser Thank you so much for posting the solution. I was trying to find a way and you did it! I'll add a link to your solution in the post I created.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors