Forum Discussion

UsefGamal's avatar
UsefGamal
Regular Visitor
2 years ago
Solved

passing sql query to notebook

I am having a trouble passing sql queries to notebooks as they are originally stored in .Xlsx file , when they are passed as a string it gives me an error that it can't unserialize the response,  tri...
Need Help
pipelines
  • UsefGamal's avatar
    UsefGamal
    2 years ago

    Hi

     

    My problem was concerned with the Sql Query itself in the .xlsx file

    The flow of the data is not directly to the notebook but it goes throw stages

     

    The excel file is a metadata config file so i use it to control the flow of the data from source to gold layer of the medallion architecture.

     

    So the data goes through this flow:

    lookup -> filter -> loop on filtered rows

    So the metadata is passed to the notebook ,including the sql query,

    I hade to remove the tabs , \n, extra spaces  making the query on a single line as it is passed as a string.

     

    that is how i solved the issue.

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi UsefGamal 

 

Thanks for using the Microsoft Fabric Community.

Could you please confirm the source of your .xlsx file?

Try loading the file into a Lakehouse and use the below code.

import pandas as pd

# Read the Excel file
df = pd.read_excel('lakehouse ABFS file path', sheet_name='Sheet1')

 

I hope this information helps. Please do let us know if you have any further queries.

 

Thank you.

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi UsefGamal 

 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

 

Thanks.