Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
6 years ago
Solved

Import data via python, manipulate it, and send to PowerBI

Hello all,   In my scenario I want to accomplish below steps but it takes very long, I waited more than 20minutes. 1. Import data from sql with python( with pyodbc) 2. Manipulate the data, create...
Need Help
Show and Tell
Tips and Tricks
  • v-eachen-msft's avatar
    v-eachen-msft
    6 years ago

    Hi Anonymous ,

     

    1. You could try higher version of Python.

    2. So your datasource is SQL Server, right? 

    You could import data from SQL Server directly. If you want to custom the sql queries, you could set it like the image below.

    3. If you want refresh data in service, based on this document, It is not supported to implement schedule refresh via on premise Data Gateway (Enterprise Gateway) for Python in Power BI Service currently .

    • To enable scheduled refresh of your Python dataset, you need to enable Scheduled refresh and have a Personal Gateway installed on the computer that houses the workbook and the Python installation. 
    • You'll need to have the pandas library installed in your Python environment for the previous script code to work properly.
    • For the Python scripts to work properly in the Power BI service, all data sources need to be set to public.
    • Nested tables (table of tables) are currently not supported

     

v-eachen-msft's avatar
v-eachen-msft
Icon for Community Support rankCommunity Support
6 years ago

Hi Anonymous ,

 

1. You could try higher version of Python.

2. So your datasource is SQL Server, right? 

You could import data from SQL Server directly. If you want to custom the sql queries, you could set it like the image below.

3. If you want refresh data in service, based on this document, It is not supported to implement schedule refresh via on premise Data Gateway (Enterprise Gateway) for Python in Power BI Service currently .

  • To enable scheduled refresh of your Python dataset, you need to enable Scheduled refresh and have a Personal Gateway installed on the computer that houses the workbook and the Python installation. 
  • You'll need to have the pandas library installed in your Python environment for the previous script code to work properly.
  • For the Python scripts to work properly in the Power BI service, all data sources need to be set to public.
  • Nested tables (table of tables) are currently not supported

 

  • v-eachen-msft's avatar
    v-eachen-msft
    Icon for Community Support rankCommunity Support
    6 years ago

    Hi Anonymous ,

     

    Does that make sense? If so kindly mark my answer as a solution to close the case. Thanks in advance.

     

  • Anonymous's avatar
    Anonymous
    Not applicable
    6 years ago

    Hello v-eachen-msft 

     

    Thanks for the comment, I tried but it didn't work, I mean it takes ages to load so I change the pipeline to :

    Get data from SQL - execute Python script - write back result to SQL - get data from SQL with PowerBI instead of SQL-Python-PowerBI.

    I really don't know why it is so slow but in case someone searching for similar situation, writing result back to SQL is much faster than Python-PowerBI connection. I guess this connection works fine for simple scripts.

     

    Thanks!