Forum Discussion

samithc's avatar
samithc
Frequent Visitor
2 years ago
Solved

Error when trying to connect the Data Set using Python Script in Power BI

Hi 

 

When i am trying to use python script to connect the Data set in Power BI. i am getting the below error. Python script was for getting data from Kaggle using Kaggle API. 

 

Details: "An error happened while reading data from the provider: 'Object reference not set to an instance of an object.'"

 

When I retry then the below error is coming. 

 

Details: "ADO.NET: Unable to find the requested .Net Framework Data Provider. It may not be installed."

 

can anyone advise what will be the issue. 

 

Regards, 

Samith 

Need Help
  • samithc's avatar
    samithc
    2 years ago

    Hi All, 

     

    i have found the solution for error. i was trying many things. Atlast I went to the C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Config\machine.config and edited the machine.config. 

    in that file MySql.Data.MySqlClient was there 2 times. I have removed the duplicate and now I am able to run the python script. 

    Thank you all for the response. 

     

    Reagrds, 

     

    Samith 

7 Replies

  • samithc's avatar
    samithc
    Frequent Visitor
    2 years ago

    Hi All, 

     

    i have found the solution for error. i was trying many things. Atlast I went to the C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Config\machine.config and edited the machine.config. 

    in that file MySql.Data.MySqlClient was there 2 times. I have removed the duplicate and now I am able to run the python script. 

    Thank you all for the response. 

     

    Reagrds, 

     

    Samith 

  • Greg_Deckler's avatar
    Greg_Deckler
    Icon for Community Champion rankCommunity Champion
    2 years ago

    samithc "connect the data set in Power BI" Can you elaborate on that. A data set in the Service? A local data set when you have Power BI open? A data set within Power BI Desktop as in a Python visual? 

    • samithc's avatar
      samithc
      Frequent Visitor
      2 years ago

      Hi Greg_Deckler , 

       

      Using the below Python code. I was trying to get the date to Power BI. 

       

      ''' python

       

      import kaggle
      import os
      import pandas as pd

      # Set Kaggle API credentials directory
      os.environ['KAGGLE_CONFIG_DIR'] = 'C:/Users/samit/.kaggle'  

      # Specify the dataset identifier
      dataset = 'piterfm/paris-2024-olympic-summer-games'

      # Set the download path
      download_path = r'D:\SAMITH\Power BI\Paris 2024 Olympics Dashboard\Source'

      # Remove existing files in the folder to prevent duplicates or outdated files
      for file in os.listdir(download_path):
          file_path = os.path.join(download_path, file)
          try:
              if os.path.isfile(file_path):
                  os.unlink(file_path)  # Delete the file
                  print(f"Deleted {file_path}")
          except Exception as e:
              print(f"Error deleting {file_path}: {e}")

      # Download the dataset using the Kaggle API and unzip the files
      kaggle.api.dataset_download_files(dataset, path=download_path, unzip=True)

      # List of CSV files to be imported
      csv_files = [
          'athletes.csv',
          'events.csv',
          'medallists.csv',
          'medals.csv',
          'medals_total.csv',
          'schedules.csv',
          'schedules_preliminary.csv',
          'teams.csv',
          'torch_route.csv',
          'venues.csv'
      ]

      # Initialize a dictionary to hold DataFrames
      dataframes = {}

      # Iterate through each CSV file and load it into a DataFrame
      for file in csv_files:
          # Construct the full path to the CSV file
          file_path = os.path.join(download_path, file)
         
          # Load the CSV file into a Pandas DataFrame
          df = pd.read_csv(file_path)
         
          # Add the DataFrame to the dictionary using the file name as the key
          table_name = file.split('.')[0]  # Remove the .csv extension
          dataframes[table_name] = df

      '''

       

      I am getting the below errors : Each time I retry then error getting changed to each other. I have tried installing .net framework 8. Also tried the My SQL connecter and re-installed power bi from website. 

      1) Details: "An error occurred creating the configuration section handler for system.data: Column 'InvariantName' is constrained to be unique. Value 'MySql.Data.MySqlClient' is already present. (C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Config\machine.config line 155). This is a configuration issue with the file 'C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Config\machine.config'."

       

      2) Details: "ADO.NET: Unable to find the requested .Net Framework Data Provider. It may not be installed."

       

       

       

       

      • Greg_Deckler's avatar
        Greg_Deckler
        Icon for Community Champion rankCommunity Champion
        2 years ago

        samithc Your script worked perfectly for me. See attached PBIX below signature. But, I started with a simple enter data query whereas it seems like maybe you started with a MySQL query?

         

  • Walter726Herrin's avatar
    Walter726Herrin
    New Member
    2 years ago

    Hi Samith,

    The errors in Power BI might be due to uninitialized objects or missing .NET Framework components. Ensure all objects in your Python script are properly initialized and check for null values. Also, verify that the necessary .NET Framework Data Provider is installed. Updating Power BI and checking dependencies for your Python script and Kaggle API might help. If the issue persists, consider reinstalling the .NET Framework or checking Power BI community forums.

    • samithc's avatar
      samithc
      Frequent Visitor
      2 years ago

      Hi Walter726Herrin ,  

       

      Below python script i have tried in VS CODE and it is working in VS CODE. 

       

      import kaggle
      import os
      import pandas as pd

      # Set Kaggle API credentials directory
      os.environ['KAGGLE_CONFIG_DIR'] = 'C:/Users/samit/.kaggle'  

      # Specify the dataset identifier
      dataset = 'piterfm/paris-2024-olympic-summer-games'

      # Set the download path
      download_path = r'D:\SAMITH\Power BI\Paris 2024 Olympics Dashboard\Source'

      # Remove existing files in the folder to prevent duplicates or outdated files
      for file in os.listdir(download_path):
          file_path = os.path.join(download_path, file)
          try:
              if os.path.isfile(file_path):
                  os.unlink(file_path)  # Delete the file
                  print(f"Deleted {file_path}")
          except Exception as e:
              print(f"Error deleting {file_path}: {e}")

      # Download the dataset using the Kaggle API and unzip the files
      kaggle.api.dataset_download_files(dataset, path=download_path, unzip=True)

      # List of CSV files to be imported
      csv_files = [
          'athletes.csv',
          'events.csv',
          'medallists.csv',
          'medals.csv',
          'medals_total.csv',
          'schedules.csv',
          'schedules_preliminary.csv',
          'teams.csv',
          'torch_route.csv',
          'venues.csv'
      ]

      # Initialize a dictionary to hold DataFrames
      dataframes = {}

      # Iterate through each CSV file and load it into a DataFrame
      for file in csv_files:
          # Construct the full path to the CSV file
          file_path = os.path.join(download_path, file)
         
          # Load the CSV file into a Pandas DataFrame
          df = pd.read_csv(file_path)
         
          # Add the DataFrame to the dictionary using the file name as the key
          table_name = file.split('.')[0]  # Remove the .csv extension
          dataframes[table_name] = df
       
      Also have tried installing .netframework 8. Not sure how to install  .NET Framework Data Provider. 
       
      Regards, 
       
      Samith