Forum Discussion

fenixen's avatar
fenixen
Advocate II
9 years ago
Solved

Can I connect to a Amazon S3 bucket using Power Query?

Hi 


Amazon stores billing data in S3 buckets, i want to retrieve the CSV files and consolidate them. Is PowerBI/Power Query able to connect to S3 buckets? 

 

 

Regards

Remi 

Need Help

21 Replies

    • jbrandt's avatar
      jbrandt
      Advocate I
      8 years ago

      I've been through this information and the process seems non-trivial, as compared to connecting to other REST API services.  Has anyone actually connected PBI to an S3 bucket as a data source?   I'm looking for actual experience and not theory per se.  Thanks!

      • spinwards's avatar
        spinwards
        Regular Visitor
        8 years ago

        Is anyone still looking for this? I have this up and running .... I can't share my query, but I might be able to point you in the right direction. 

    • fenixen's avatar
      fenixen
      Advocate II
      9 years ago

      Thank you! 

       

      Im new to REST API calls so havent fully cracked it yet, but its clear that your suggestion should work :):) 

  • ZappySys's avatar
    ZappySys
    Helper I
    8 years ago

    Hi,

     

    ZappySys has released API drivers (XML and JSON) with AWS API support. See below blog post it explains scenario of how to access AWS S3 data in Power BI. It also explains Billing / Cost API usecase via API calls. ZappySys will rease CSV driver very soon which will support your scenario of reading CSV from S3 in Power BI but until that you can call Billing API (JSON format)

     

    https://zappysys.com/blog/read-amazon-s3-data-power-bi-aws-json-xml-api/

     

    Query Amazon Billing APIConfigure AWS Connection using ZappySys ODBC Driver (XML or JSON)Import Amazon Billing data in Power BI using ZappySys Driver

  • Anonymous's avatar
    Anonymous
    Not applicable
    6 years ago

    Hi,

     

    I have tried using Azure Data Factory to pull CSV from S3 bucket. If you have some ETL or SSIS experience, then you are good to go with ADF. I managed to pull the CSV into a blob storage. You can then insert the data from CSV into any SQL database and connect to Power BI. 

     

    Good luck!

    Peter

  • Anonymous's avatar
    Anonymous
    Not applicable
    7 years ago

    Best idea is to use Redshift in this case.

    PBI Architect

    • Anonymous's avatar
      Anonymous
      Not applicable
      7 years ago

      This helps!

  • gdecome's avatar
    gdecome
    Helper III
    6 years ago

    Hi fenixen , could you solve your problem? I´m facing the same situation now. I´m able to get url, credentials and s3path with Power Query (Power BI) but not sure how to use them to get the csv file with the data that I need.

    • fenixen's avatar
      fenixen
      Advocate II
      6 years ago

      Hi gdecome 

      I landed on a semi-manual solution using https://s3browser.com/ to retrieve the data files and then connecting to the files using Power Query. I didn't have people available to help me with API. 

    • Anonymous's avatar
      Anonymous
      Not applicable
      3 years ago

      Hello! I applied a similar solution to our process extracting data from a MP Tool, but to autorefresh a dashboard you need to set up a On-premise app and this lives in your local computer, hence if it is not on it will not refresh because the script is there