Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
szczawek
Frequent Visitor

Power Query as staging table - free Power BI account

Hi all,

 

I am not very good in M and Power Query so i decided to ask someone better than me 😉

 

The goal i would like to achive is to have staging table of prices per day from currency exchange web site.

I need to use free Power BI account to do it.

 

I was trying to create 2 tables:

1. Pull - this query is downloading data from web page at refresh

2. StagingCurrency - this is staging table

 

For staging I tried to do as follow:

 

 

 

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i44FAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Currency = _t, Sell = _t, Buy = _t, Date = _t, Tag = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"Currency", type text}, {"Sell", type number}, {"Buy", type number}, {"Date", type datetime}, {"Tag", type text}}),
    #"Appended Query" = Table.Combine({#"Changed Type", Pull}),
    Custom1 = #"Appended Query"
in
    Custom1

 

 

 

 

 

Table StagingCurrency is created as enter data -  i listed columns to match Pull table.

Expected logic is to load data for table from Pull and then add new values after next refresh without wiping out current data.

 

Currently result is that after refresh i have only latest data from Pull table, all previous data are cleared.

 

Best

K

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

Power BI has no memory.  You cannot use it as a staging tool.  There's a thing called dataflows and you could theoretically use these with incremental refresh.  But that would be a strategy based on hope. 

 

You need to find another tool to do that, for example SQL Server Developer /Express - those are free. Or a bunch of CSV files.

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

Power BI has no memory.  You cannot use it as a staging tool.  There's a thing called dataflows and you could theoretically use these with incremental refresh.  But that would be a strategy based on hope. 

 

You need to find another tool to do that, for example SQL Server Developer /Express - those are free. Or a bunch of CSV files.

Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

February 2024 Update Carousel

Power BI Monthly Update - February 2024

Check out the February 2024 Power BI update to learn about new features.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.

Top Solution Authors
Top Kudoed Authors