Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

How to Import data for latest date or Apply dynamic filters during data refresh

Hi 

 

I have a data set that contains 6 months of data in table storage. Data is added on the table on a daily basis.  I want to add a dynamic filter during import which will pick data from the last 24 hours or using the latest date only from the table storage. As the data set is huge the refresh is failing so I want to apply this filter so that only the latest data is imported. Scheduled refresh is already applied on a daily time. Please assist . 

 

Connector Used: Azure Table Storage

Number of table: 19 

 

Sample Dataset .  Additional column that I have

 

Need Help

5 Replies

  • luzwales's avatar
    luzwales
    Regular Visitor
    5 years ago
    =Table.SelectRows(Table,each DateTime.Date([TimeStamping])=DateTime.Date(DateTime.LocalNow())

     

  • Anonymous's avatar
    Anonymous
    Not applicable
    5 years ago

    Type this into the formula bar:

    = Table.Max(NameOfPriorStep, {"TimeStamp"})

    --Nate

    • Anonymous's avatar
      Anonymous
      Not applicable
      5 years ago

      I want to do this during the data import. Eg . when the refresh happens on daily basis import should only pick the latest date data . 

       

       

  • Anonymous's avatar
    Anonymous
    Not applicable
    5 years ago

    As long as you add this formula before expanding your table, it will work.