Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago
Solved

Removing duplicate values in Power BI cloud

I'm pulling data into the MS SQL server which I then use to build a report in Power BI. I have some duplicate values that I want to remove. I know how to do it in Power BI desktop.

The problem is that the report is published to Power BI cloud and dataset is refreshed daily in the cloud.

Is there any way to remove duplicates when data is refreshed in the cloud?

  • Hey,

    if you are importing the data, then the steps you apply to remove the duplicates will also be applied if the dataset will be refreshed in the service.

    If you use direct query then this may not be possible as not all transformations are supported for directquery. Nevertheless, in case of directquery I would recommend to create a query to remove the duplicates on the SQL Server side.

    Hopefully this provides some insight.

    Regards,
    Tom

2 Replies

  • Hey,

    if you are importing the data, then the steps you apply to remove the duplicates will also be applied if the dataset will be refreshed in the service.

    If you use direct query then this may not be possible as not all transformations are supported for directquery. Nevertheless, in case of directquery I would recommend to create a query to remove the duplicates on the SQL Server side.

    Hopefully this provides some insight.

    Regards,
    Tom
    • Anonymous's avatar
      Anonymous
      Not applicable

      We're importing data and I wasn't aware that the queries we added in Power BI desktop are retained when the dataset is refreshed in the cloud.

      Thanks!