Forum Discussion

joshua1990's avatar
joshua1990
Icon for Post Prodigy rankPost Prodigy
4 years ago

Change Column Type in Dataflow or PBI Desktop

Hello everyone!

I have access to a Data lake (Databricks) that stores multiple hundred million records.

Unfortunately, all of these tables/columns/values are stored as a string.

Now, since I have to define the types for every column, would you do that in the dataflow or in the dataset?

Especially from a performance and refresh time point of view.

Unfortunately, it is not possible to define the column types in the data lake.

 

1 Reply

  • v-xiaotang's avatar
    v-xiaotang
    Icon for Community Support rankCommunity Support

    Hi joshua1990 

    There are differences between dataflow and dataset in many aspects. Which one to choose depends on your needs. They can be used to solve various problems. Each implementation has it’s advantages and disadvantages.

    Here's an article for your reference,

    https://ssbipolar.com/2019/10/14/power-bite-dataflows-vs-datasets/

     

     

    Best Regards,

    Community Support Team _Tang

    If this post helps, please consider Accept it as the solution to help the other members find it more quickly.