Forum Discussion

FrancoisHuard's avatar
FrancoisHuard
Advocate II
8 years ago

Decimal Values Precision

How can a change the precision of a decimal value   Let says I have the following table CREATE TABLE dbo.Test (Column1 NUMERIC(32,12))   INSERT INTO dbo.Test VALUES(12.211112312131),(13.5555787...
Need Help
ImkeF's avatar
ImkeF
Community Champion
8 years ago

Haven't had an issue like this before. Only thing I can imagine is to buffer the table after import before doing further transformation.

But this of course would prevent query folding, so will load the whole selection so far to the model.

Greg_Deckler's avatar
Greg_Deckler
Community Champion
8 years ago

Hmm, buffering didn't seem to work, I am trying with this:

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WMjTSMzIEAiNjQyNDY0OlWB2gmLGeKRCYW5gbGgJpsJiBngEYgCRMDRFChgYGRmZGYKFYAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type text) meta [Serialized.Text = true]) in type table [Decimal = _t]),
    Buffer = Table.Buffer(Source),
    #"Changed Type" = Table.TransformColumnTypes(Buffer,{{"Decimal", type number}})
in
    #"Changed Type"
  • ImkeF's avatar
    ImkeF
    Community Champion
    8 years ago

    Now I see what you mean. Oddly enough, when that table is loaded to the datamodel, the missing decimals show up again. So it might just be a display issue in the query editor.

    • Greg_Deckler's avatar
      Greg_Deckler
      Community Champion
      8 years ago

      Ah, that's interesting. I wonder if someone from Microsoft can confirm that it is simply a display issue. I wonder if there is some calculation that could be performed to prove out whether or not it is maintaing the precision behind the scenes? 

      • FrancoisHuard's avatar
        FrancoisHuard
        Advocate II
        8 years ago

        I don't think it is only display.

        If you bring your data to the Report Pane, you don't see the remaining decimal even if I add precison from the formatting button.

        I also tried to add "total" to my column and sum it. The result (sum) of the column show that the data was rounded at 6 of precision.