Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

Issue with Publishing Data in the Lakehouse

Hello team,   I hope this message finds you well.   I have some data and I have created a script in Power Query. The script runs without any errors and I can see the output in my view.   Howeve...
Dataflows
Need Help
  • charlyS's avatar
    charlyS
    2 years ago

    Hello Anonymous,

     

    Trying to reproduce, it seems that the last record generate an error retrieving the Duration Column, is there a possibility you didn't saw that ? 

     

    Regards,

     

  • charlyS's avatar
    charlyS
    2 years ago

    Thanks ! Any chance you can provide an exemple as : 

     

    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WCkktLlHSgVFGBkYmugaGQATnGIE4sTrRSiVAJUZAYRgNV4vgGIPVxgIA", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [SourceAddress = _t, DestinationAddress = _t, StartTime = _t, EndTime = _t]),
      // Step 2: Ensure the correct data types before sorting
    ...
     
    To try to reproduce your error ? 
     
    Regards,
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Anonymous 

     

    Thank you very much charlyS for your prompt reply.

     

    Although you mentioned that you didn't have the problem that charlyS said you did, I suggest you check. Because in my test, I also encountered the same thing.

     

    This error first occurs in step 5:

     

     // Step 5: Shift Source and Destination Addresses using List.Generate to efficiently calculate the "NextRow"
    ShiftedTable = Table.AddColumn(AddIndex, "NextRow", each try SortedTable{[Index]} otherwise null),

     

    There should be no "null" here. The result is the error that charlyS describes.

     

     

     

    I recommend that you test with a small amount of data first. And modify the step 5 as:

     

    Table.AddColumn(AddIndex, "NextRow", each try SortedTable{[Index] - 1} otherwise null)

     

     

     

    Finally, in my tests, it was successfully published in lakehouse.

     

     

    Regards,

    Nono Chen

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

charlyS's avatar
charlyS
Icon for Most Valuable Professional rankMost Valuable Professional
2 years ago

Hello Anonymous,

 

Trying to reproduce, it seems that the last record generate an error retrieving the Duration Column, is there a possibility you didn't saw that ? 

 

Regards,

 

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hello charlyS,

     

    I tried, but I didn't get this error. If there were such an error, then this wouldn't even get published.

    • charlyS's avatar
      charlyS
      Icon for Most Valuable Professional rankMost Valuable Professional
      2 years ago

      Thanks ! Any chance you can provide an exemple as : 

       

      Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WCkktLlHSgVFGBkYmugaGQATnGIE4sTrRSiVAJUZAYRgNV4vgGIPVxgIA", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [SourceAddress = _t, DestinationAddress = _t, StartTime = _t, EndTime = _t]),
        // Step 2: Ensure the correct data types before sorting
      ...
       
      To try to reproduce your error ? 
       
      Regards,
  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Also, I have 40L + records, and in Power Query, I can see only 1000 Records.