Error on updating DataFlow

[GustavoBorges]

I have a Dataflow whose source is Mongo Atlas SQL, within the dataflow I do various data processing, convert jsons into tables...

Before carrying out the data processing, the dataflow was updating normally, however, now one of the tables (the largest, around 300mb / 550k mongo documents) is failing with the error: Error: We have reached the end of the buffer.

The dataflow error log (in Portuguese):

Requested on,Nome do fluxo de dados,Status de atualização de fluxo de dados,Nome da tabela,Nome da partição,Atualizar o status,Hora de início,Hora de término,Duração,Linhas processadas,Bytes processados (KB),Confirmação máxima (KB),Tempo do Processador,Tempo de espera,Mecanismo de computação,Erro,
2024-02-01 14:14:31,Mongo -  Moskit,Falhou,users,N/D,Concluído,2024-02-01 14:14:31,2024-02-01 14:15:02,00:00:31.0800,N/D,N/D,N/D,N/D,N/D,N/D,N/D
2024-02-01 14:15:02,Mongo -  Moskit,Falhou,contacts,N/D,Concluído,2024-02-01 14:15:02,2024-02-01 14:16:03,00:01:01.3470,N/D,N/D,N/D,N/D,N/D,N/D,N/D
2024-02-01 14:16:03,Mongo -  Moskit,Falhou,deals,N/D,Concluído,2024-02-01 14:16:03,2024-02-01 14:17:04,00:01:00.4570,N/D,N/D,N/D,N/D,N/D,N/D,N/D
2024-02-01 14:17:04,Mongo -  Moskit,Falhou,projects,N/D,Concluído,2024-02-01 14:17:04,2024-02-01 14:17:35,00:00:30.9930,N/D,N/D,N/D,N/D,N/D,N/D,N/D
2024-02-01 14:17:35,Mongo -  Moskit,Falhou,activities,N/D,Falhou,2024-02-01 14:17:35,2024-02-01 14:19:36,00:02:01.1830,N/D,N/D,N/D,N/D,N/D,N/D,Error: Chegamos ao final do buffer. Request ID: 2d3d1164-6e12-1005-dd04-4d7390d6e9bc Activity ID: d0bf3a78-5130-45cc-b6ca-4d116749bfd2

[Anonymous]

Hi @GustavoBorges ,

Please refer this document, hope it is helpful for you: Troubleshooting dataflow issue - get data from dataflow - Power Query | Microsoft Learn

Best regards,
Community Support Team_Binbin Yu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[GustavoBorges · Accepted solution]

Thanks for answering @Anonymous,

In fact, the problem was when converting text to JSON trying to convert a cell that was empty, then the error occurred.

Replacing the empty ones with [] or {} (depending on whether the column was an array or an object) and it worked.