I can't get full content of my table using python script.

[Anonymous]

I have fields in my table in query editor which contains 1024+ characters. As a result in preview I see only 1024 characters and everything more is cut. There is no problem for queries, because full content is available by powerBI but there is problem if I try run python script. It looks like "dataset" contains only preview of table. Any Ideas how to solve it? Or maybe it's issue of PB?

[v-yuta-msft]

@Anonymous ,

---

@Anonymous wrote:

I have fields in my table in query editor which contains 1024+ characters. As a result in preview I see only 1024 characters and everything more is cut. There is no problem for queries, because full content is available by powerBI but there is problem if I try run python script. It looks like "dataset" contains only preview of table. Any Ideas how to solve it? Or maybe it's issue of PB?

---

Could you please share the python code you are using?

Regards,

Jimmy Tao

[Anonymous]

@v-yuta-msft 

Actualy I can't show you script, and also my data. I'm trying to reproduce bug on diffrent data but it's hard. However now I see that this problem is slightly different. I'll show You:

This is my data:

Python Script is nothing, just to convert table to dataset:

Later dataset looks like:

I have no idea why output is so weird. Why cells are split by end of lines?

[v-yuta-msft]

@Anonymous ,

It's wierd. I would suggest you create a support ticket here.

Regards,

Jimmy Tao

[Anonymous · Accepted solution]

@v-yuta-msft 

I have reproduced my issue, maybe now You can say what is going on before I create a ticket.

This is json to read:

{
  "startAt": 0,
  "maxResults": 5000,
  "maxResultsLimit": 5000,
  "total": 409,
  "values": [
    {
      "Id": "some-code-12321",
      "title": "Some Title",
      "some messages": [
        "something\nsomething",
        "something\nsomething"
      ],
     }
			]
}

This is Query:

let
    Source = Json.Document(File.Contents("path_to_json")),
    #"Converted to Table" = Record.ToTable(Source),
    Value = #"Converted to Table"{4}[Value],
    #"Converted to Table1" = Table.FromList(Value, Splitter.SplitByNothing(), null, null, ExtraValues.Error),
    #"Expanded Column2" = Table.ExpandRecordColumn(#"Converted to Table1", "Column1", {"Id", "title", "some messages"}, {"Id", "title", "some messages"}),
    #"Extracted Values1" = Table.TransformColumns(#"Expanded Column2", {"some messages", each try Text.Combine(List.Transform(_, Text.From), " ") otherwise _, type text}),
    #"Run Python script" = Python.Execute("# 'dataset' holds the input data for this script#(lf)",[dataset=#"Extracted Values1"]),
    dataset = #"Run Python script"{[Name="dataset"]}[Value]
in
    dataset

And here is output:

[v-yuta-msft]

@Anonymous 

I could reproduce your issue. This issue should be caused by '\n'. I will report this issue internally and update here when I get any info.

Regards,

Jimmy Tao