Forum Discussion
olimilo
Post Prodigy
Post ProdigyDataflow timeout with Sharepoint.Files connector
I'm getting a dataflow timeout with some files I'm trying to pull from a Sharepoint folder. To my knowledge, there is no way to specify a timeout duration for the Sharepoint.Files connector - is ther...
lbendlin
Super User
Super UserWe utilize a rudimentary retry approach, like so:
...
#"Added custom" = Table.AddColumn(#"Filtered rows", "Data", each Table.SelectColumns(Table.PromoteHeaders(
try Csv.Document([Content], [Delimiter = ",", Encoding = 1252, QuoteStyle = QuoteStyle.Csv])
otherwise Csv.Document(Binary.Buffer([Content]), [Delimiter = ",", Encoding = 1252, QuoteStyle = QuoteStyle.Csv])
, [PromoteAllScalars = true]), Columns)),
...
That allows us to ingest 160 CSV files (up to 300 MB each) from a sharepoint folder.
olimiloPost Prodigy
Post ProdigyThanks, I think this has something to do with our dataflow code overall since when I get this error, the dialog box shows the all of the queries that are inside the dataflow which gives me the impression that we will have to silo some of our data on a different dataflow/query altogether.