Issue loading data

[MCALDERON]

Hello, 

I am working with data coming from a .csv, the files are located on a sharepoint folder. Those csv comes daily so it is a big amount of data, aprox 6 million records or more.

When loading the data to the query, I made some simple tranformations, everything works fine but as soon as I save and apply changes, I get the error: Failed to save modifications to the server. Error returned: 'OLE DB or ODBC error: [DataSource.Error] The operation has timed out.. '.

Is there any way of getting the data or is not possible because the amount of data? I am filtering for resolved-completed status and taking the data that comes from July 1st.

[Anonymous]

Hi @MCALDERON ,

The error may be caused by a single Roll up summary that is looping over opportunities.

You can apply a step at the early beggining of the transformation,  "Remove other columns" and leave only the ones you need (all except the formulas you do not need).

The step to remove columns should be applied before any transformation is made to the columns.

Your code will look like this:

let
Source = Sharepoint.Data(),
Account = Source{[Name="Account"]}[Data],
#"Removed Other Columns" = Table.SelectColumns(Account,{"Id", "Name"})
in
#"Removed Other Columns"

Best Regards,
Rico Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.