Speed up import of SAP HANA database

[Anonymous]

Hi,

When I am trying to import data from a SAP HANA database, it very quickly becomes large and slow datasets. The key is of course to try to limit the scope of data and the columns, but I have some limitations.  For example, I usually need to import a certain field ("order number") to get a certain measurement to work from SAP HANA ("number of items"). Is there anyway somehow make the import faster by importing all of below data, then removing the "order number" and clustering the "number of items"? For example:

My data looks like this and I need to import "order number" other wise the "number of items" will be imported blank.

Customer	Order number	Number of items
A	100	10
A	101	10
A	102	10
B	103	10
B	104	10

But I only need the data in this format, meaning fewer rows to load.

Customer	Number of items
A	30
B	20

Is there any way to do this and achieve faster loading times? Right now I have to load thousands of rows and it takes quite much time. Note my actual data has many more rows and columns.

Thanks in advance

[V-lianl-msft]

Hi @Anonymous ,

 Try using "group by" in the query editor.

If the data size is large, it is recommended to use the direct query mode instead of the import mode.

Best Regards,
Liang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[dedelman_clng]

Hi @Anonymous  - my suggestion would be to create a view in HANA that does the grouping, then read from that view.

If that is not possible, suggest you post this in the Power Query forum. The users there would be able to tell you if there is a way to group prior to ingesting all of the data.

Hope this helps

David