Forum Discussion
Import Multiple SharePoint Lists as One Dataset share
Hi,
I've just watch Greg Low's webinar where he imported multiple CSV files from a folder in to one dataset by changing the filepath to look at the folder containing all these files.
Is it possible to do the same with SharePoint Lists? I have 3 lists in SharePoint all with the same structure. I've previously had to import all 3 to Power BI Desktop then append them all together to create one dataset. But there's so much data that it's slow to do a refresh is it's now refreshing 4 datasets. I want to be able to combined them all in to one dataset without the need to append.
When I try to link to a SharePoint Folder my lists don't appear. But when I just link to a SharePoint list, the 3 files appear and upload separately.
Is this possible?
Thanks,
mjholland
So, are they lists or are you talking about something like CSV files in a document library?
If they are SharePoint lists, you can use a modified version of my "Power Query: Merge Queries with M" article.
http://social.technet.microsoft.com/wiki/contents/articles/32915.power-bi-merge-query-with-m.aspx
Essentially, within one query, you define the three sources and append them together. Similar to what you probably have today but it is all in one query.
3 Replies
So, are they lists or are you talking about something like CSV files in a document library?
If they are SharePoint lists, you can use a modified version of my "Power Query: Merge Queries with M" article.
http://social.technet.microsoft.com/wiki/contents/articles/32915.power-bi-merge-query-with-m.aspx
Essentially, within one query, you define the three sources and append them together. Similar to what you probably have today but it is all in one query.
This looks about right. I'll give it a go next week and let you know how I get on.
Thanks,mjholland
I've found a way to do this without having to go in to any M language ...
- I linked to one of my lists in SharePoint and imported it in PowerQuery
- Then I selected the cog next to 'source' on the Query Settings panel. This shows up all the lists that appear in my SharePoint site
- From there I removed rows of lists I didn't need
- Then I expended the table column to reveal the fields in each SharePoint list
- When I did this it merged my lists together
It works a treat.
