Import Multiple SharePoint Lists as One Dataset share

[mjholland]

Hi,

I've just watch Greg Low's webinar where he imported multiple CSV files from a folder in to one dataset by changing the filepath to look at the folder containing all these files.

Is it possible to do the same with SharePoint Lists? I have 3 lists in SharePoint all with the same structure. I've previously had to import all 3 to Power BI Desktop then append them all together to create one dataset. But there's so much data that it's slow to do a refresh is it's now refreshing 4 datasets. I want to be able to combined them all in to one dataset without the need to append.

When I try to link to a SharePoint Folder my lists don't appear. But when I just link to a SharePoint list, the 3 files appear and upload separately.

Is this possible?

Thanks,

mjholland

[Greg_Deckler · Accepted solution]

So, are they lists or are you talking about something like CSV files in a document library?

If they are SharePoint lists, you can use a modified version of my "Power Query: Merge Queries with M" article.

http://social.technet.microsoft.com/wiki/contents/articles/32915.power-bi-merge-query-with-m.aspx

Essentially, within one query, you define the three sources and append them together. Similar to what you probably have today but it is all in one query.

[mjholland]

This looks about right. I'll give it a go next week and let you know how I get on.

Thanks,

mjholland

[mjholland]

I've found a way to do this without having to go in to any M language ...

• I linked to one of my lists in SharePoint and imported it in PowerQuery
• Then I selected the cog next to 'source' on the Query Settings panel. This shows up all the lists that appear in my SharePoint site
• From there I removed rows of lists I didn't need
• Then I expended the table column to reveal the fields in each SharePoint list
• When I did this it merged my lists together

It works a treat.