Forum Discussion
Combining Multiple 'Web' Data Sources
Thanks Gordonlilj
I had actually just managed to achieve this before you posted, however I'll have a look at your post to see if that's a better solution. I muddled this in the following ways:
1. Import the first source as web source: https://{API_KEY}:{PASSWORD}@{STORE_NAME}.myshopify.com/admin/orders.json?limit=250
2. Transform the table how I required it.
3. Advanced editor this table:
Before let add: (myPages) =>
Change the URL for the web contents source to end with: ?limit=250"&myPages)),
4. Rename the property to 'fnproducts' and Close & Apply.
5. (There's probably a much cleaner way to do this but) Create an excel sheet with values in different rows of: &page=1 , &page=2, &page=3 (etc. depending on how many pages you want to pull in)
6. Import the excel sheet as a new data source.
7. Edit the query of the excel sheet
8. Add colum > Custom Column
9. Use the following custom column formula: fnproducts([Column1]) and hit OK.
10. Step through data privacy.
11. Remove column1
12. Expand remaining column.
This then pulls in all of the data into a single table. I think it's probably a bit messier than it needs to be but it works - thank you for your help.
Hi Revokez were you able to find a solution? As a workaround, maybe you can try to test your connection with a 3rd party connector, which does not have this limiations from Shopify API. I've tried windsor.ai, supemetrics and funnel.io. I stayed with windsor because it is much cheaper so just to let you know other options. In case you wonder, to make the connection first search for the Shopify connector in the data sources list:
After that, you need to follow instructions and install the windsor.ai app from the Shopify App Store:
then on preview and destination page you will see a preview of your Shopify fields
There just select the fields you need. Finally, just select PBI as your data destination and finally just copy and paste the url on PBI --> Get Data --> Web --> Paste the url.