Connect to web data source like a folder?

Question

I have some files published using apache and I am accessing them in Power BI with a Web connector. This works fine as long as I know the exact name of the file I want. But in some cases I need to import all the files in the web directory and don't know their names or how many there are.

E.g. my files are at https://myserver/files/ and I am trying to access all the files in that web server directory in the same fashion as I coudl if using a FOLDER connnector, where I could read all the files in a Windows folder I can't seem to find any references to how to do this. I've see reference to accessing a SharePoint folder but this isn't SharePoint.

Any ideas?

greg_deckler · Answer

Not sure if there is a solution. You could just sync the files locally. Oh, yeah, Apache doesn't do that. 😉 Not easily I guess anyway.&nbsp;https://www.liquidweb.com/kb/how-to-sync-two-apache-web-servers/
&nbsp;
ImkeF&nbsp;any ideas here?
&nbsp;
&nbsp;

imkef · Answer

Hi&nbsp;Anonymous ,
I'm not familiar with it, sorry.
&nbsp;

anonymous · Answer

Thanks, Greg_Deckler&nbsp; and ImkeF&nbsp;however I don't need to sync multiple Apache servers. I have files being stored in one server and I can do a scheduled refresh with Power BI re-reading the data periodically.&nbsp; My challenge is trying to find a way to treat that server directory as if it were a folder on a Windows OS, and have the functionality of a folder connection. That would allow me to get all the files in it, without knowing in advance how many there are, or their exact names. There may not be a way to do it like that.

gracez · Answer

Hi Gitouttatown,&nbsp;Have you found the solution? I have the same problem getting all files in our server folder. Thank you.&nbsp;&nbsp;Grace Zhang

anonymous · Answer

Hi Grace- sorry for the very delayed reply. I didn't find a solution in the way I hoped. Ultimately I solved the problem by algorithmically generating all the file names I expected I might find, and then querying for each and doing error handling for items not found. That is, I'm looking for files that will be generated each day with a predictable pattern based on the date it was generated. So I look for each specific file. It's more work, but it does what I need. I would still like to be able to get a list of all files that are actually in a folder on a web server but I didn't find that sort of soltuion.

Forum Discussion

Connect to web data source like a folder?

6 Replies

Related content

Connection failed using a Folder connection in a pipeline

Connecting Sharepoint Folder to PowerBI

Sharepoint Folder Connection – Access Required

OneDrive Folder as source

Connecting Sharepoint folder to Power BI