Forum Discussion
Ingesting data from Google Drive folder
Have anyone done this before ? I am just playing around, trying to ingest data (multiple csv flat files) into Microsoft Fabric. I tried to use HTTP protocol in Pipeline item, but it did not work and returned the error message below when I tried to preview the data, but somehow the test connection worked (really dunno why). For the url in source in copy action, I basically clicked on sharing file in Google Drive then chose the Copy link url option (I already set it as Anyone with the link can access it).
Hello bao_phan
The copy link gives you a URL that points to a web page, not the file that you're after. The HTTP activity finds it as a huge first row and throws that error. This is not an issue with connectivity, but the content of the URL being deciphered as a row, hence test connection succeeds!
The workaround is to change the URL into a downloadable direct file URL, so Fabric can download. Change the URL as per this -
Original (share) link looks like:Convert to direct download:Use this in the HTTP connectors source. This should return the file content. This is explained here:
2 Replies
Hello bao_phan
The copy link gives you a URL that points to a web page, not the file that you're after. The HTTP activity finds it as a huge first row and throws that error. This is not an issue with connectivity, but the content of the URL being deciphered as a row, hence test connection succeeds!
The workaround is to change the URL into a downloadable direct file URL, so Fabric can download. Change the URL as per this -
Original (share) link looks like:Convert to direct download:Use this in the HTTP connectors source. This should return the file content. This is explained here:oh, so we need to change the url like the format you mentioned to allow Fabric to be able to download the files and read that file. Thank you!!! Your solution works.
