Forum Discussion
How to process GeoTiff images in Fabric?
- 3 months ago
Hi parvgeet,
rasterio can be tricky in Fabric because it depends on native GDAL libraries under the hood, not just pure Python packages. In many cases, the package installation fails even if the Python dependency itself looks valid.
A common approach is to :
- store the GeoTIFF files in OneLake/Lakehouse
- process them through Spark notebooks
- and try installing compatible versions of rasterio, GDAL, or alternatives like rioxarray / xarray
You may also want to check whether the issue comes from :
- unsupported wheel format
- missing native dependencies or runtime compatibility with the current Fabric Spark environment.
Another option is to preprocess the GeoTIFFs externally (Databricks, local environment, Azure ML, etc.) and then load the processed outputs into Fabric.
Useful docs :
- https://learn.microsoft.com/en-us/fabric/data-engineering/library-management
- https://learn.microsoft.com/en-us/fabric/data-science/python-guide/python-overview
Hope this helps a bit 🙂
If this comment helped narrow it down, feel free to mark it as a solution so it can help others facing the same issue. - 3 months ago
I added below in YML editor view and it is working
Hi parvgeet,
rasterio can be tricky in Fabric because it depends on native GDAL libraries under the hood, not just pure Python packages. In many cases, the package installation fails even if the Python dependency itself looks valid.
A common approach is to :
- store the GeoTIFF files in OneLake/Lakehouse
- process them through Spark notebooks
- and try installing compatible versions of rasterio, GDAL, or alternatives like rioxarray / xarray
You may also want to check whether the issue comes from :
- unsupported wheel format
- missing native dependencies or runtime compatibility with the current Fabric Spark environment.
Another option is to preprocess the GeoTIFFs externally (Databricks, local environment, Azure ML, etc.) and then load the processed outputs into Fabric.
Useful docs :
- https://learn.microsoft.com/en-us/fabric/data-engineering/library-management
- https://learn.microsoft.com/en-us/fabric/data-science/python-guide/python-overview
Hope this helps a bit 🙂
If this comment helped narrow it down, feel free to mark it as a solution so it can help others facing the same issue.
I added below in YML editor view and it is working