I have same issue with sleepeatazure, my code is like this:
import duckdb
# Initialize DuckDB connection
conn = duckdb.connect()
print("Connect success")
conn.execute("SET TimeZone = 'UTC'")
print("Execute timezone ke UTC success")
conn.sql("LOAD '/home/path/azure.duckdb_extension';")
print("Load azure.duckdb_extention success")
conn.sql("""
CREATE SECRET secret4 (
TYPE AZURE,
PROVIDER CREDENTIAL_CHAIN,
CHAIN 'cli;env',
ACCOUNT_NAME 'onelake'
);
""")
print("create secret credential success")
conn.sql("LOAD '/home/path/delta.duckdb_extension';")
print("Load delta.duckdb_extension success")
print("create query")
# Query SELECT dari parquet di abfss
query = """
SELECT * FROM delta_scan('abfss://demo@onelake.dfs.fabric.microsoft.com/lakehouse/Tables/mapping_object');
"""
print("create query success") # I also used not only delta_scan, but 'read_parquet'
print("proses query start")
# run query dan save result to pandas dataframe
df = conn.execute(query).fetchdf()
print("proses query success")
print(df.head())
Error:
unknown error occurred, this could mean the credentials used were wrong. Original error message: 'Fail to get a new connection for: https://onelake.blob.fabric.microsoft.com. Problem with the SSL CA cert (path? access rights?)'
Extra:
Package Version: - Python 3.7.16
----------------- -----------
certifi 2022.12.7
deltalake 0.13.0
duckdb 1.1.3
joblib 1.3.2
numpy 1.21.6
pandas 1.3.5
pickleshare 0.7.5
pip 22.3.1
pyarrow 12.0.1
python-dateutil 2.9.0.post0
pytz 2025.2
scikit-learn 0.22
scipy 1.7.3
setuptools 65.6.3
six 1.17.0
typing_extensions 4.7.1
wheel 0.38.4
- (It’s better not to change the version, because it is compatible with the modeling in my previous infrastructure)
- And I have 2 different file, azure.duckdb_extension and delta.duckdb_extension to enable support for Azure authentication and reading Delta tables, sometimes you need to install additional packages manually if they are not included during the pip install duckdb.
I have read the Medium article you shared, but I couldn’t find any information related to DuckDB accessing ABFSS/blob storage.
Could you please let us know if you have any information or guidance regarding this issue?
Thank you.
