Forum Discussion
Solved
Load Parquet File into Fabric Datawarehouse
Hello, Im writting a Fabric notebook to load a Parquet file into Fabric Warehouse. I want this isn Pysparks only as the notebook is fully written using the PySparks. Please advise me the fast & eff...
Hi westf,
Perhaps you can take a look at the following link to use notebook load data to data warehouse.
Load data to MS Fabric Warehouse from notebook - Stack Overflow
Regards,
Xiaoxin Sheng
Below is the sample code that we use :
# Load the Parquet file into a Spark DataFrame
df = spark.read.parquet("path/to/your/parquet/file")
# Write the DataFrame to the Fabric Data Warehouse df.write.mode("overwrite").saveAsTable("your_table_name")
Now based on what I know, you can either append or overwrite data in table directly.
I am not sure w.r.t upsert, need to validate myself