Forum Discussion
Helper IIISpark Data Warehouse Connector and Pyspark
Helper IIIYes, it's only Scala for now
And we also look for another feature: create regular views of lakehouse SQl endpoint from notebook without using Script pipeline
Hi yongshao ,
-- At this point, is Scala the only language for this feature?
You are correct. One of the current limitations is that only Scala is supported.
Spark connector for Microsoft Fabric Synapse Data Warehouse - Microsoft Fabric | Microsoft Learn
Notebook itself does not directly provide database or repository management functionality, such as creating views.
-- With the script pipeline we have to manually establish the connection of lakehouse SQL endpoint, which cannot be automated.
Please first create a new pipeline, call the notebook in the pipeline, the logic of the code in the notebook is to connect to lakehouse and storage the view data to the table.
after that, create a Copy data activity in the pipeline, the data source is the table in lakehouse and the destination is the warehouse.
finally, create a schedule for the pipeline.
Best Regards,
Gao
Community Support Team
If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!
How to get your questions answered quickly -- How to provide sample data in the Power BI Forum