Forum Discussion
Moving from Power BI to data engineering
Hello BIA1996
You are in a good position already, as you have been working with DAX and M language. Your direction of travel to learn a code based approach also seems appropriate. If you've already done DP-600 your best bet is to try Notebook approach using SQL or Python language, and get some experience in working with Spark APIs.
You can start by
- Using T-SQL with Warehouses, and get your confidence up in writing stored procedures and functions.
- Using Python and Spark notebooks where appropriate in building ingestion, transformation and orchestration logic, Pandas first then diving into Spark.
You background on BI is desirable - engineering can be transform the data into a desired state, but BI skills are invaluable in turning transformed and cleaned data into insights!
- BIA19966 months agoFrequent Visitor
Hi,
thank you for tour advices!
This post can be closed