Forum Discussion
Transitioning from experienced DBA/Developer to Data Engineering — Advice Needed?
No two job descriptions for Data Engineers read the same. To be honest it is impossible to know everything. For example, I never used DBT, and most likely most of Fabric/ Databricks Data Engineers probably have not, but some roles absolutely require it. But I would say Python, SQL and cloud based data stores (datalakes, blob storage) . No parquet files, Delta tables and the Pyspark, Request libraries. Then have a great understanding of Medallion architecture. Also undertand Realtime(KQL, Event House) and appropriate use cases for. This will be covered in DP 700 but the concepts will stay the same.
With your experience I think getting the DP 700 and if you can get to the point you feel Dangerous in Python would be enough. Microsoft has made it so that you can do a lot without coding but once you can code, you turn into NEO. There is no spoon.
One last thought. Oddly enough, a lot of the hiring managers for Data Engineers are are not very technical. So it is important to learn how to talk about everything in layman's terms and thoroughly explain concepts in a way that instills confidence that you really know it.