Responsibilities / Skills Must have:
Must have experience mentoring and leading Data engineering team.
Highly Experienced with Azure Databricks features
Deal with some of the Ambiguities in the codebase
Experienced with coding in Python, Pyspark
Must have experience with cluster configurations
Proficiency in Databricks and Azure Cloud, Databricks Asset Bundles.
Hoslistic vision on the Data Strategy.
Proficiency in Data Streaming and Data Modeling
Strong understanding of data scaling and its complexities
Data Archiving and Purging mechanisms
Experienced with Sql
Should have Excellent problem solving skills