Lead Software Engineer

• Design and implement robust, scalable, and efficient data architectures leveraging Azure Data Lake and Databricks.

• Define and enforce best practices for data ingestion, storage, processing, and retrieval.

• Develop and implement security measures for Azure Data Lake.

• Manage role-based access control (RBAC), encryption, and other security protocols within Azure Subscriptions.

• Lead and mentor a team of data engineers.

• Drive agile practices.

• Oversee the deployment and management of Azure Data Lake and Databricks environments.

• Implement monitoring and alerting systems to ensure system reliability and performance.

• Evaluate and incorporate new Azure services and technologies to enhance the data platform.

• Develop and execute a roadmap for data engineering.

• Stay abreast of industry trends and advancements in data engineering and Azure technologies.

• Provide recommendations for long-term data strategy, including data lake house adoption and cloud optimization.

• Bachelor's degree in computer science, Information Technology, or a related field.

• 7+ years of experience in data engineering, with at least 3 years in a leadership role.

• Azure Data Lake, Databricks, and other Azure services.

• US citizenship is required.

• Proficiency in SQL.

• Azure security concepts, including subscription management, RBAC, and data encryption.

• Experience with data modeling, ETL pipelines, and big data technologies.

• Familiarity with CI/CD pipelines and DevOps practices in a data engineering context.