Post Job Free
Sign in

Architect - Azure Databricks

Company:
Marlabs LLC
Location:
Bengaluru, Karnataka, India
Posted:
May 02, 2024
Apply

Description:

Marlabs is a digital innovation company helping enterprises innovate & capture digital opportunities to enable swifter solutions. Our focus is to help each of our clients find and capture their unique opportunities and empower them with digital technologies so that they can run a purposeful business. Visit and know more about us –

Work Location - Bengaluru/Pune (Hybrid)

What you can expect from the job:

Lead the design and implementation of our cloud-based data architecture using Azure Databricks and Azure native services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.

Collaborate with cross-functional teams to define data requirements, develop data models, and establish data governance policies and standards.

Architect scalable and efficient data pipelines to support real-time and batch processing, ensuring data quality, reliability, and consistency.

Design and implement security and compliance measures to protect sensitive data and ensure regulatory compliance.

Optimize data architecture for performance, scalability, and cost-effectiveness, leveraging cloud-native technologies and best practices.

Provide technical leadership and mentorship to data engineering teams, guiding them in the implementation of data solutions and adoption of best practices.

Evaluate emerging technologies and trends in data engineering and cloud computing and recommend strategic investments and initiatives.

Collaborate with infrastructure and operations teams to define and implement cloud infrastructure requirements and configurations.

Establish and maintain documentation for data architecture, including data models, data lineage, and system configurations.

What will help you do the job well:

10 to 12 years of experience working as a Data Architect, with a focus on cloud-based data platforms and services, particularly Azure Databricks and Azure native services.

Extensive hands-on experience designing and implementing data solutions using Azure cloud services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.

Strong proficiency in SQL, Python, and Spark, with advanced knowledge of data modelling techniques, dimensional modelling, and data warehousing concepts.

In-depth understanding of data governance, security, and compliance frameworks, with experience implementing security controls and encryption mechanisms in cloud environments.

Excellent leadership and communication skills, with the ability to effectively communicate technical concepts and strategies to stakeholders at all levels.

Proven ability to lead cross-functional teams, drive consensus, and achieve project goals in a dynamic and fast-paced environment.

We would love it if you have:

Bachelor’s or master’s degree in computer science, Engineering, or a related field.

Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert or Microsoft Certified: Azure Data Engineer Associate are highly desirable.

Apply