Designation: Cloud Data Architect
Experience: 12+ years
Location: Bangalore, Gurgaon, Mohali
Job Description :
Design and implement data architectures: This involves analyzing business needs, selecting appropriate technologies, and creating blueprints for data ingestion, transformation, storage, and processing using Databricks.
Build and optimize data pipelines: Develop efficient and reliable data flows that move data from various sources to destinations, ensuring data quality, performance, and security.
Collaborate with stakeholders: Work closely with data engineers, analysts, and business users to understand requirements, translate them into technical solutions, and communicate effectively.
Monitor and troubleshoot issues: Proactively identify and resolve performance bottlenecks, data quality problems, and other technical challenges in the data pipelines.
Stay up-to-date with the latest technologies: Continuously learn about new features and capabilities of Databricks and related technologies to adapt and improve solutions.
Document and share knowledge: Create clear and concise documentation of architectures, designs, and processes to ensure knowledge transfer and maintainability.
Qualifications:
Experience: 12+ years of experience in data architecture or engineering with Databricks.
Technical skills:
Proficiency in SQL, Python, and Scala.
Understanding of big data concepts and frameworks (Spark, Hadoop, etc.).
Knowledge of cloud platforms (AWS, Azure, GCP) is a plus.
Familiarity with data security and governance best practices.
Soft skills:
Excellent communication and collaboration skills.
Problem-solving and analytical skills.
Ability to work independently and as part of a team.