We are looking for a Sr. Data Analytics Architect will be responsible for designing, implementing, and maintaining data pipelines and infrastructure to support our organization's data-driven decision-making processes. You will work closely with analysts and other stakeholders to ensure data availability, quality, and reliability.
Responsibilities:
Design, build, and maintain robust data pipelines that extract, transform, and load (ETL) data from various sources into data warehouses or data lakes. These pipelines should be scalable and efficient
Manage and optimize data warehouses to ensure high performance, availability, and scalability
Implement best practices for data modeling and schema design
Integrate data from different systems and sources, ensuring data consistency and accuracy
Collaborate with cross-functional teams to understand data requirements
Implement data quality checks and validation processes to identify and rectify data inconsistencies or anomalies
Ensure data is accurate, complete, and up-to-date
Optimize data processing and query performance to meet business requirements
Identify and resolve bottlenecks in data pipelines and database systems
Implement and maintain data security measures to protect sensitive information
Follow best practices for data encryption, access control, and compliance with data privacy regulations
Create and maintain documentation for data pipelines, processes, and data schemas and ensure knowledge sharing within the team
Set up monitoring and alerting systems to proactively detect and address issues with data pipelines and infrastructure
Perform troubleshooting and root cause analysis
Design systems that can scale with growing data volumes
Automate routine tasks to improve operational efficiency
Collaborate with analysts, software engineers, and other stakeholders to understand data requirements and deliver solutions that meet their needs
Stay updated on emerging technologies and tools in the data engineering field
Evaluate and recommend new technologies that can enhance data processing capabilities
Basic Qualifications:
Bachelor’s degree in computer science, or related field
Proven 5+ years of experience as a Data Engineer, preferably in a senior or lead role
Strong programming skills in languages such as Python, Java, or Scala
Proficiency in SQL and experience with relational and NoSQL databases
Expertise in data warehousing and ETL processes
Familiarity with data integration and data modeling concepts
Knowledge of big data technologies such as Hadoop, Spark, or Kafka is a plus
Experience with cloud platforms like AWS, Azure, or Google Cloud
Strong problem-solving and troubleshooting skills
Excellent communication and collaboration skills