Lead Data Architect

Position: Data Architecture

Location: Houston, TX four days onsite.

Job Type: W2

They are not just looking for a developer, but a business facing engineering lead with agile project management experience. Leadership experience, soft skills, communication and presentation skills are very important.

Responsibilities May Include:

Lead data engineering teams through Agile methodologies, ensuring timely delivery of high-quality data products.

Collaborate with business stakeholders to define clear business requirements, user stories, and acceptance criteria.

Lead the design and implementation of scalable and secure cloud-based data infrastructure on platforms such as Azure, AWS, and other cloud services.

Lead the architecture and development of data warehouses, data lakes, and lake-houses, data pipelines, AI/ML/BI solutions.

Lead the implementation of data management and governance frameworks, including data ownership, stewardship, data quality management, master data management, and data access control.

Champion the integration of advanced analytics, machine learning, and artificial intelligence capabilities within the data architecture.

Drive the adoption of DataOps, DevOps, and MLOps practices to ensure efficient and automated delivery of data solutions.

Required Qualifications:

Legally authorized to work in the job posting country

Bachelor’s degree in computer science, engineering, business, or related field

1 or more hands-on experience with Data Engineering tools like DataBricks, Delta Lake, and Parquet, and with proficiency in developing and high-performance data pipelines using SQL, Python, PySpark, and Spark Clusters for large-scale data processing

Strong expertise in BI & Data Visualization tools, specifically Power BI (dashboard creation, reporting, and analytics)

Hands-on experience with Agile Project Management, including Azure DevOps for sprint planning, tracking, and reporting progress to various audiences including end users as well as senior leadership.

Preferred Qualifications:

3 or more years of experience in the Oil & Gas industry with a strong understanding of commercial and/or logistics value chain, including trade and risk management, deals-to-dollars processes, and commercial contracts for physical commodities

10 or more years of experience in Data Architecture, Data Engineering, or related fields, with a strong focus on large-scale data infrastructure and cloud environments

Strong background in business analysis, working closely with business stakeholders to define features, user stories, requirements, acceptance criteria, and test cases

Solid understanding of Data Governance, including Data Security, Data Stewardship, Data Quality, and Master Data Management

Proven experience in AI/ML, specifically with Azure Machine Learning, Fabric Data Science, and Gen AI frameworks

Familiarity with DataOps, DevOps, and MLOps practices, including CI/CD, automated testing, containers (Docker), and orchestration (Kubernetes)

Certification in Cloud Platforms (Azure, AWS, GCP)

Thanks & Regards

Abhishek Yadav

Sr. IT Recruiter

Novia Infotech LLC