Lead Data Engineer

Experienced Data Engineer with oil & gas experience / 100% remote

This Jobot Job is hosted by: Christine McNamara

Salary: $140,000 - $190,000 per year

A bit about us:

We are seeking a dynamic and experienced Lead Data Engineer to join our team in the oil & gas industry. As a Lead Data Engineer, you will be responsible for managing and organizing data, developing, testing, and maintaining architectures such as databases and large-scale processing systems. You will also be expected to use your experience and expertise to improve the quality of data and develop tools to help our teams in decision-making processes.

Why join us?

Medical, Dental, Vision

401k with company match

Remote work

Generous PTP + sick leave

Annual performance bonus

Job Details

Responsibilities:

Design, develop, and implement data pipelines using modern data architecture tools and techniques, including ELT, ETL, Spark, Airflow, and Snowflake.

Lead the design and implementation of database architecture using methodologies such as Kimball and 3NF.

Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.

Design and develop data applications using selected tools and frameworks as required and requested.

Oversee the development and deployment of the Data Warehouse.

Collaborate with data scientists and architects on several projects.

Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.

Write complex queries, make sure it performs optimally across different data sources.

Manage and optimize API integrations.

Manage, deploy and monitor clusters using Kubernetes and Docker.

Qualifications:

Bachelor's degree in Computer Science, Information Systems, or a related field.

Proven experience in the oil & gas industry preferred.

Minimum of 5 years of experience in a Data Engineering role with a focus on data architecture and pipeline development.

Proven experience with data architecture methodologies.

Hands-on experience with on-premise/SaaS/PaaS/IaaS and cloud technologies (Azure preferred).

Proficiency with data pipeline tools such as ETL, Spark, and Airflow.

Experience with data warehouse technologies like Snowflake.

Deep understanding of API design and development.

Strong experience with container orchestration platforms like Kubernetes and Docker.

Strong analytic skills related to working with unstructured datasets.

Experience with or knowledge of Agile Software Development methodologies.

Strong project management and organizational skills.

Excellent communication skills, both verbal and written.

Ability to work independently and as part of a team.

If you are passionate about data engineering and have the necessary skills, we would love to hear from you. This is a fantastic opportunity to be part of a fast-paced, growing team where your contributions will have a direct impact on the success of our organization.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Permanent