Data Engineer

Job Title: Senior Data Engineer

Location: San Jose, CA (Hybrid)

Duration: 6 months

Contract Type: W2 only

Pay Rate: $69.72/Hour

We are seeking a highly skilled Senior Data Engineer to join our Data Science Engineering team. In this role, you will design and maintain scalable data pipelines, orchestrate workflows, and develop dashboards that empower data-driven decision-making.

Key Responsibilities

Design, build, and maintain robust data pipelines to support analytics and dashboarding needs.

Collaborate with stakeholders to gather business requirements and translate them into actionable data solutions.

Develop modular and efficient ETL workflows using orchestration tools.

Ensure comprehensive documentation for maintainability and knowledge sharing.

Build and deploy cloud-native applications (AWS, Azure, or GCP) with a focus on cost optimization.

Write scalable, distributed data processing code using PySpark, Python, and SQL.

Integrate with RESTful APIs to consume and process external data services.

Create high-performance dashboards using Tableau or Power BI.

Required Skills & Experience

10+ years of experience in building scalable data pipelines and analytical dashboards.

Proficiency in SQL, PySpark, and Python for Big Data processing.

Strong experience with cloud platforms and data warehousing technologies (e.g., Databricks).

Expertise in workflow orchestration tools (e.g., Airflow, AWS Glue).

Experience designing architectures for complex workflows, including data privacy and deletion.

Proven ability to reduce technical debt and automate data workflows.

Deep understanding of data privacy, governance, and compliance.

Experience handling petabyte-scale datasets.

Familiarity with anomaly detection, monitoring, and alerting systems.

Strong documentation and presentation skills.

Skilled in performance tuning for dashboards and queries.

Knowledge of Medallion Architecture and Delta Live Tables.

Preferred Qualifications

Demonstrated ability to quickly adapt to new technologies and environments.

Self-starter with a proven track record of delivering high-quality solutions with minimal ramp-up time.

Strong problem-solving skills and a proactive mindset.