Post Job Free
Sign in

Data Engineer

Company:
Annex It Solutions
Location:
Toronto, ON, Canada
Posted:
May 07, 2025
Apply

Description:

ob Overview:

We are looking for a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience working with large datasets, building ETL processes, and supporting data analytics and machine learning teams by ensuring clean, reliable, and accessible data.

Key Responsibilities:

Design, build, and maintain efficient and scalable ETL/ELT pipelines to process structured and unstructured data.

Develop and optimize data models, data lakes, and data warehouses.

Integrate data from multiple sources, including APIs, databases, and third-party platforms.

Collaborate with data scientists, analysts, and software engineers to deliver high-quality data solutions.

Implement data quality checks, validation, and monitoring processes.

Ensure security, compliance, and governance of data systems.

Document data flows, schemas, and processes.

Required Qualifications:

Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field.

2–5 years of experience in data engineering or a similar role.

Strong programming skills in Python, Java, or Scala.

Proficiency with SQL and relational databases (e.g., PostgreSQL, MySQL).

Experience with data pipeline and workflow tools (e.g., Airflow, Luigi, Apache NiFi).

Familiarity with big data technologies (e.g., Spark, Hadoop, Kafka).

Experience with cloud platforms such as AWS (e.g., S3, Redshift, Glue), Azure, or GCP.

Preferred Qualifications:

Experience with modern data warehouses (e.g., Snowflake, BigQuery, Databricks).

Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).

Familiarity with DevOps practices and CI/CD tools.

Strong understanding of data privacy and governance practices (e.g., GDPR, HIPAA).

Apply