Data Engineer - TDM, IDMC

Avanciers is seeking a highly skilled Data Engineer - TDM, IDMC to join our team for an exciting Fulltime role with one of our esteemed Fortune 500 clients, based in Canada. This is a REMOTE role.

Position: Data Engineer - TDM, IDMC

Location: [CANADA (REMOTE)

Job Description:

The Test Data Engineer is a critical role responsible for establishing, implementing, and governing the Test Data Management (TDM) strategy. This position ensures that high-quality, secure, and compliant test data is reliably available to support rigorous software testing across all non-production environments. The role requires a strong blend of data engineering, security (masking), and automation expertise, particularly within the Azure cloud ecosystem.

Core Responsibilities

TDM Strategy & Governance: Define, implement, and lead the organization’s TDM strategy, methodology, and governance, establishing the TDM function as a core service.

Test Data Supply Chain: Design and maintain the end-to-end data flow (supply chain) from production to non-production, guaranteeing data quality, volume, and referential integrity .

Data Security & Masking: Mandate the use of and execute data masking/protection techniques (using TDM tools) to secure sensitive customer information (PII) for compliance in lower environments.

Data Sourcing & Preparation: Utilize complex SQL queries to perform data identification, analysis, and extraction across relational (SQL Server, Oracle, DB2) and NoSQL sources for specific testing scenarios.

TDM Tooling & Automation: Implement TDM functions using tools like Informatica IDMC, CA, or Delphix for sub-setting, synthetic data generation, and golden copy creation. Automate test data refresh and provisioning, integrating TDM services into CI/CD pipelines and Test Automation Frameworks.

Cloud Data Engineering: Design and build data pipelines using Azure Data Factory (ADF), PySpark, and Databricks Notebooks to manage and transform test data in the Azure cloud environment.

Design & Consultation: Analyze business requirements, conduct feasibility studies (POCs), and create high-level design documents for optimal test data solutions.

Minimum Positions Qualifications/Education Requirements:

8+ years of software product development, testing and delivery experience.

5+ years of TDM/SQL experience.

3+ years of Informatica Power Center, IDQ, IICS/IDMC experience.

2+ years of experience in some of the Azure Cloud tools: ADF, Pyspark, databricks notebooks

3+ Experience with Python and libraries like Panads, Numpy & Matplotlib.

Familiar with Latest Cloud Technologies.

Mandate Key Skills:

Expertise in TDM Strategy and Implementation: including defining and driving TDM strategy, governance, and delivery model as a core function.

Strong proficiency in SQL for data identification, extraction, transformation, and analysis: SQL, NonSQL, Relational Database.

Experience with TDM Tools & Automation: Hands-on experience with TDM tools like Informatica IDMC, CA, Delphix

Experience with Azure Cloud tools: Azure Data Factory, PySpark, Databricks Notebooks.

Experience with test management tools like: HP ALM, Jira, QMetry