Post Job Free
Sign in

Streamsets Integration Architect

United States
July 08, 2024


Title: Streamsets Integration Architect

Location : Dublin, CA (Onsite)

Client : Artech

Implementation : Accenture

End Client : Confidential

Duration : 12+ Months (Possible Extension)

Visa : USC, GC, GC EAD, H4 EAD

Job Description :

Important Skillsets:

Streamsets, Hadoop, Snowflake, DBT, Azure Infrastructure, AKS, 10+yrs of Retail Industry experience

Individual contributor role, with Streamsets, Hadoop, Snowflake as Primary skills

Must have 15yrs of Retail industry experience. Someone who understands Supply chain, Transportation management system models, establish an Integration pattern.


• Establish an architecture pattern and build data pipelines using Streamset to source structured, unstructured data from legacy sources and integrate with Snowflake Cloud platform. Hadoop to Snowflake migration streamlining.

• Build data pipelines using Streamset Integration platform to integrate Transportation Management System with Snowflake.

• Resolve issues with existing pipelines, refactor, rationalize and ensure pipelines are optimized for incremental load

• Establish Data observability using Dynatrace, Snowflake metadata

• Register data entities with Alation Data Catalog.

• Metadata capture: data classification, data lineage, role-based access control(RBAC).

• Review and align on Deliverables with Ross team.

• Prepare demo on Alation Data Catalog features.