Data Engineer (ETL, Talend, Spark, HDInsight)

Job Description

Description:

NOTE: This is a full-time employment opportunity (No C2C, subcontractor or 1099 engagements, please.) The candidate MUST be a U.S. Citizen or Permanent Resident and must be able to complete/pass/hold a public trust investigation. This is a remote opportunity; ET time zone work schedule.

Daily Responsibilities

Provide engineering and administrative support for data integration solutions, databases and systems, including Talend, Spark, and HDInsight.

Talend coding, Spark coding, Azure Blog Storage configurations, read and removal of databrick from Talend code, Nexus, JIRA, Confluence, Gitlab configurations for Talend code.

Receive, transform, and test data files using data analytics tools.

Provide data engineering, maintenance, and modernization support for EDM production systems. Analyze data problems and recommend potential data integrity solutions via a Data Quality Analysis Report.

Ensure EDM service resiliency through improved technology and best practices.Requirements:

Must be a U.S. Citizen or Permanent Resident, as mandated by our government client.?

Must be able to complete/pass/hold a public trust investigation.

7+ years of experience in data warehouse architecture, ETL design and development.

ETL development experience with Talend, Spark, and/or HDInsight.

Experience in building framework-based data integration using the above tools.

Experience in building Talend based ETL workflow to ingest, transform and aggregate data.

Extensive experience in ETL methodology for performing data profiling, data migration, Extraction Transformation and Loading.

Solid experience in implementing complex business rules by creating reusable transformations and robust mappings using various transformations.

Experience in writing complex SQLs to analyze and troubleshoot the issues/problems.

Experience with data analysis, data architecture, data cleansing and data quality.

Technical experience with Industry standard CICD methods, Azure preferred.

Excellent analytical skills, attention to detail, and strong problem-solving abilities.

Excellent communication and collaboration skills.

BS/BA degree in Computer Science, Information Sciences, or related IT discipline

Our Comprehensive Benefits Package Includes:

401(k) Retirement Plan

Health Insurance Plans (Medical, Rx, Dental, and Vision – Open Access)

Long Term and Short-Term Disability (Company Paid Benefit)

Life Insurance Benefit (Company Paid Benefit)

Employee Assistance Program (EAP)

Generous Paid Time Off (PTO)

Paid Holidays

Health Care and Dependent Care Flexible Spending Accounts (FSA)

Voluntary Life and AD&D Insurance

Discount Programs for Consumer Products and Wellness Services

Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.

Full-time

Fully remote