Post Job Free
Sign in

Cloud Data Engineer

Company:
Revel IT
Location:
Columbus, OH, 43224
Posted:
April 25, 2024
Apply

Description:

Our Columbus, Ohio client has a contract opportunity for a Cloud Data Engineer who will be responsible for developing, expanding, and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

On-site 2-3 days/week in Columbus, Ohio.

NO THIRD PARTIES! Candidates MUST be on our W2 payroll.

Position requires candidate to manage and guide a team of developers in addition to completing technical work so candidates must have previous experience as a technical lead or a background that also includes with leadership/management.

Required Skill Set: (Technical + Soft Skills)

Informatica, IICS data pipeline development experience, Cloud Datawarehouse (Snowflake preferred), on-prem to cloud migration experience

Ability to perform peer SIT testing with other Cloud Data Engineers

Database - MS SQL Server, Snowflake.

Nice To Have Skill Set: (Technical + Soft Skills)

Nice to have / medium priority: Informatica PowerCenter (high priority)Nice to have / medium priority: Informatica PowerCenter (high priority)

Analytical reporting - Tableau / Qlik Sense / SAS / R (migrating existing reports -mostly Tableau / moving from Qlik View to Qlik Sense)

Kafka, Kubernetes.

Desired Industry Experience:

Finance, Lease / Loan or Automotive experience are a plus.

Cloud Data Engineer

Qualifications:

BASIC QUALIFICATIONS:

This position requires a Bachelor's Degree in Computer Science or a related technical field, and 5+ years of relevant employment experience.

2+ years of work experience with ETL and Data Modeling on AWS Cloud Databases.

Expert-level skills in writing and optimizing SQL.

Experience operating very large data warehouses or data lakes.

3+ years SQL Server.

3+ years of Informatica or similar technology.

Knowledge of Financial Services industry.

PREFERRED QUALIFICATIONS:

5+ years of work experience with ETL and Data Modeling on AWS Cloud Databases.

Experience migrating on-premise data processing to AWS Cloud.

Relevant AWS certification (AWS Certified Data Analytics, AWS Certified Database, etc.).

Expertise in ETL optimization, designing, coding, and tuning big data processes using Informatica Data Management Cloud or similar technologies.

Experience with building data pipelines and applications to stream and process datasets at low latencies.

Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.

Sound knowledge of data management and knows how to optimize the distribution, partitioning, and MPP of high-level data structures.

Knowledge of Engineering and Operational Excellence using standard methodologies.

Responsibilities:

The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

During various aspects of this process, you should collaborate with coworkers to ensure that your approach meets the needs of each project.

To ensure success as a data engineer, you should demonstrate flexibility, creativity, and the capacity to receive and utilize constructive criticism.

A formidable data engineer will demonstrate unsatiated curiosity and outstanding interpersonal skills. Key accountabilities of the function

Leading Operations for Assigned Systems:

Designing, implementing, and operating assigned cloud technology platforms as the technical expert.

Leading internal and external resources in the appropriate utilization of cloud technology platforms.

Executing ITSM/ITIL processes to ensure ongoing stable operations and alignment with SLAs.

Steering providers in the execution of tier 2 and 3 support tasks and SLAs.

Resolving escalated support issues.

Performing routine maintenance, administering access and security levels.

Driving System Management & Application Monitoring.

Ensuring monitoring and correct operation of the assigned system.

Ensuring changes to the system are made for ongoing run and support.

Ensuring consolidation of emergency activities into regular maintenance.

Analyzing system data (system logs, performance metrics, performance counters) to drive performance improvement.

Supporting Agility & Customer Centricity.

Supporting the end user with highly available systems.

Participating in the support rotation.

Performing other duties as assigned by management Additional skills: special skills / technical ability etc.

Demonstrated experience in vendor and partner management.

Technically competent with various business applications, especially Financial Management systems.

Experience at working both independently and in a team-oriented, collaborative environment is essential.

Must be able to build and maintain strong relationships in the business and Global IT organization.

Ability to elicit cooperation from a wide variety of sources, including central IT, clients, and other departments.

Strong written and oral communication skills.

Strong interpersonal skills.

Apply