Data Engineer

An extraordinarily talented group of individuals work together every day to drive TNS' success, from both professional and personal perspectives. Come join the excellence!

Overview

Transaction Network Services (TNS), a Koch Industries company is seeking a talented and motivated data engineer to work within our AI Labs, India. As a Data Engineer you will initially focus on collecting and analyzing data from our international sources as well as supporting the senior staff of data scientists. You will be designing scalable data architectures to efficiently perform data processing, storage, and analysis. As responsibility increases over time, your role is expected to expand to include managing international data requirements and use within TNS.

Responsibilities

Primary Responsibilities:

Determine operational data objectives by studying international business functions; gathering information; evaluating output requirements and formats.

Design, develop, and maintain robust and scalable data pipelines to efficiently collect, process, and store large volumes of data.

Collaborate with data scientists and analysts to understand data requirements and implement solutions for data transformation, integration, and analysis.

Implement and manage data lakes, data warehouses, and other data storage solutions on the AWS environment.

Collaborate with DevOps and infrastructure teams to automate data pipeline deployments and ensure smooth operations.

Implement MLOps practices for model deployment, monitoring, and version control.

Ensure data security, privacy, and compliance with relevant regulations and best practices.

Single point of contact for both business and technology teams on data requirements.

Perform both business and technical QA of any software developed.

Prepare technical reports by collecting, analyzing, and summarizing information and trends.

Contribute to the greater team effort by accomplishing related results as needed.

Qualifications

Qualifications

Education/Experience:

Advanced degree in computer science, machine learning, statistical methods, or related field.

5 years of industry experience in data engineering or a related role.

Strong experience building and maintaining data pipelines using AWS services such as S3, Redshift, Glue, EMR, or related technologies.

Proficiency in programming languages such as Python, Java, or Scala.

Experience with data modeling, database design, and SQL.

Familiarity with DevOps practices and tools, including CI/CD pipelines and infrastructure-as-code (e.g., Terraform).

Demonstrated ability to work with large data sources with a focus on data privacy and security.

Background in software development process and tools with a focus on Jira.

Experienced in working in a geographically distributed team environment.

Experience working for leadership located in other countries and cultures as well as large time zone shifts.

Communications:

Excellent communication & presentation skills.

Strong teamwork, communication skills, passion, creativity, productivity & learning agility.

Strong written and verbal communications skills working with internationally based colleagues.

Ability to articulate and interpret analytical results from developed programs.

Related Knowledge base:

Familiarity with big data processing frameworks such as Apache Spark or Hadoop.

Knowledge of stream processing frameworks like Apache Kafka or AWS Kinesis.

Experience with containerization technologies like Docker and orchestration tools like Kubernetes.

Understanding of data governance, data cataloging, and metadata management.

If you are passionate about technology, love personal growth and opportunity, come see what TNS is all about!

TNS is an equal opportunity employer. TNS evaluates qualified applicants without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity or expression, protected veteran status, disability/handicap status or any other legally protected characteristic.

R1512