Data Engineer Software

Jairam Marndi

+1-716-***-**** ************@*****.*** https://www.linkedin.com/in/jairam-marndi/

Software Engineer with 7 Years of Experience in Python, Cloud Computing, and Scalable Data Solutions TECHNICAL SKILLS

Programming Languages: Python, Core Java, R, SQL, C++, SQLite, Teradata, HQL, Scala Databases and Data Handling: PostgreSQL, MySQL, Oracle, SQLite, Pandas ETL Tools: Talend Big Data, Talend 7.3, Talend 7.2, Talend Open Studio Data Visualization Tools: Tableau

Frameworks and Platforms: Hadoop (HDFS, Hive, Impala, HBase, Apache Pig), Snowflake, Apache Spark Cloud Platforms: AWS (Glue, S3, RDS, Lambda), Azure (Databricks) PROFESSIONAL EXPERIENCE

Data Engineer Lead, LTIMindtree Jun 2022 - Jan 2023

• Developed and optimized over 150 Python-based data processing scripts, leveraging SQL, Talend, AWS Glue, and AWS Lambda to improve the efficiency of 1M+ daily banking transactions by 40%.

• Designed and implemented complex SQL queries in Amazon Redshift and AWS RDS, optimizing query execution with efficient indexing and partitioning strategies, ensuring high-performance data retrieval and transformation for large-scale analytics.

• Enhanced Python-based data processing workflows by integrating AWS EMR for distributed computing, implementing dynamic partitioning, real-time validation mechanisms, and parallel processing techniques, leading to a 30% performance improvement.

• Led an Agile development team, defining sprint goals, backlog prioritization, and CI/CD pipeline integration, gathering detailed client requirements, and ensuring on-time project delivery with enhanced collaboration and productivity. Senior Data Analyst, Accenture Dec 2021 - Jun 2022

• Optimized Python-based data processing workflows with Talend and Snowflake, improving system efficiency by 20% and enabling the seamless transfer of 500,000+ raw material and invoice records from CSV, Oracle DB, and flat files into Snowflake.

• Designed and implemented a high-performance data model in Snowflake for a bank’s customer onboarding application, incorporating efficient indexing, partitioning, and caching strategies, leading to a 25% improvement in query execution speed.

• Developed and automated CI/CD pipelines for Snowflake and Python-based data applications, implementing automated testing, version control, and deployment strategies, resulting in a 30% improvement in data processing efficiency. Senior Data Engineer, IRIS Business Services Limited Nov 2020 - Dec 2021

• Developed data pipelines for migrating over 1M banking data from JSON taxonomy files to Big Data for the Reserve Bank of India, significantly enhancing data warehousing capabilities and generating a profit of 8.5 million USD.

• Optimized workflow efficiency by 60% by scheduling and managing Talend jobs within a data warehousing environment, reducing manual efforts and streamlining data processing operations.

• Resolved a 1-hour processing delay in a data warehousing job involving 20 tables and 10,000 entries through root cause analysis, reducing turnaround time to four minutes.

• Enhanced data extraction by 40% by addressing complexity in HiveQL, improving data warehousing processes for more efficient handling of intricate tables.

Senior Data Engineer, Infosys Limited Jun 2016 - Nov 2020

• Designed and automated SQL procedures for generating Tableau dashboards, incorporating data from 20+ tables, which reduced manual extraction and analysis efforts by 25%.

• Collaborated with clients to gather report specifications for Tableau dashboards, enhancing communication and responsiveness, which led to a 40% decrease in development duration.

• Implemented data validation checks for schema, data type, and format validation on JSON files before integrating with Tableau, achieving a 98% accuracy rate in data transfer and minimizing errors. PROJECTS

• Interactive dashboard for soccer clubs (2023): Created an interactive, real-time Tableau dashboard analyzing soccer player data across divisions and countries, aiding clubs in evaluating current team performance and identifying potential acquisition from a dataset of over 1 million entries.

• Relational database design (2023): Designed and implemented a robust SQLite-based DBMS for a manufacturing and supply chain company, overseeing various data domains, ensuring data security and real-time access. EDUCATION

Master of Science, Data science, University at Buffalo, The State University of New York 2023-2024

• Machine learning, Supervised learning, Unsupervised learning, Probability, Database Management System Bachelor of Technology, Electronics & Communications Engineering-Silicon Institute of Technology, BPUT 2012-2016

Contact this candidate