Post Job Free
Sign in

Data engineer

Location:
Columbus, OH
Posted:
April 30, 2025

Contact this candidate

Resume:

Chandra Sekhar Challa

Cloud Data Engineer

+1-614-***-**** *****@*****.***

linkedin.com/in/challa-chandra-sekhar

Professional Summary:

IT Professional with 10 years of experience, including 5 years as a Data Engineer specializing in Python, Apache Spark (PySpark), and Snowflake, and 5 years in Java, microservices, and cloud migration.

Proficient in designing and implementing scalable data pipelines using AWS Glue, EMR, S3, and Redshift.

Extensive experience in big data processing, leveraging Apache Spark with PySpark for distributed data processing and analytics.

Hands-on expertise with Snowflake Data Warehouse, including data modeling, query optimization, and performance tuning for large-scale data operations.

Skilled in developing ETL/ELT pipelines for data ingestion and transformation using Apache Airflow for orchestration and creating custom operators.

Proficient in implementing CI/CD pipelines using Jenkins and GitHub Actions to automate build, deployment, and testing processes.

Proficient in data modeling (Star and Snowflake schemas), SCD techniques, and data warehousing concepts.

Adept at working with diverse data sources and file formats such as Avro, Parquet, ORC, JSON, and XML, optimizing data pipelines through partitions and bucketing.

Proven ability to create AI-driven solutions using LangChain and LLMs, enabling intelligent, autonomous systems that enhance operational efficiency.

Collaborated with cross-functional teams to deliver insights-driven solutions, improving data accessibility and business decision-making.

Hands-on experience with proactive data governance measures, including role-based access controls, encryption protocols, and data quality assurance.

Skilled in infrastructure provisioning and version control using Terraform and Git.

Expertise in building frameworks to generate ad hoc reports and improve enterprise-wide data accessibility.

Known for delivering scalable, high-performance solutions that streamline analytics workflows and drive business success.

Technical Skills:

Languages: Python, SQL, Java, DataBases:, MySQL,Postgres Data Processing Framework: Spark, Hive Storage Systems: S3, HDFS Orchestration Tools: Airflow DataWarehouse: Snowflake Repository Management: Bitbucket, GitHub CI/CD: Jenkins, GitHub actions AI/ML Frameworks: LangChain,OpenAI API Web Frameworks & Tools: FastAPI,RESTful APIs Cloud Technologies: AWS,Azure Project Management: Jira Work Experience

CGI INC. October2024 – March 2025

AI/Python Engineer: The Cigna Group

Developed and deployed a Master Agentic AI to streamline the healthcare and insurance processes, handling claims, benefits, and dental services for users.

Designed and implemented the architecture where a master agent processes prompt inputs from a chatbot and intelligently routes the queries to specialized child agents based on task requirements (claims, benefits, dental, etc.).

Integrated Natural Language Processing (NLP) capabilities in the master agent to understand and categorize user queries, ensuring efficient routing to the appropriate child agent.

Child agents leverage large language models (LLM) via endpoints to perform domain-specific tasks such as claims adjudication, benefits verification, and dental coverage inquiries, ensuring accurate responses tailored to the user's needs.

Built a scalable and modular system to allow child agents to be independently updated or expanded as new healthcare policies, insurance packages, and dental plans are introduced.

Utilized LangChain framework to facilitate smooth orchestration between the master agent, child agents, and external data sources, improving the adaptability and context awareness of the system.

Worked with cross-functional teams, including product managers and healthcare domain experts, to ensure that the AI system adhered to relevant regulations and provided accurate, ethical responses in sensitive healthcare scenarios. Accenture Solutions Pvt. Limited January2023 – May 2024 Data Engineer: Telefonica

Engineered robust, scalable data pipelines utilizing PySpark to seamlessly integrate diverse datasets into a Snowflake data warehouse, enhancing processing efficiency and significantly reducing latency.

Collaborated closely with data analysts and business stakeholders to extract requirements and deliver tailored solutions, leveraging my technical acumen to translate complex data into actionable insights.

Executed data transformations with PySpark, applying advanced optimization techniques to ensure high-performance outcomes that align with business objectives and maintain data integrity.

Developed and implemented innovative workflows using AWS Glue for ETL processes focused on data cleansing and ingestion, while leveraging Apache Airflow to automate data management tasks, enhancing operational efficiency.

Leveraged AWS Athena for querying and analyzing data stored in S3, enabling efficient and cost-effective data exploration.

Utilized Snowflake as a data warehouse to support data management and analytics initiatives.

Engaged actively in Sprint feature planning within Agile methodologies, partnering with business Key Achievements:

Streamlined data ingestion workflows, achieving a 25% reduction in operational bottlenecks and enabling real-time insights crucial for business strategy development.

Contributed to a 40% reduction in AWS Glue processing costs through strategic optimization of ETL pipelines and efficient resource allocation.

Enhanced data integrity and reliability by implementing robust transformation frameworks in PySpark, which increased overall analytics accuracy by 15%.

Boosted collaboration efficiency within Agile sprints by improving feature planning, fostering stronger alignment between technical solutions and business requirements. Accenture Solutions Pvt. Limited. April 2020 – December 2022 Data Engineer: BMW AG

Architected and executed scalable data pipelines for ETL processes using PySpark and AWS Glue, integrating data from diverse sources with various file formats, resulting in improved data processing efficiency and reduced latency.

Collaborate with data analysts and business stakeholders to gather requirements and deliver solutions within specified timelines, leveraging technical expertise to drive team efforts and provide actionable insights.

Perform Transformations using Spark with Python (PySpark) as per the business requirement using optimizations and performance tuning techniques.

Designed and implemented new workflows for scheduling and orchestrating the ETL process using Apache Airflow and AWS Glue.

Participated in Sprint feature planning within Agile methodology frameworks, working closely with business analysts and scrum masters to ensure alignment of technical deliverables with business objectives. Key Achievements:

Optimized BMW’s data processing capabilities, leading to a 40% cost savings in cloud resource utilization across ETL operations.

Enhanced data reliability and accuracy, ensuring error-free transformations that increased the confidence in analytics- driven decision-making by 15%.

Implemented automation for repetitive data tasks, reducing manual effort by 50% and enabling the team to focus on strategic initiatives.

Accenture Solutions Pvt. Limited. April 2018 – March 2020 Application Developer: BMW AG

Controlled the migration of Quarkus-based and other Java applications from on-premises environments to Azure cloud, achieving a 40% improvement in scalability and reducing infrastructure costs by 25%.Orchestrated the implementation of OIDC configuration for applications, enhancing machine-to-machine authentication and bolstering security by 30%.

Crafted new Jenkins pipelines for CI/CD processes, reducing deployment time by 35% and ensuring consistent application delivery.

Leveraged a variety of CI/CD tools—GitHub Actions, Azure DevOps, Argo CD, and Jenkins—to tailor implementations based on business requirements, increasing operational efficiency by 20%.

Directed the migration of applications from GlassFish 4 to GlassFish 5 Payara servers, ensuring a seamless transition and achieving a 100% uptime during the migration phase. Key Achievements:

Optimized cloud migration processes, leading to a 50% reduction in system downtime and significantly enhancing application availability.

Boosted authentication security and compliance, ensuring all applications met industry standards and reduced vulnerabilities by 25%.

Streamlined CI/CD workflows across multiple tools, providing enhanced flexibility and reducing manual intervention by 40%.

Accenture Solutions Pvt. Limited. April 2015 – March 2018 Application Developer: Merck KGaA AG

Coordinated with the onshore team and stakeholders to gather and analyze requirements, improving alignment and reducing requirement discrepancies by 20%.

Oversaw application health check-ups and periodic restarts, ensuring a 99.9% uptime and bolstering system reliability.

Orchestrated migration from Content Server 7.2 to 16.2

Contributed to development for change requests and problem ticket fixes, achieving a resolution efficiency rate of 95% and minimizing issue turnaround time.

Handling weekly meetings with client regarding ongoing issues, if any and further enhancements. Key Achievements:

Achieved a 25% improvement in system performance post-migration, enabling better scalability and efficiency.

Streamlined issue resolution workflows, cutting average response time by 40% and improving overall productivity.

Implemented proactive monitoring strategies during health checks, reducing system anomalies by 15%. Education

Bharat Institute of Engineering&Technology, JNTU Hyderabad Sep 2010 – April 2014 Bachelor of Technology in Computer Science Engineering.



Contact this candidate