Data Engineering Analytics

SRIKANTHAREDDY THUMMALA

Edison, NJ ***** • 248-***-**** • ******************@*****.***

SUMMARY

• Over 13 years of experience in software design, development, and management.

• 7+ years of expertise in data engineering, designing and deploying scalable data solutions.

• Proficient in ETL processes and tools with extensive data pipeline management skills.

• 5+ years of professional experience using AWS services like S3, RDS, Lambda, and Glue.

• 3+ years of hands-on expertise with Databricks, including Delta Lake, Unity Catalog, and PySpark.

• Skilled in data analytics, AI-driven data annotation, and data governance implementation.

• Experienced in data warehousing and modeling using MS SQL, Redshift, and more.

• Strong programming background in Python and C#.NET, alongside big data technologies.

• Advanced knowledge of serverless computing and real-time data processing.

• Adept in cloud services, monitoring solutions, and network architecture on AWS and Azure.

• Proven ability to lead teams, deliver projects efficiently, and communicate technical solutions.

• Dedicated to staying ahead of evolving technologies in the data engineering space. EDUCATION

Stratford University, Falls Church, VA Apr 2009 Master of Science in Software Engineering Osmania University, Hyderabad, Telangana, India May 2005 Master of Science in Mathematics with Computer Science

CERTIFICATIONS

• Cribl Certified User (2024–2026)

• Microsoft Certified Technology Specialist (Expired) TECHNICAL SKILLS

Category Technologies

Programming Languages Python, C#.NET, SQL, PL/SQL, PySpark Hadoop Ecosystem HDFS, MapReduce, Hive, Sqoop, Oozie Databases Redshift, MS-SQL, MongoDB, Oracle, MS Access, MySQL ETL Tools AWS Glue, Lambda, Sqoop

Visualization Tools Power BI, Databricks

Collaborative Tools SharePoint, Confluence

Cloud Platforms AWS (S3, Lambda, RDS), Azure Sentinel Version Control Git, SVN, Bitbucket

PROFESSIONAL EXPERIENCE

Client: Merck Pharmaceuticals, Rahway, NJ

Role: AWS Data Engineer Tenure: August 2022 – Current Key Responsibilities:

• Developed and streamlined Databricks notebooks to curate data for diverse business use cases, mounting S3 on Databricks hosted on AWS.

• Implemented Databricks Unity Catalog for centralized data governance, enhancing security and compliance across organizational units.

• Designed Delta Lake solutions using Databricks Notebooks and PySpark for optimized data handling.

• Built SQL tables integrated with AI generative functions for automated column descriptions.

• Designed and implemented scalable data pipelines leveraging AWS services such as S3, Glue, and Lambda.

• Collaborated with data scientists and stakeholders to understand and deliver tailored data solutions.

• Created data models and warehousing solutions using AWS services like Redshift.

• Developed and maintained robust ETL workflows utilizing AWS Glue.

• Engineered data processing solutions with AWS Lambda for efficient data handling.

• Established security measures using AWS IAM and S3 bucket policies to safeguard data access.

• Managed data replication and synchronization processes for RDS and DynamoDB.

• Architected backup and archiving solutions using AWS S3 for long-term storage needs.

• Created data visualization solutions using AWS Quick Sight and third-party tools such as Power BI.

• Implemented real-time data processing pipelines via AWS Lambda.

• Optimized database performance and ETL processes using Lambda functions.

• Forecasted and analyzed future events using Python libraries for log file analysis.

• Applied Big Data modeling techniques with Python for advanced analytics.

• Developed ETL pipelines for efficient data ingestion and extraction from warehouses using Python and SQL.

Environment: SQL Server, Redshift, DynamoDB, AWS S3, Lambda, Glue, Python, PySpark, Databricks, SSIS, Delta Lake, CloudWatch, Event Bridge, Step Function, Jira, Agile, GitHub Client: Citigroup Technologies Inc., New York, NY

Role: Data Engineer - Information Security Operations Senior Manager Employment Type: Full-Time

Tenure: November 2014 – July 2022

Overview: Senior Management role focused on leading teams and initiatives to prevent, monitor, and respond to data breaches and cyber-attacks. Ensured the execution of Information Security activities in compliance with Citi's data security policy.

Key Responsibilities:

• Directed a team of visualization experts for Citi's Fusion Center, leveraging Big Data analytics and dashboards to address cybersecurity challenges.

• Designed and maintained ETL processes using Python, Sqoop, and Oozie, staging data from Hadoop Hive tables to SQL for executive dashboards.

• Supervised staff by prioritizing workloads and evaluating performance.

• Developed detailed project schedules and managed team collaboration through work breakdown structures.

• Presented system requirements and updates to development teams and stakeholders.

• Extracted internal data using API calls, stored it in AWS S3, and transferred it to AWS Redshift.

• Automated data transfers with AWS Lambda functions written in Python.

• Built data models on Redshift to provide analysts with datasets for reporting purposes.

• Established secure connections to Redshift for dashboards in Power BI and Fusion Center applications.

• Managed workgroup meetings, including preparing agendas, minutes, and action plans.

• Delivered project metric reports and status updates for senior management.

• Maintained software products such as Power BI, SharePoint, and Confluence, along with dashboard tools.

• Designed technical solutions and automated capabilities for timely and efficient data visualization.

• Implemented centralized data storage repositories for intelligence data querying and mining.

• Developed scripts to process and customize multiple data feeds.

• Contributed to the development of a data lake integrating transactional, referential, and enrichment data using Hadoop for analytics and investigations.

• Created staging databases and employed visualization tools for generating reports on CSFC dashboards.

• Evaluated and optimized cloud platforms such as AWS and Azure for cost-efficient and secure data solutions.

Environment: MS SQL, C#.NET, Python, Hadoop, MapReduce, Hive, Cloudera, Sqoop, AWS Redshift, S3, Lambda, Power BI, HTML, JavaScript

Client: Citigroup Technologies Inc., New York, NY

Role: Data Engineer - Technology Specialist for Cyber Security Fusion Center (CSFC) Tenure: September 2010 – October 2014

Key Responsibilities:

• Developed and implemented Archer solutions to migrate Cyber Intelligence Center (CIC) applications seamlessly.

• Built Proof of Concepts (POCs) in Archer to facilitate the migration of the Cyber Security Incident Management (CSIM) application.

• Planned and executed large-scale data migration from SharePoint lists/libraries to SQL Server databases and Hadoop systems.

• Designed, developed, and managed the Cyber Crisis Management Portal (C2MP) project to provide situational awareness for senior leadership during cyber crises.

• Utilized C# scripts to transfer data from Archer to SQL database staging and subsequently to web servers in JSON-readable formats for dashboards.

• Oversaw maintenance and support of the CIC SharePoint portal.

• Automated data parsing and storage into the CIC database using efficient scripts.

• Designed custom workflows for implementing Threat Intelligence alerting mechanisms.

• Delivered automated Threat Intelligence daily summaries to subscribed users.

• Led CIC portal migration from MOSS 2007 to SharePoint 2010, ensuring minimal downtime.

• Enhanced and maintained confidential data on the CIC SharePoint site.

• Implemented user interfaces to upload bulk data into SharePoint using Excel Services.

• Maintained user entitlement levels on the CIC portal, ensuring role-based access control as per business assignments.

• Designed and implemented automated metrics tools for generating analytical charts and graphs for CIC.

• Developed subscription interfaces using InfoPath forms, published to SharePoint CIC portals.

• Built automated notification systems to alert subscribed users of modifications or deletions to confidential data.

• Analyzed and selected software tools aligned with CIC business needs.

• Managed CIC threat landscape reports, third-party intelligence reports, and biweekly awareness summaries addressing emerging security trends relevant to Citi. Environment: MS SQL, MS Access, SharePoint, VB, C#.NET, Python, Archer, Power BI, HTML, JavaScript Innovative Intelligent Solutions, LLC - Contractor Client: Peace Health Hospitals, Eugene, Oregon

Role: SharePoint Developer

Tenure: August 2009 – August 2010

Key Responsibilities:

• Resolved design challenges and implemented aesthetically appealing solutions using innovative methods.

• Designed and deployed dynamic content and web-server applications following industry’s best practices.

• Defined database controls and optimized performance for improved efficiency.

• Collaborated with technical and non-technical teams at various levels to ensure successful project delivery.

• Provided functional and technical guidance throughout project brainstorming, design, and completion stages.

• Delivered analytical support and technical advice during conceptualization, development, and implementation phases.

• Developed components leveraging the SharePoint Framework and integrated third-party solutions effectively.

Environment: SharePoint, MS SQL, MS Access, MS Excel

Contact this candidate