Data Engineer Software

PARTHVI SONI

+1-201-***-**** **************@*****.*** LinkedIn GitHub

OBJECTIVE: Results-driven Data Engineer experienced in building scalable, cloud-native data pipelines and observability solutions. Adept at collaborating across engineering teams to develop secure, efficient systems that drive business impact. Skilled in Python, AWS, SQL, and ELK stack, with a passion for automation and performance optimization.

PROFESSIONAL EXPERIENCE

BI/Data Engineer Barclays NJ, USA Feb 2024 – Present

• Led the design and deployment of end-to-end ELK pipelines (Logstash, Elasticsearch, Kibana) to enhance observability and provide real-time operational visibility into distributed systems.

• Managed and optimized Elasticsearch as a Service (ESaaS) for centralized logging, improving incident response times by 35% and enabling scalable search across microservices.

• Automated log ingestion and parsing from multiple environments, integrating with alerting systems to support SRE- driven SLIs/SLOs and reduce on-call fatigue.

• Partnered with SRE and DevOps teams to define monitoring standards, automate observability workflows using AWS (S3, Lambda, Glue), and drive adoption of best practices across engineering, enhancing system reliability, cross-team debugging, and real-time health reporting at scale. Data Engineer Intern Slalom NJ, USA Jun 2023 – Aug 2023

• Developed Power BI dashboards for Johnson & Johnson's Change Control systems, enhancing decision-making and cutting reporting time by 30%.

• Collaborated with data engineers to migrate data to Azure CDL via Databricks, ensuring data reliability and compliance.

• Automated SQL-based validation pipelines to streamline data quality checks. Software Engineer Phillip Capital India Mar 2022 – Aug 2022

• Engineered algorithmic trading systems in Python and deployed real-time REST APIs for market data delivery.

• Refactored SQL databases to optimize query performance in high-throughput environments. Software Engineer BP Wealth India Apr 2021 – Mar 2022

• Designed ingestion pipelines for financial data using SQL and Power BI, enabling interactive dashboards for trend analysis.

• Implemented automated data parsing and reporting for structured/unstructured sources. Business Analyst Leo9 Studio India Jul 2020 – Jan 2021

• Delivered analytical insights using Excel and SQL to support UI/UX design decisions.

• Facilitated stakeholder interactions and data-driven product improvements. PLATFORMS

• Programming: Python, Flask, Django, Pyspark, ETL, Shell scripting-Bash

• Cloud & Infrastructure: AWS (S3, Lambda, Glue), Azure CDL, Hadoop, Kafka

• Databases: MySQL, SQLite3, Microsoft SQL Server

• Visualization Libraries: Dash, Plotly, Streamlit

• Monitoring: ELK (Elasticsearch, Logstash, Kibana), Grafana

• Technologies: Tableau, Power BI, MS Excel, Databricks, Apache

• Certifications: Databricks Lakehouse Fundamentals, Data Engineer Associate (AWS) PROJECTS

Global Trade BI Dashboard

Performed Python-based EDA and built a MySQL + Tableau dashboard analyzing cross-border commodity flows. College Enquiry Chatbot

Built an IBM Watson-powered chatbot scraping college info using BeautifulSoup and HTML/CSS. News Aggregator Web Interface

Designed a Python-based web app using Scrapy and newspaper3k for real-time RSS feed tracking. EDUCATION

M.S. in IT & Analytics, Rutgers University, USA Sep 2022 - Dec 2023 Analytics for Business Intelligence, Algorithmic Machine Learning, Business Forecasting B.E in Information Technology, University of Mumbai, India Jun 2017 - May 2021 Advanced Database Management (DBMS), Software Project Management, Big Data Analytics EXTRA CURRICULAR ACTIVITIES AND ACHIEVEMENTS

• National finalist, Smart India Hackathon (Data solutions)

• Recognized for excellence in data-driven technical competitions

• Volunteer: Youth leadership and digital literacy initiatives

Contact this candidate