Data Engineer
Resume:
VISHVABEN SHAH
E-Mail: adg0bz@r.postjobfree.com
EXPERIENCE:
Data Engineer at Comcast, West Chester, PA Feb 2019 – June 2020
• Handling development, testing, requirement gathering, feasibility analysis, support and maintenance related activities which included analyzing existing system issues, fixing and debugging application-oriented problems, implementing all the system change requests, maintenance requests, and other regular application & system enhancement activities.
• Collaborate with Data Scientists to find requirements and then source the streaming data using Kafka.
• Working on database tools/client like – Teradata, Oracle (SQL developer), SSMS, MySQL and providing integration services with other RDBMS system. Also, worked with different data format such as JSON, Parquet and AVARO at staging and Integration layer to process structured or unstructured data.
• Collaborate with business, Architecture and other software development team to develop business application in Agile Environment.
• Build scalable data pipelines capable of processing massive amounts of data using AWS platform and AWS EMR and define company data assets, HiveSQL, SQL and spark jobs to populate data models.
• Experience in processing streaming data by creating spark job/ shell scripts on cloud EC2 and ingesting into standalone cluster or EMR, storing processed data into S3 or redshift for reporting or analysis.
• Build upon on the infrastructure required to optimize the extraction, transformation, and loading of data using Python and SQL. Collaborate with business intelligence and analytics teams to optimize Tableau report queries. Data Engineer at Legion Energy, INDIA Jan 2014 – Nov 2016
• Strong experience in Big Data client to server data flow and processing mechanism.
• Monitored and managed various DEV, QA, UAT and PROD environments for production and deployment activities. Identified cross functional dependencies through monitoring and tracking release milestones.
• Used JIRA for change control & ticketing and able to create complex JIRA workflows including project workflows, screen schemes, permission scheme and notification schemes in JIRA.
• Performed structured data analysis on Hadoop databases such as Hive and HBase using various method including SQL (HIVESQL) and Integrating with RDBMS, processing to achieve best cost-benefit for overall system.
• Develop Jobs & maintain on ETL development tools like –Informatica and Achieved hands-on expertise with Informatica PowerCenter by developing data integration using transformation such as Joins, lookup and ETL concept.
• Initiated corrective actions to stay on schedule. Install, upgrade, and test complex big data deployments.
• Strong knowledge of data warehousing concepts, including data warehouse technical architectures, ETL/ ELT and reporting/analytic tools and environments, metadata management and performance tuning.
• Handled storage over cloud (AWS) on S3, performed capacity planning and designing, OS upgrades and hardware refresh.
TECHNICAL SKILLS:
ETL Tools Informatica 8.6/9.1/9.5/10.1
Cloud Technology AWS S3, EC2, EMR, Redshift
Hadoop/Bigdata Hadoop ecosystem, Hadoop 2.0 & 3.X, Hive, HBase, Spark Sub Skills UNIX/Linux, Python, Kafka
Scheduling Tool Control m, Autosys
Databases Oracle10g/9i, SQL Server 2005, 2008, Teradata, MySQL Reporting Tools Tableau, PowerBI, Cognos
EDUCATION:
• California State University-Los Angeles, GPA: 3.57 Jan,2017-Dec,2018 Master of Science: Computer and System Engineering
• Gujarat Technological University, GPA: 3.7 Aug,2011 – May,2015 Bachelors of Engineering: Electronics & Communication STRENGTH:
• I am a person who thrives in fast paced environments, always ready to learn new things, adventures person and always believe in self learning and positive thinking. Strong Analytical and problem-solving skills which motivates me to deep dive in IT.
Contact this candidate