Post Job Free

Resume

Sign in

Big data Engineer

Location:
Des Plaines, IL
Posted:
May 22, 2023

Contact this candidate

Resume:

Nabin Pandey

adw903@r.postjobfree.com

773-***-****

Professional Summary:

Over 6 Years of experience in analysis, design, implementation and testing of big data technologies ( technical aspects : Java, Python,SQL and data pipelines flow in Hadoop, Spark)

Experienced on Cascading framework for Map/Reduce operation in Hadoop platform and have engaged working in Apache Hive databases as well and extracting data from Snowflake database as well and store in s3 bucket

Experience in working with Redis server for Map/Reduce operation in hadoop for big data processing

Clouding computing knowledge on AWS EMR, EC2 instances, AWS Glue for serverless

Experience in handling query under Redshift as a part of data analysis

Theoretical knowledge on Kafka for data pipelines and Cassandra/Mongo DB as No Sql databases

Strong knowledge in Object Oriented Concepts, Object Oriented Design (OOD), Object Oriented Analysis (OOA), Programming and its implementation.

Expertise in XML, CDA (Clinical document architecture), FHIR ( Fast health interoperability Resources),Json, Parquet, CSV, EDI (Electronic Data Interchange) document file structure

Sound knowledge in frame works as well ; Grails for full stack, Angular js for front, Django for python

Experience in using Java IDE tools like Intellij and familiarity with other IDEs such as Eclipse.

Experience in using MySQL databases to write complex SQL queries, and familiarity with databases like SQL

Experience in using frameworks and tools like J Unit.

Extensive experience in using SQL to write Stored Procedures and Triggers.

Document preparation including Requirement Specification, design documents, Test cases and Analysis, User Training documents and Technical Help documents.

Excellent communication, interpersonal and analytical skills along with can–do attitude.

Ability to learn and use new systems and paradigms in considerably less time.

Experience of development in different environments like Windows,linux, mac OS

Well versed with complete systems life cycle development processes of design, development, testing and implementation.

Good experience in Object Oriented Analysis & Design (OOAD) using different design methodologies/process frameworks like SDLC and tools like Agile

Involved in the architectural design of UI interface with review of specifications and design overviewed as UAT

Involved in profile reporting and predictive analysis as a part of R programming and Machine learning simultaneously

Professional Experience:

Trustmark Health Benefits, Lake Forest, IL

Dec’2022 to Present

Sr. Java Hadoop Developer

Responsibilities:

Established the User Interface to have the user to have the automation transformation rules and used further in big data processing

Developed a java module for layout determination of file as either CSV, Fixedlength, Parquet structure

Research on the AWS server side for optimization of legacy code block

Engaged in AWS EC2 cluster configuration for auto scaling concepts

Write code blocks in advanced Java, Python for manipulation of unstructured data structure like XML, JSON, Excel, EDI

Worked on migration of legacy java code block in automation format in the concept of using MYSQL database architecture

Experience with various MVC Java frameworks like Angular.JS, Grails, etc.

Experience in implementing in setting up standards and processes for Hadoop based application design and implementation.

Theoretical and conceptual knowledge of Cassandra No SQL distributed database system

Developed web pages using HTML/CSS and JavaScript.

Involved in debugging the product using Intellij and JIRA Bug Tracking.

Involved in coding for JUnit Test cases

Provide direction and execution oversight for large Agile Development projects

Designed Use Case Diagrams, Class Diagrams and Sequence Diagrams and Object Diagrams to model the detail design of the application using UML.

Design & Development of the User Interfaces using HTML, CSS and JSP.

Has developed XML Parsing logic to structured format using advanced python

Communicate well in the team to have the verification on the business models are well directed to functional requirements

Mitigate and manage project risks

Work with others to get rid of project impediments

Coordinate with other managers and related personnel from the US office for smooth delivery of projects

Recruit, train, and mentor resources

Environments: ADVANCED JAVA, PYTHON, BIG DATA,AWS, KAFKA, MY SQL, CASSANDRA, HADOOP, SPARK, WEB SERVICES, INTELLIJ, PYCHARM,, GIT, GITHUB, JUNIT, AGILE, UML, JSP, XML,JSON,EDI,ANGULAR, DJANGO, REDSHIFT, SNOWFLAKE,REDIS

.

HealthScope Benefits, Little Rock, AR

Dec’2020 to Dec’2022

Sr. Java Hadoop Developer

Responsibilities:

Developed data engine used in ETL processing of Big data in cope with Hadoop architecture to transform the data structure

Good query knowledge in data analytical tools RedShift, Snowflake

Expertise in the raw data structure that are in CSV, Parquet,XML(CDA), Json(FHIR), Excel, EDI format

Developed the automated python script using SQS, SES services of AWS on EC2 instances to have the jobs simultaneous work flow

Expertise in Advanced Java libraries and frameworks like Cascading that are used in object oriented programming in java

Implemented business logic using python libraries like boto3, iterator,decorators,generators .

Implement statistical analytical algorithm

Design the architecture related to MVC framework in grails

Development of java interfaces for different function calls which is used to migrate the legacy java code block to automation engine

Technology leadership for the direction of the Cloud based application using RedShift, MY SQL Server integrating to a proprietary framework.

Designed and modified User Interfaces using AngularJS, CSS.

Built main application in Python, Django leveraging technologies as internal User Interface

Integrated Rest API services

Responsible for the implementation of Web Design based on CSS3, HTML5, and Bootstrap Front-End Framework.

Wrote Java programs, performed builds, monitored DB2 data and ran SQLs query

Designed & implemented client/server application to plan package forwarding & route scheduling. Used JDBC for database connectivity.

Built a REST API to provide the external end point services to work with dependent projects

JUnit testing of Java classes to test the transformation logics in sample data size

Used Intellij IDE for designing, coding and developing applications

Developed test cases and performed unit testing using JUnit.

Extensive experience in developing applications using Java and related technologies using WATERFALL and AGILE SCRUM methodologies.

Involved in detail design developing use cases, use case diagrams, class diagrams, sequence diagrams and high level activity diagrams using UML from the requirements.

Developed Use Cases, Sequence and Class Diagrams using Rational Rose.

Developed user interface application using grails framework

Created Maven build file to build the project related to data engine

Was responsible for Developing XML file document to CSV one using advanced python libraries

Configured Server for My SQL Database and Apache Tomcat

Work with DevOps team to have transition in test environment(UAT) before push to production

Environments: ADVANCED JAVA, PYTHON, AWS EC2, AWS GLUE, HADOOP, SPARK, CSS, HTML5, JDBC, MONGODB, HIVE, WEB SERVICES, INTELLIJ,JUNIT, AGILE, UML, CLASS DIAGRAM, JSP, MAVEN,GRADLE, XML, APACHE TOMCAT, LINUX, MAC OS, ANGULAR

Cedargate Services, Nepal

Dec’2018 to Dec’2020

Java Big Data Developer

Responsibilities:

Implementing the data transformation business logics in Java Mapping level using OOPs and DSA concepts

Make automated Python Script to write the Java manual code blocks to reduce the developer time for coding

Good query knowledge in data analytical tools Redshift

Migrate the Java code blocks in SQL concepts and build comparison module to check the result variance

Build Python parser to insert the excel based document into MYSQL databases

Expertise in Advanced Java libraries and frameworks like Cascading that are used in object oriented programming in Java

Implemented business logic using python libraries like boto3, iterator, decorators, generators .

Implement statistical analytical algorithm

Technology leadership for the direction of the Cloud based application using Redshift, MY SQL Server integrating to a proprietary framework.

Built main application in Python, Django leveraging technologies as internal User Interface

Integrated Rest API services

Responsible for the implementation of Web Design based on CSS3, HTML5, and Bootstrap Front-End Framework.

Designed & implemented client/server application to plan package forwarding & route scheduling. Used JDBC for database connectivity.

Built a REST API to provide the external end point services to work with dependent projects

JUnit testing of Java classes to test the transformation logics in sample data size

Used Intellij IDE for designing, coding and developing applications

Developed test cases and performed unit testing using JUnit.

Extensive experience in developing applications using Java and related technologies using WATERFALL and AGILE SCRUM methodologies.

Created Maven build file to build the project related to data engine

Work with DevOps team to have transition in test environment(UAT) before push to production

Environments: ADVANCED JAVA, PYTHON, AWS EC2, HADOOP,MYSQL, CSS, HTML5, JDBC, MONGODB, HIVE, WEB SERVICES, INTELLIJ,JUNIT, AGILE, UML, CLASS DIAGRAM, JSP, MAVEN,GRADLE, LINUX, MAC OS

GfiveTech, Nepal

Nov 2017-Nov 2018

Web Developer

Gfive Tech is an IT Solutions to provide the services on web applications and other training to the Students as well. They gives services designing web outlet and hosted the applications as well

Responsibilities:

Designing the front end using the word press template

Engage in web application designing

Involved in detail design developing use cases, use case diagrams, class diagrams, sequence diagrams and high level activity diagrams using UML from the requirements.

HTML/CSS on web page designing

JUnit testing of Java classes to test the transformation logics in sample data size

Used Intellij IDE for designing, coding and developing applications

Developed test cases and performed unit testing using Junit

PhpMyAdmin for table design and SQL knowledge

Java Server Pages integration as well in web designing

Model view controller (MVC) conceptual designing in web applications

Environments: MYSQL, CSS, HTML5, JDBC, WEB SERVICES, INTELLIJ,JUNIT, AGILE, UML, CLASS DIAGRAM, JSP, LINUX,MVC

Education:

Bachelors in Computer Engineering, Tribhuvan University, Nepal



Contact this candidate