Post Job Free
Sign in

Data Engineer Big

Location:
Ottawa, ON, Canada
Salary:
55K
Posted:
September 13, 2022

Contact this candidate

Resume:

Rajharini Krishnasamy

Big data Engineering

git-Rajharini li-Rajharini *************@*****.*** +1-613-***-**** SUMMARY

Ô Recent Big data solution architecture graduate student bringing statistical ana- lytic expertise and the ability to deal with large and complex sets of data for im- plementing ETL processes and pipelines.Proven ability to increase data extraction efficiency and accuracy, with strong skills in research and programming method- ologies.

PROJECTS

AUTOMATION OF MONTHLY FINANCIAL REPORT SHELL SCRIPT, EASYMORPH Ô Collaborated and worked with SOURCEONE Financial Corp in the Automation of the manual process of Monthly summaries about customer payments, collections, and portfolio performance using Shell Script and ETL tool Easymorph. ETL OF TWEETS THROUGH TWITTER API PYTHON, MONGODB ATLAS, HTML, CSS, JAVASCRIPT

Github repo

Ô Created a web application using python flask framework that performed an end-to-end pipeline to extract tweets based on the given keyword using Twitter API and transformed the tweets for the analysis using python and finally loaded it to MongoDB Atlas.

USED CARS RESALE VALUE ANALYSIS USING SPARK AZURE DATABRICS, APACHE SPARK, HDFS

Github repo

Ô The Cars dataset was taken from Kaggle which was web scraped for more than a year in Czech Republic and Germany from different web pages.The dataset was cleaned and analyzed using Spark Dataframes.The analysis was done to predict and determine the resale value of commercial and personal use cars. AMALGAMATION OF DATABASES T SQL

Github repo

Ô Amalgamated two databases and increased performance efficiency by using Nested Triggers, and Stored Procedures.Performed Error handling of Stored Procedures using an Exceptional Handling routine.

EXPERIENCE

SRI EASWARAR TEXTILE AND EXPORTS JR. DATA ENGINEER Jan 2019 – Dec 2020 Karur, India

Ô Experienced in constructed data pipelines to process structured and semi structured data from multiple different sources.

Ô Automated ETL processes making it easier for wrangling data and increased the efficiency by 40 %.

Ô Translate these database reporting needs into T-SQL queries that extract data and create relevant reports.

Ô Experienced in using Data Integration Platforms such as SSIS for ETL. SKILLS

PROGRAMMING

Proficient:

• Python • R Programming •

T-SQL • Pyspark • C • C++

Experienced:

Java• HTML • css • Java Script

• Shell Script • NodeJS

LIBRARIES/FRAMEWORKS

Apache Hadoop • python

flask• Apache Kafka • Apache

Sqoop • Apache spark • pytest

TOOLS/PLATFORMS

Git • GCP • Microsoft Power BI

• Tableau • Azure Databricks

EDUCATION

CONESTOGA COLLEGE

BIG DATA SOLUTION

ARCHITECTURE GRADUATE

CERTIFICATE

Apr 2022 Waterloo, Canada

GPA: 3.72 / 4.0

GEORGIAN COLLEGE

BIG DATA ANALYTICS GRADUATE

CERTIFICATE

Sep 2021 Barrie, Canada

GPA: 3.33 / 4.0

SRI KRISHNA COLLEGE OF

ENGINEERING AND TECH

NOLOGY

BACHELOR'S IN COMPUTER SCIENCE

Apr 2019 Coimbatore, India

GPA: 3.6 / 4.0

CERTIFICATIONS

MICROSOFT CERTIFICATION: AZURE

FUNDAMENTALS

See badge

SAS PROGRAMMING 1: ESSENTIALS

See badge



Contact this candidate