Engineer Data

Professional Experience

Arbisoft

January **** - Present

SOFTWARE ENGINEER / DATA ENGINEER

IDEA PLATFORM LOMBARD ODIER

April 2019 - PRESENT

IDEA (Integrated Dashboard of Everything Analyzable) is a proprietary data science and investment research platform to help synthesize insights from alternate, fundamental, and market pricing data in an easy to navigate visual interface for use by investment professionals. The platform is underpinned by a slew of predictive algorithms, error detection protocols, and multi-faceted ETL processes that streamline and combine disparate internal and external data sources within a single data warehouse.

● Build and Manage infrastructure for optimal ETL pipelines.

● Create and contribute to big data ingestion strategies for different types of data from various sources using SQL and AWS big data technologies.

● Responsible for creating and managing Data Predictors and Analytical Models(Algorithms) to forecast and present data for better analysis.

● Responsible for identifying the bottlenecks in the current processes, designing and implementing the process improvements, redesigning the infrastructure, and optimizing queries for greater scalability.

● Create Data Scraper to scrape data from different sites and build the pipeline to clean and store output to AWS Object Storage.

Tool & Technology: Python, Pandas, Postgres, SQLAlchemy, Scrapy, Apache Airflow, Docker, Jenkins, AWS Services (EC2, S3, RDS, Redshift, Athena) SPIDER HOSPITAL SPIDER

January 2018 - April 2019

A Retail Market Intelligence Platform that helps retailers make better decisions over product, assortment, pricing, and promotion through AI-driven market data, analytics and research.

● Worked as Full Stack Developer on Web App built using Django and React.

● Provided the data-driven solution in Scrapy by writing pipelines, middlewares and crawlers.

Tool & Technology: Python, Scrapy, Django, ReactJs, Postgres, Vagrant, Ansible Artificial Intelligence & Multidisciplinary Research Lab July 2016 – June 2017

Intern

● Developed the web back-end (ASP.NET MVC)

● Integrated the front-end to the application (HTML5, CSS, JQuery, Bootstrap)

● Deployed and Managed open source repository manager Gitlab. Husnain Aslam (92-314-*******

****************@*****.***

Linked In Github

Punjab University College of Information Technology February 2017 - June 2017

Teaching Assistant

Artificial Intelligence and Object-Oriented programming course

● Supervise students in the lab.

● Prepare and Mark assignments and Quiz.

● Assist students individually or in small groups in order to help them master assignments and to reinforce learning concepts presented by teachers. Tool and Technology

Sufficient Knowledge:

Hands-On Experience:

Academic Qualification

Certification & Nanodegree

Data Engineering Nanodegree - Udacity

2020

Neural Networks and Deep Learning by deeplearning.ai - Coursera 2018

● Python ● C ● C++ ● Postgres

● SQLAlchemy ● Scrapy ● Django ● ReactJs

● Apache Airflow ● Docker ● Jenkins ● AWS Redshift

● AWS EC2 ● AWS S3 ● AWS RDS ● Numpy

● Scikit ● Pandas ● Git

● Apache Spark ● PySpark ● Cassandra ● Matplotlib

● Scipy ● Ansible ● Vagrant ● AWS Athena

2015 - 2017 M.Sc. Computer Science

Punjab University College of InformationTechnology(PUCIT), Lahore 2013 - 2015 B.Sc. (Calculus, Mechanics, Mathematical methods, Vector, Physics) Punjab University, Lahore

Contact this candidate