Data Engineer Machine Learning

Abhinav Priyadarshi

LinkedIn: https://www.linkedin.com/in/cyberxalpha1234/ Contact No.: +44-077******** GitHub: github.com/abhiwer Mail id: **********************@*****.*** Experience

Data Engineer Jul 2022 to Present

British Telecom PLC, Birmingham

● Created and managed data pipelines and batch and streaming jobs. Built and scaled microservices applications.

● Scheduled and ran DAGs using Cloud Composer and Airflow.

● Developed Dataflow Templates in Apache Beam and Python.

● Provisioned cloud resources using Terraform.

● Implemented unit and integration tests for dataflow Python code.

● Modelled data and wrote stored procedures in Google Big Query.

● Accelerated Dataflow pipelines using Docker images.

● Improved development speed and CI/CD bottlenecks with CI branch tagging.

● Developed complex data pipelines to handle Kafka and Tokenisation.

● Developed and managed Data Warehouse (Big Query) and applied access controls and applied best practices and techniques to improve it. Keys Achievements

● Consistently delivered projects ahead of schedule, including one that will save the company millions.

● Participated in pair programming and code reviews, and refactored legacy code.

● Helped team members with CI/CD and GCP.

Tech Stacks/Tools Used: Python3, Apache Beam, Apache Kafka, Big Query, Google Cloud Storage, Cloud Functions, Cloud Composer, Apache Airflow, Data Flow, Terraform, Gitlab, Unit Testing, Docker, git, VS code. Python Developer Oct 2020 to Jul 2021

iSmile Technologies Chicago, IL, USA (Remote)

● Worked in Virtual Assistant: Covid Analyser Team, as a Machine Learning Engineer to design Facial Recognition System and Fatigue Detection System.

● Created script to convert videos to photos and later trained it using Machine Learning and Deep Learning algorithms to get better results and accuracies using 100 GB of Dataset.

● Provided consultation on the use of computer vision for Food Allergies Application and helped in designing technical flow diagram.

● Detected anomalies in sewer pipe using sewage robot with accuracy up to 95%. With the model trained using YOLO V3 and later on V5.

● Performed Stock Market Analysis (NASDAQ) to analyse Index funds and FAANG stocks for Options and Futures.

● Cloud Migration: Automated client's Local Oracle Database to GCP for uploading changes in weekly and monthly fashion with a script run. Tech Stacks/Tools Used: Languages {Python3, C++11/14}, Framework {Flask, Django}, Machine Learning {SVM, RCNN, Random Forest}, Deep Learning & Computer Vision {Darknet, YOLO V3, V5, Custom Vision, OpenCV, TensorFlow, Keras}, Operating System {Raspberry Pi OS, Ubuntu}, IDE {VS Code, BASH, Google Colab}, Cloud {GCP, Azure}, Video Streamers {FFmpeg, OBS Studio, Azure Media Services}. Key Achievements

● Led global development teams, embraced Start-up and Agile environments, grasped the significance of version control and DevOps (Azure DevOps), orchestrated end-to-end application development, and tackled diverse tasks spanning data science, robotics, and cloud domains. Certifications and Learnings

Associate Cloud Engineer (Google Cloud)

Professional Data Engineer (Google Cloud)

Professional Cloud Architect (In Progress)

Data Structures and Algorithms (LeetCode 300+ Solved) Technical Skills

● Programming Languages: Python3, C++, C#.

● Databases: MySQL, SQLite, SQL Alchemy, PostgreSQL.

● Cloud: GCP (Google Cloud), Azure, AWS (Amazon Web Services).

● Big Data/Data Engineering: Batch Data Pipelines, Apache Beam, Google Big Query, Data Flow, Apache Airflow, Cloud Composer, Cloud Functions, Data Modelling, SQL Routines.

● Data Science and Machine Learning Libraries: Pandas, NumPy, SciPy, Matplotlib, Seaborn, Keras, OpenCV, TensorFlow, Yolo V3/V5, Darknet, LSTM.

● Python Testing: Pytest, Unit test, Postman.

● Web Technologies: Flask, Rest API, HTML, CSS, JSON, YAML, JavaScript.

● DevOps (CI/CD) and Version Control: Git, Gitlab CI/CD, Terraform, Docker Addition Skills

● Leadership, Risk Management, Project Planning, Adaptability, Agile. Education

Nottingham Trent University – Nottingham Jan 2020 to Jan 2022 MSc Engineering (Electronics Engineering)

Relevant Coursework: Software Engineering (C#), Embedded Systems, Major Project. Chandigarh Engineering College - Mohali, India Jul 2014 to Jun 2018 B. Tech (Electronics & Communication Engineering)

Relevant Coursework: Operating Systems, Object Oriented Programming, Computer Networks, Data Structures & Algorithms Projects

Stock Realtime Data Visualisation: Python3, Pandas, Flask, JavaScript, HTML/CSS Water Tap Detection: Python3, Yolo V3, Darknet

Contact this candidate