Post Job Free

Resume

Sign in

Python Developer Data Analytics

Location:
Clinton, MA
Posted:
February 17, 2024

Contact this candidate

Resume:

Bala Surya ( Citizen)

Sr. Python Developer

Email: ad3o1w@r.postjobfree.com

Phone: 617-***-****

LinkedIn: linkedin.com/in/krishanthan-balasuriya-623378291

Professional Summary:

7+ years of experience as a Python Developer in the IT Industry with proficiency in the Design and development of Python, Java/J2EE, Django, and Flask projects.

Experience in writing Sub Queries, Stored Procedures, Triggers, Cursors, and Functions on MySQL and PostgreSQL databases.

Having experience in Agile Methodologies, Scrum stories, and sprints experience in a Python-based environment, along with data analytics, data wrangling, and Excel data extracts.

Cleaned data and processed third-party spending data into maneuverable deliverables within specific formats with Excel macros and Python libraries.

Implemented PySpark using Python and utilizing data frames and temporary table SQL for faster processing of data.

Designed Cloud Infrastructure as a Service environment using open source technology OpenStack to enable portability of cloud services across hybrid cloud environments

Experience in Developing Web Services (SOAP, RESTful) in Python using XML, and JSON.

Experience using React.js in web development for creating interactive and dynamic front-end applications.

Experienced in MVW frameworks like Django, JavaScript, and jQuery.

Experience in developing web applications by following Model View Control (MVC) Architecture using server-side application Django.

Proficient in working with Databricks to process big data and run analytics pipelines efficiently.

Experienced in utilizing Delta Lake to manage large-scale data lakes with reliability and performance.

Experience in Testing and deploying in to large environments using Jenkins.

Skilled in implementing data streaming and batch processing using Databricks and Delta Lake technologies.

Experience in Data migration from Hadoop to Idp.

Familiar with optimizing data workflows and ensuring data quality and consistency in Databricks environment. Experience with Delta Lake for managing large-scale data lakes efficiently

Used Agile processes to define, test, analyze, profile, and procure data on a Cloudera Hadoop-based consolidated platform to support re-engineered CECL, IFRS9, and CCAR expected credit loss forecasting models

Scaling up projects using python tools like multithreading, celery.

Hands-on experience in Managing, developing, and designing a dashboard control panel for customers and Administrators using Django, HTML, CSS, JavaScript, Bootstrap, jQuery, JSON, and REST API.

Experience in core Java technology which includes Multithreading, JDBC, RMI, and network programming.

Experience in using Python libraries like Beautiful Soup, NumPy, SciPy, matplotlib, NetworkX, MySQL db for database connectivity, and IDEs like Sublime Text, Spyder, and PyCharm.

Experience in working with Python ORM Libraries including Django ORM, and SQL Alchemy.

Experienced in working with various Python IDEs using PyCharm, PyScripter, Spyder, PyStudio and PyDev.

Hands-on experience working in WAMP (Windows, Apache, MYSQL, and Python/PHP) and LAMP (Linux, Apache, My SQL, and Python/PHP) Architecture.

Experience with Amazon Cloud EC2, Simple Storage Service S3 and Amazon SQS.

Expertise in working with different databases like Oracle, MySQL, and PostgreSQL and Good knowledge in using NoSQL databases Cassandra and MongoDB.

Experience with Design, code, and debug operations reporting data analysis and web applications utilizing Python.

Developed business logic-based features and applications using Python and deployed in AWS cloud in test driven Development.

Experience in Converting existing AWS Infrastructure to Server less architecture(AWS Lambda, Kinesis),deploying via Terraformand AWS Cloud Formation templates.

Performed analysis as part of quarterly and monthly Federal Reserve stress tests Comprehensive Capital Analysis and Review (CCAR), FFIEC, CECL and IFRS report generation

Proficiency with application servers like WebSphere, WebLogic, JBoss, and Tomcat.

Experience in core Java technology which includes Multithreading, JDBC, RMI, and network programming.

Experience with Docker, and deployment of applications inside software containers.

Experience in implementing Python alongside using various libraries such as matplotlib for charts and graphs, python-twitter, PySide, Pickle, Pandas data frame, and network.

Experienced with WAMP (Windows, Apache, MySQL, and Python/PHP) and LAMP (Linux, Apache, MySQL, and Python/PHP).

Experience working with Redis, RabbitMQ for task queues and Celery to manage Asynchronous tasks

Used PySpark-SQL to load JSON data and create schema RDD, Data Frames and loaded it into Hive Tables and handled Structured data using Spark-SQL.

Extensive experience in the implementation of the version control software SVN and GIT.

Excellent working knowledge in UNIX and Linux shell environments using command line utilities.

Have the ability to understand complex systems and be in command of the details to provide solutions.

Experience with Unit Testing / Test Driven Development (TDD), Load Testing, and Integration Testing.

Technical Skills:

Languages

Python, C++, Java, SQL, Shell Script, PHP,Pyspark

Databases

MYSQL, PostgreSQL, Oracle, no-SQL database MongoDB, Cassandra.

Version Controls

Git and SVN.

Python libraries

Pandas, NumPy, Matplotlib, Pytables, SciPy, Flask, Beautiful soup, Bootstrap, jQuery.

Web Servers

Apache Webserver, IIS, HTTP server, Web Logic, Jboss.

Operating System

Linux, Unix, Mac, and windows.

Reporting tools

Tableau, MS-Word, and MS-PowerPoint.

Cloud Technology

Cloud Formation, EC2 and AWS.

Web technologies

JSON, XML, HTML5, Angular JS, CSS/CSS3, JavaScript, jQuery, AJAX.

Frameworks

Django, Pyramid, Flask, CSS Bootstrap.

Technologies

HTML, CSS, JavaScript, jQuery, XML, DOM, CSV, AJAX, Angular JS, Excel, Text.

Methodologies

Agile, Waterfall and Scrum.

Professional Experience:

Lincoln Financial, PA(Remote) Mar 2022-Till Date

Sr. Python Developer

Responsibilities:

Utilized Django Web Framework for creating web applications utilizing model view control engineering.

Use Python unit and functional testing modules such as unit test, mock, and custom frameworks in line with Agile Software Development methodologies.

Implemented Spark using PySpark libraries for faster testing and processing of data.

Managed datasets using Panda data frames and MySQL, queried MYSQL database queries from Python using Python-MySQL connector and MySQL dB package to retrieve information.

Designed and Developed User Interface using front-end technologies like HTML, CSS, JavaScript, JQuery, AngularJS, Bootstrap, and JSON.

Used Agile processes to define, test, analyze, profile, and procure data on a Cloudera Hadoop-based consolidated platform to support re-engineered CECL, IFRS9, and CCAR expected credit loss forecasting models.

Used PySpark-SQL to load JSON data and create schema RDD, Data Frames and loaded it into Hive Tables and handled Structured data using Spark-SQL.

Worked with a marketing company to build several Django, Pyramid, Flask, and CherryPy applications. Worked on Django API's for accessing the database.

Implemented SQL Alchemy which is a Python library for complete access to SQL.

Developing applications using RESTFUL architecture using Node.js and PHP as backend languages. Designed and maintained databases using Python and developed Python-based API (RESTful Web Service) using Flask, SQL Alchemy, and PostgreSQL.

Developed business logic-based features and applications using Python and deployed in AWS cloud in test driven Development

Performed analysis as part of quarterly and monthly Federal Reserve stress tests Comprehensive Capital Analysis and Review (CCAR), FFIEC, CECL and IFRS report generation

Deployment of applications into Cloud infrastructure i.e. Pivotal Cloud Foundry space

Scaling up projects using python tools like multithreading, celery.

Created Automation test framework using Selenium.

Involved and played a leading role in database migration projects from Oracle to MongoDB, Cassandra, and CouchDB databases based on my custom software. experience in using collections in Python for manipulating and looping through different user-defined objects.

Generated Python Django forms to record data of online users and used PyTest for writing test cases.

Clean data and process third-party spending data into maneuverable deliverables within specific format with Excel macros and Python libraries such as NumPy, SQL Alchemy, and matplotlib.

Experience working with Redis, RabbitMQ for task queues and Celery to manage Asynchronous tasks.

Used Pandas as API to put the data as time series and tabular format for manipulation and retrieval of data.

Worked with Oracle RDBMS for writing complex queries and PL/SQL, SQL for Stored Procedures, Triggers, and Events, for generating some important responses needed by the application at times.

Developed Python web services for processing JSON and interfacing with the Data layer.

Use Celery as a task queue and RabbitMQ, and Redis as messaging brokers to execute asynchronous tasks.

Scraping website using Python Beautiful Soup, and then parsing it with XML.

Designed Cloud Infrastructure as a Service environment using open source technology OpenStack to enable portability of cloud services across hybrid cloud environments.

Outputting the parsed data as JSON/BSON and storing it in MongoDB.

Worked with the messaging services tools like Rabbit MQ.

Designing Celery and multithreading for scheduling the tasks and multiple activities.

Implemented automation tools Chef, Puppet, Splunk, and cloud services AWS.

Involved in helping Amazon AWS S3 and RDS to have static/media documents and the information base into Amazon Cloud.

Performed analysis as part of quarterly and monthly Federal Reserve stress tests Comprehensive Capital Analysis and Review (CCAR), FFIEC, CECL and IFRS report generation

Implemented PySpark using Python and utilizing data frames and temporary table SQL for faster processing of data.

Extensive experience with AWS services like S3, ELB, EBS, Auto-Scaling, Route53, Storefront, IAM, Cloud Watch, RDS.

Using AWS for application deployment and configuration.

Wrote UNIX shell scripting for automation.

Worked with the CI/CD tools like Dockers and Kubernetes.

Experienced working with GIT, and version control to commit the changes and follow the workflow.

Develop consumer-based features using Django, HTML, and Test-Driven Development (TDD).

Environment: Django, Pandas, AWS, Bootstrap, XML, HTML, JavaScript, Angular.js, JSON, Rest, Mongo DB, Git, MySQL, Agile, Python, SQL Server, WebLogic, Rabbit MQ, Dockers, .NET, Visual Studio, Docker, Kubernetes.

Navy Federal, VA July 2020- Feb 2022

Sr. Python Developer

Responsibilities:

Exposed to various phases of the Software Development Life Cycle using Agile, Software development methodology. Followed agile for the entire project.

Involved and fostered the UI of the site utilizing HTML, XHTML, AJAX, jQuery, Bootstrap, CSS, and JavaScript.

Created whole frontend and backend modules utilizing Python on Django Web Framework.

Planned and created information on the executive’s framework utilizing MySQL.

Responsible for setting up Python REST API framework using Django.

Worked with the ceaseless combination and organizations utilizing Jenkins.

Used Python-based GUI components for the front-end functionality such as selection criteria.

Worked in MySQL and NoSQL databases on simple queries and writing Stored Procedures for normalization and renormalization.

Implemented performance effective solutions for long running SQL processes by using PySpark Data Frame processing.

Implemented CSV file load processes in Oracle in PySpark by using Panda libraries

Implemented Docker containers to create images of the applications and dynamically provision slaves to Jenkins CI/CD pipelines.

Designing Celery and multithreading for scheduling the tasks and multiple activities.

Worked with the messaging services like Active MQ.

Worked with various Python IDEs using PyCharm, Python IDLE, Eclipse, and IntelliJ.

Worked with Python Libraries like NumPy, SciPy, Matplotlib, Pandas, and sci-kit-learn.

Involved in the expected XML Schema reports and executed the system for parsing XML archives.

Involved in SQL Queries, Stored Procedures, and Triggers Using Oracle, SQL, PL/SQL.

Dealt with planning and executing a MongoDB-based data set and related web administrations for putting away unstructured information.

Performed AWS Cloud organization overseeing EC2 cases, S3, Cloud Formation, SES and SNS administrations.

Conveyed Microservices utilizing Docker holder utilizing Confidential EC2 compartment administration and utilizing AWS administrator console.

Involved in using the CI/CD tools like Jenkins, Dockers, and Kubernetes.

Developed entire frontend and backend modules using Python on Django Web Framework.

Involved in using Servers like Apache Tomcat, and WebLogic.

Used GIT for Source code control and JIRA for Bug tracking.

Developed in Windows and deployed it in a Linux server.

Designing Celery and multithreading for scheduling the tasks and multiple activities.

Used PyUnit, the Python unit test system, for all Python applications.

Performed testing utilizing Django's Test Module.

Environment: Python, JavaScript, Agile, PL/SQL, MySQL, HTML, Django, jQuery, AWS, NoSQL, Git, REST, Agile, Scrum, Jenkins, Active MQ, Tomcat, JBoss, Jenkins, Dockers, Maven, Linux server, Kubernetes.

Magellan Health, AZ, Nashville, TN Jan 2018 - June 2020

Python Developer

Responsibilities:

Developed views and templates with Python and Django to create a user-friendly website interface.

managed, developed, and designed a dashboard control panel for customers and Administrators.

Developed user interfaces using CSS, HTML, JavaScript, jQuery, JSON, Bootstrap, Node.js, and Angular.js.

Worked intimately with leads in execution openness on assistance-based, SOAP, and RESTful advancements.

Designed and implemented utilizing Core Java and C++ in Linux environment for Socket Programming and Thread libraries.

Used Django evolution and manual SQL modifications and was able to modify Django models while retaining all data, while the site was in production mode.

Worked with applications using Python –Django, Enaml, and other python libraries like Panda, Beautiful Soap, and NumPy that were based on principles of Test-Driven Development (TDD) and Parallel Programming.

Responsible for setting up Python REST API framework and Spring framework using Django.

Worked with Data tables using PyQt to show client and strategy data and add, erase, and update client records.

Utilized Python-based GUI parts for the front-end usefulness like determination rules.

Executed route rules for the application and page results, composed regulators utilizing explanations.

Worked with Perl, and shell scripting (bash) to automate administration tasks.

Added support for Amazon AWS S3 and RDS to host static/media files and the database into Amazon

Cloud.

Working on AWS services and deployment services (Lambda) and RDS, Dynamo DB (NoSQL), Beanstalk, and Jenkins.

Automated the existing scripts for performance calculations using NumPy and SQL alchemy.

Developed, designed, and handled a dashboard control panel for customers and Administrators using Django and MySQL.

Used Python libraries like Beautiful Soup, NumPy, and Pandas.

Worked on loading data from Excel into an Oracle table using an external table.

Developed tools using Python, and XML to automate some of the menial tasks.

Developed in Windows and deployed it in a Linux server.

Created an observing application that catches the blunder-related information and stores it in the data set.

Engaged with scouring project, which refreshes the current information with hashed values.

Used Git version tools and deployed the project to Heroku.

Developed Restful APIs using Django and SQL, Alchemy data models as well as ensured code quality by writing unit tests using PyTest.

Environment: Python, JSON, AWS, Git, LINUX, Django, Panda, Beautiful Soap, NumPy, SciPy, Pandas, Mongo DB, Rabbit MQ, SOAP, REST, MySQL, PyQuery, HTML.

Citrix, FL Jun 2016 – Dec 2017

Python Developer

Responsibilities:

Wrote script or program to automate analysis tools to streamline the evaluation of initial data for integrity.

Participated in developing web application UI using HTML, CSS, and JavaScript.

Created core Python API which will be used among multiple modules.

Uploaded statistics to MySQL for analysis and logging.

Involved in database-driven web application development using a variety of frameworks such as Django on Python.

Worked with the applications using Python –Django and other Python libraries like Panda, Beautiful Soup and NumPy, Pyside.

Responsible for debugging the project monitored on JIRA (Agile).

Wrote shell scripting for automation.

Used UNIX server for application deployment and configuration.

Designed object model, data model, tables, constraints, necessary stored procedures, functions, triggers, and packages for Oracle Database.

Worked with JSON-based REST Web services and Amazon Web services (AWS).

Used SVN as a version control tool.

Implemented Test Driven Development (TDD) strategy for the project.

Environment: Python, Django, MySQL, HTML, CSS, JavaScript, SVN, Beautiful Soup, NumPy, Panda Windows, UNIX.



Contact this candidate