Post Job Free

Resume

Sign in

Big Data Management

Location:
San Jose, CA
Salary:
Negotiable
Posted:
February 20, 2024

Contact this candidate

Resume:

Gur Saran Das Varma, PhD

PRINCIPAL ENGINNER

San Jose, CA 408-***-**** ad3r91@r.postjobfree.com

Objective

A challenging engineering position with a growing organization that will utilize my expertise in AWS, Azure, Real-Time Ad/Tech, Search Engine, Big Data, Hadoop echo system, RESTful APIs, OpenStack, Cloud Technology, Virtual Machines, Big Data Storage Management, Server Design, Network Management, Distributed Systems, Object- Oriented Real-Time Databases, RTOS, Embedded Systems, Device Drivers, Real-Time Software for Systems Control and Integration.

Experience

Arista Networks, Santa Clara, CA Principal Engineer 2022- Present

Working on Cloud Vision to provide support for AI based data security, dynamic configuration of switches and routers and the telemetry data interface with Hadoop, HBase, Hive, Elastic-Search, Redis, MongoDB, Kafka using gNMI. Used Programming Languages Go, Python etc.

Worked on switches and router online purchases, coupons, vouchers, purchasing cart, written the UI and backend software. Used PHP, Python etc.

Firewall design, traffic-policy data management using PHP, Symfony, WordPress, VueJS, NodeJS, React, JavaScript, Jenkins, Docker, Kubernetes etc.

Written software for the Firewall creation using AI and dynamic data models. Defined the RESTful API interface to control routers and switches.

Pluribus Networks, Santa Clara, CA Principal Engineer 2018-2022

Added new features, updated architecture for the Update Server.

Created modern AI related software for telemetry data on UNUM using Java Spring Boot framework, Kafka, Elastic-Search, Redis, Postgres, Jenkins with CI/CD, AWS, Digital Ocean etc.

Worked on fabric design and its backend database. Used Java, JavaScript, Python, Perl, Ruby etc.

Written software for the ZTP provisioning, IOS software feature creation etc. that enormously increased the company’s revenue. Used Python, C/ C++, Java etc.

Worked on Docker Containers and Kubernetes for handing big data using RESTful APIs.

Mentor software engineers

Software design and code reviews etc.

Realtor.com, San Jose, CA Tech Lead, Principal Software Engineer 2018-2018

Worked on real-time Data Analytics Platform, Data Management Platform design and implementation using AWS S3, DynamoDB, RDS, Lambda, Kinesis, CloudWatch, IAM, CloudFormation, ECS, AWS Auto Scaling, API Gateway, Storm path, Cognito, SNS, SQS, AWS Batch, Redis and AWS Data Pipeline etc. using NodeJS, Java, and Python.

Architected, designed, and implemented real-time data pipeline Automation for Data Management Platform.

Mentor software engineers, working using scrums/sprints and did software design, code review etc.

Catalina Marketing, San Jose, CA Principal Software Engineer 2016-2017

Catalina works in the Ad/tech industry and serves real-time targeted/ untargeted online Ads and Coupons.

Worked on real-time Data Analytics System for targeting users, Ad/ Tech real-time Bidding System, Supply Side Platform, Demand Side Platform, Data Management Platform Design, and implementation using Azure, AWS S3, Hadoop, MapReduce, Yarn, Kafka, HBase, Storm, Hive, Apache Phoenix, Solr, Spark, Hue, Oozie, Java, and Python etc.

Designed and implemented real-time Data Pipeline for Data Management Platform.

Worked on performance tuning and cluster load balancing, improved throughput by a big margin.

Mentor software engineers, worked using scrums/sprints and did software design, code reviews etc.

Proteus Digital Health, Redwood City, CA Consultant Software Engineer 2016-2016

Proteus works on real-time patient health monitoring by using their exclusive technology used with medicines.

Worked on Cloud Software Design using Node.js, JavaScript and Python etc. and implemented cloud management and control software using Amazon AWS.

Designed and implemented Big Data Control using Node.js to provide web data management using EC2, S3, DynamoDB, Kafka, Lambda, Kinesis, CloudWatch, IAM, Elastic Beanstalk, Storm path and Cognito, SNS etc.

Implemented Security Protocol.

Worked on scrums/sprints and design, code reviews etc.

Arm Inc., San Jose, CA Consultant Software Engineer 2016-2016

Worked on Cloud Software Design using PyQt5 and implemented Front End GUI to serve and control cloud data using Amazon AWS.

Designed and implemented Big Data Control using Boto3 to provide web data management using EC2, S3, RDS, DynamoDB, SAML and ElastiCache etc.

Worked on implementing Security Protocol for web data.

OpenVPN Inc., Pleasanton, CA Principal Software Engineer 2016-2016

Worked on VPN Server Design in Cloud Environment using Java and Python etc.

Sysomos Inc., Sunnyvale, CA Principal Engineer 2015-2015

Sysomos works in Ad/Tech and Data Analytics Space and provide different leads for the businesses.

Designed and implemented Distributed Grid Systems Platform with Hadoop Clusters running Kafka, HBase, Solr, Lucene, Hive, Spark, Storm, Oozie, Tomcat, Apache Phoenix and Cassandra etc. using Cloud Technology.

Software development for systems performance tuning, benchmarking, runtime shard balancing, and controlling optimally use resources.

Created tools to send notifications for the data ingestion delays, data responsiveness, network condition changes etc. and provided controls to auto correct the system.

Used C/C++, Java, PHP, Python, Perl, Ruby etc. in Linux environment.

Used Puppet etc. for automation.

Integrated Batch Processing RESTful APIs with big data applications MAP, Heartbeat and Audience.

Benchmarking Hadoop Platform for applications, MAP, Heartbeat and Audience.

Managed a software development team of Systems Engineers and Architects for Infrastructure and Security.

AMD SeaMicro, Sunnyvale, CA Principal Engineer 2011-2014

Designed and implemented Distributed Server Cluster, Chassis Management Control Software for dense servers. Used C/C++, Java, PHP, Python, Perl, Java Script, CSS etc. in Linux and Netbsd environment.

Architected and implemented RESTful APIs for SM-15K Chassis.

Integrated Open Stack (Cloud Technology) using RESTful APIs and its interfaces, Cache Management, and UI software for a large-scale cluster of servers in a cloud environment.

Designed and implemented SeaMicro XenAPIs using XML-RPC, JSON-RPC and Hardware based virtualization and interfaced with Citrix XenCenter.

Worked on Storage management software, lower-level protocols, L2, L3 and SNMP etc.

Speaker on OpenStack in Cloud Expo on fabric based dense server technology with bare-metal services.

SM15K Chassis running with RESTful APIs and integrated with OpenStack had a world record of fastest server provisioning with so far highest number of VMs provisioned on bare-metal servers benchmarked by Canonical. (From Feb 2011 to Jan 2012 - MTS and from Jan 2012 to Nov 2014 Principal MTS).

Getjar Inc., San Mateo, CA Principal Software Engineer 2010-2010

Designed and implemented Server Software for Android, iPhone etc. Integrated GetJar users with Facebook to share the downloaded apps. Used Kafka, Memcached, Hadoop, HBase, Thrift etc. to store and retrieve high volume data.

Implemented UI for ETL data displayed for the Subscribers. Used C+ +, Java, PHP, Java Script, CSS etc. in Linux environment.

Skyfire Labs, Mountain View, CA Principal Software Engineer 2010-2010

Designed and implemented Server Software for Android and iPhone web browser to play videos/movies from internet.

Written code to run distributed bots on the internet to acquire data from different servers periodically to update database. Used Perl, C+ +, and Java etc. in Microsoft Windows and Linux environments.

PayPal Inc., San Jose, CA Staff Software Engineer 2006-2010

Designed and implemented Web based UI, database, and interfaces to automate by choosing custom Virtual Machines from the selected templates. Used VMWare’s vSphere/vCenter and Lab Manager Interfaces with SOAP, AD/LDAP, Apache, Oracle, MySQL, Berkeley DB, PHP, JavaScript, Perl, and Java.

Designed and written online Software Tools for run-time code analysis, process internals monitoring, RPM comparison and content verification to the least element level, Link-line binary format checking and memory imaging etc. using Perl and C++.

Debugged and fixed bugs within the code written in C++, Java, Perl, and Python to make that work and install on developer machines, QA machines and on the live-site servers. Used Oracle, MySQL, Berkeley DB, and Apache etc. for application development and Nagios for network monitoring.

Lead the project and ported PayPal’s complete C++ code to compile using GCC 4.x compiler and build and run on latest RHEL platform. I performed code refactoring and scaling to simplify the code and divide into different classes of services to perform code optimization.

Worked on implementing a new Object-Oriented build system and ported complete PayPal’s code to build faster.

Created new footprint for the PayPal code to run on the new platforms. Worked with operations Services team to install services on live site and fix live site issues.

Radiance Tech, Los Altos, CA Principal Software Engineer 2006-2006

Designed and implemented internet based large scale multi-clustered high speed Content Delivery System using Windows XP/NT, Linus, T-SQL, ORACLE, C++, Java, SOAP, XML, Apache etc.

Intel Corporation, Santa Clara, CA Sr. Software Engineer 2005-2006

Designed and implemented Heterogeneous WAN based Large Scale Clustered Distributed System. This system involves High Scalability, Fault Tolerance and High Availability. I used T-SQL, Perl, C/C++, Java, C# & .NET, SOAP- Lite, XML for the application development.

Guided Systems Software based projects in a multi-clustered system on a common platform with Windows XP/NT, Linux, UNIX, and Mac OS etc.

Agere Systems, San Jose, CA Principal Software Engineer 2005-2005

Designed and development of Layer 2 & 3 Protocols, written Device Drivers for 10 Giga Bit Ethernet Switch and its Adaptation Layer, using NPU, XAUI, VxWorks, Tornado & Linux Development Environments.

The protocols used were SNMP, ICMP, IGMP, GARP, GMRP, MPLS VPN, AAL2 etc. The services handled were VLAN, QoS, diff-serve, IPv4/v6 Forwarding, ATM, IPSec etc.

Novellus Systems Inc., San Jose, CA Sr. Staff Software Engineer 2000-2004

Designed and implemented Real-Time QNX RTOS based Distributed Control System for a clustered Modular CVD reactor. This system involves Fault Tolerance and High Availability.

Performed Network Load Balancing, Task Tuning etc. to check the Distributed Process Synchronized Response Time using IPC & TCP/ IP Protocols. Programmed QNX File System. Written QNX Device Drivers for the different devices.

Written Simulation Software for the complete CVD Reactor.

Quester Technology Inc., A Canon Company, Fremont, CA Staff Software Engineer 1997-2000

Designed and implemented a High-Speed Network Traffic Controller using a Client/Server Model. The Controller is designed to handle many nodes on a Wide Area Network (WAN).

The software is written on Windows NT and Solaris/Unix workstations using C++.

Project Leader for the software design and development of Real-Time VxWorks RTOS based VME control system for a CVD (Chemical wafer deposition equipment) reactor.

Honeywell Measures Inc., Cupertino, CA Staff Software Engineer 1995-1997

Project Leader for the design and implementation of a Real-Time Distributed Database Management System for Real Time Control Systems. The system uses Object-Oriented design on Windows

NT platform with the integration to relational database (using ODBC) and the other application tools such as LabVIEW, UOS, AM, IMS, UNIX etc.

Designed and implemented high speed Real-Time Network Messaging Services (NMS).

Education

Indian Institute of Technology, Roorkee PhD, Computer Engineering

Heterogeneous Distributed Object-Oriented Database Management System

Indian Institute of Technology, Roorkee MS, Computer Science and Technology

3D Graphics Computer Graphics

DEI Faculty of Engineering, Agra BS, Electrical Engineering

Digital Electronics Electrical Engineering

Skills & abilities

·Go, C/C++, Java, Python, Perl, PHP, Ruby, JavaScript, C#, .NET, JSO, XML, SQL, DHTML, UML etc.

·Java Spring Boot, Docker Containerization, Kubernetes, Hibernate, WordPress, Symfony, ReactJS, VueJS, gRPC, gNMI etc.

·HBase, DynamoDB, Cassandra, MongoDB, Netezza, Solr, Hive, Spark, RDS, ORACLE, MySQL, Postgres, T-SQL, Berkeley DB, GDB etc.

·Hadoop, Yarn, S3, NetBSD, Linux, QNX, VxWorks, Windows, Solaris etc.

·Git, SVN, RCS, CVS, Microsoft Source-Safe, Clear-Case Clear-Quest etc.

Visa Status

US Citizen



Contact this candidate