Shiva Rudra
+1-209-***-**** Data Engineering Cloud Engineering Oracle Database Administrator/ETL *********@*****.***
SUMMARY
As an IT professional with over 12 years of experience, I have successfully served 4 Years for Data Engineering and 2 years Cloud Engineering and 6 years for Oracle DBA.
In Deep Diving in Data Engineering having Designed, customizing and development & Functionality In Google Cloud Platform support are GCP (Big Query, Airflow, Data Flow, Data Proc, DAG, CDC Pipeline, Composer, Data Spanner, Data Form, Data prep, APIs Pub/Sub) GitHub Dev-Ops Methodology. Salesforce. Performance tuning SQL.
Azure Databricks for ETL & Staging, Clusters, Azure (Data Lake, Data Lake Storage (ADLS) SQL, BLOB, DW, Event Hubs, Synapse Analytics), Databricks Unit.
Cloud solutions such as Amazon Web Services, AWS RDS, EC2, S3, DMS, CloudWatch, Data Syn Understanding of Software design patterns, SDLC, Continuous Integration and Continuous Delivery.
in Oracle Database 12C, 19C, /MS SQL Server My expertise spans Oracle, Data Guard, ASM, OEM 13.5, and RMAN Backup & Recovery, with a strong emphasis on Performance Tuning and Security.
TECHNICAL SKILLS
GCP Data Engineering BigQuery, Airflow, Data Fusion, Data proc, CDF, PUB/SUB, Composer, Buckets. Cloud
Spanner, Data Form, Data prep, APIs, Maven, Jenkins. Cloud Monitoring.
AWS Cloud Platforms: AWS (EC2, RDS, CloudWatch), Snowflake, Cost Planning Google Marketing platform.
Programing skills: SQL, PL/SQL, Python, PySpark.
Performance Tuning: (DB, Object, Instance, SQL Profile) Tuning, Oracle Hints, Explain plan, TKProof, AWR, ADDM.
PL/SQL Features: Analytical Functions, Native Dynamic SQL, Cursors, Cursor Variables, Bulk Binding.
Other Skills: Salesforce Inspector, Data Integration, Data Loading, Debugging CDF Pipe line & GitHub, & Jira
Databases, storage: Oracle 12C/19C/21C./ 19C, MS SQL Server, AWS RDS, S3.
Database Tools: RMAN, Oracle SQL Loader, Cloud Watch & Languages: SQL, PL/SQL Shell scripting.
Database Objects: Schemas, Tables, Views, Indexes, Triggers, Functions, Procedures, Materialized views Packages.
PROFESSIONAL EXPERIENCE
Client: WALLMART Role: GCP Data Engineering Jun 2024-Present
Data migration was done from Oracle database 19c to GCP BigQuery Due reduce the cost of oracle license cost.
Design and implement new tables, indexes, or relationships in Cloud Spanner and Modified existing schemas to accommodate changing business requirements without downtime using Spanner’s schema management capabilities.
Storage (GCS) bucket, Google Cloud Functions, GSUTIL, BQ command line utilities, Data Proc, and Google Cloud Operations.
Monitor and maintain data ingestion pipelines that insert, update, or delete data in Cloud Spanner.
Use tools like Dataflow or custom ETL jobs for data transformation and migration.
Handle both batch processing and real-time streaming data into Cloud Spanner.
Integrate Cloud Spanner with other GCP services like BigQuery (for analytics), Pub/Sub (for messaging), or Dataflow (for data processing).
Client: A3 Smart Homes Security Role: GCP Data Engineering Jun 2020-May 2024 Sub Project 1
Extensive hands-on experience in Google Cloud Platform (GCP), proficient in BigQuery, Cloud Dataflow, Google Cloud
Automate data processing using APIs like Dataflow, BigQuery, and Pub/Sub, which can process batch or streaming data.
Develop and maintain applications that interact with Cloud Spanner using its API (gRPC, REST, JDBC for PostgreSQL).
Monitoring and Performance Tuning Monitor metrics, logs, and alerts for the overall health of Cloud Spanner instances and optimize performance as needed.
Designed and developed continuous deployment pipelines, integrating Google Cloud's built-in functionalities into a DevOps environment with robust CI/CD processes.
Demonstrated advanced expertise in GCP by designing and deploying effective solutions tailored to client needs on GCP.
Designed architecture, Pipelines, CDF, DAG AIRFLOW & BIGQUERY and moved data into dedicated applications.
Extensively used GCP, Big Query, Salesforce, data fusion for daily development jobs.
Implemented the pipelines for data ingestion from various sources and data processing using ETL operations.
Closely worked and supported Sedona/Salesforce team to deliver and complete the deliverables within deadlines.
Optimized data migration to GCP using Cloud Dataflow, decreasing data discrepancies by 30%
Salesforce objects modification and data load and monitoring in police inspector and data loaded from files. Expertise in setting up AWS RDS, DynamoDB, MongoDB, PostgreSQL, Cassandra, as well as loading business front-end data
Client: AAA Club
Sub Project 1 Role: AWS Cloud Engineering Jul 2018 – May 2020
On Deman and Load we will create instance in AWS and attached to the existing business, it will work as automate process.
AWS Cloud watch we will monitor and performance of databases and operating systems.
Oracle Database Migrations to AWS RDS using DMS.
Creating EC2 servers with S3 as per client recommendations and with multiple regions with cost effective.
EBS volumes, RDS, ElastiCache, built with EC2 &S3 with dynamic scaling & Load Balancing and routing.
Efficiently decommissioning servers and applications on schedule to enhance productivity by AWS Cost reduces.
Experience in ETL data integration, automation, and utilizing Shell scripting for automating processes.
Designed and implemented data pipelines using Azure Data Factory to automate data integration and ETL processes
Designed data lakes using Azure Data Lake Storage Gen2 for storing structured, semi-structured, and unstructured data.
Integrated data from multiple sources, including Azure SQL, Synapse, and ADLS, to create unified views of business metrics
Built and managed scalable data processing solutions using Azure Databricks for real-time and batch processing.
Sub Project 2 Role: Oracle Database Administration Jul 2012 – May 2018
Strong knowledge in oracle database Architecture, Implementation from Oracle 11GR2,12C,19C.
Oracle database to GCP big query cloud migration using simple shift and lift method.
Planned, installed, configured, administered, and maintained Oracle Database 12c and 19c, including RAC and Data Guard, in production environments. Additionally, managed deployments in cloud OCI and monitored systems using OEM.
Proficient in writing complex SQL queries, multiple joins, subqueries, and aggregations to retrieve and manipulate data.
Troubleshooting and Resolving Performance Bottlenecks like Query Optimization (SQL Tuning, Indexing Scanning).
Managed and optimized long-running transactions in Oracle databases, performance and availability.
Performed parallel execution tuning, optimizing resource usage for large-scale operations and improving data processing.
Utilized ticketing tools such as Jira and ServiceNow for efficient tracking and participated in daily Scrum calls. EDUCATION
Masters in Database Professional, Sheffield Hallam University.
Bachelor of Technology in Electrical and Electronic engineering, CMR Engineering College.
CERTIFICATIONS
GCP Google Cloud Certified Professional Data Engineer (Aug 2024).
AWS Certified Solutions Architect Associates Certified (Jun 2022).
Oracle Certified Associates 19C(OCA) (May 2024).
Oracle Certified Professional 19C(OCP) (May 2024).
Oracle Cloud Infrastructure Foundations Associate (OCI) (OCT 2024).
AWARDS & ACHIVEMENTS
Received the Outstanding Employee (O2) Award six times at HCL Technologies Pvt Ltd.
Conducted training sessions on Oracle DBA, AWS, and GCP for new hires and current team members within the Learning Curve group.
In my role as Senior Associate Manager, I managed all project activities, including team recruitment and knowledge transfer (KT). I also supported the Business Continuity Plan (BCP), Auditing and contributed to other project needs within my available bandwidth.