Databricks Archittect
Resume:
BigTapp Analytics Inc Kiran Kumar Tati – Data AI Architect ****.*****@****************.***
Kiran Kumar Tati – Data and Analytics Solutions Architect, Practice Leader www.linkedin.com/in/kirankumartati
Summary
● Fourteen years of experience in Data Warehousing, Data Lakehouse, Cloud, Big Data, Data Engineering, Operational Data Store (ODS), Data Modelling and Business Intelligence.
● Extensive experience in leading workshops, proof-of-concepts with clients and key stakeholders to deliver technical solutions and strategic roadmaps.
● Extensive experience in design, develop, and implement end-to-end data solutions both on-prem and cloud for various business groups.
● Extensive experience in leading data platforms/ tools evaluation
Azure Synapse vs Snowflake vs Teradata Vantage vs Amazon Redshift
Informatica IICS vs IBM DataStage
ADLA vs HDInsight vs Azure Databricks
HVR vs Qlik Replicate
Confluent Kafka vs Azure Event Hubs (contributor)
● Managed a global team of technical resources (Analysts, Data Modelers, Data Engineers, report developers etc.) to design, develop, and maintain a robust enterprise data warehouse, advanced analytics, and business intelligence reporting solution.
● Experience in designing and implementing solutions using AWS and Azure/big data technologies like ADLS Gen2, Amazon S3, Azure Databricks, Snowflake, Amazon Redshift, Azure Data Factory, Azure Event Hubs, Kafka, Function apps, Power BI, Amazon QuickSight etc.
● Extensive experience leveraging the full suite of Databricks products and services to drive enterprise-scale data solutions.
● Expertise spans the Databricks Lakehouse Platform, including Delta Lake for reliable data management, MLflow for end-to-end machine learning lifecycle management, and Databricks SQL for seamless analytics.
● Extensive hands-on experience in multiple full life cycle development projects that include Enterprise Data Warehouse (30 TB)/ODS (3TB) using Teradata, Snowflake, SQL Server, Informatica, SSRS, Tableau and Power BI.
● Designed and implemented a micro-batch architecture to a complex business- critical BI solution to reduce the data refresh rate from 24 hours (daily batch) to 20 minutes using ADLS and Databricks.
● Strong SAP domain knowledge and built analytical solutions that ingest, transform, model and visualize SAP data for business insights.
● Experience in leading, mentoring, and motivating technical teams in high data volume and fast-paced environments.
Data & Analytics Leadership
Data Engineering Migration, Modernization
Apache Spark PySpark Big Data Warehousing
Data Lake AI+BI Unity Catalog
Cloud Hyper scalers
Analytics Architecture - Implementation
Data Modelling - Governance
Code Optimization Coaching and Mentoring
Professional Certifications
Databricks Certified Data Engineer –
Professional (November 2023)
AWS Certified Data Analytics – Specialty
(July 2022)
AWS Certified Solutions Architect –
Associate (May 2022)
Technical Skills
Databases: Amazon Redshift, Teradata,
Snowflake, SQL Server, Azure Synapse, Oracle,
Azure SQLDB, SSAS (Tabular and Multi-
Dimensional)
Big Data: Azure Databricks, Snowflake, ADLS,
Azure Blob, HDFS, Amazon S3, HDInsight
(Apache Spark, Hadoop, PySpark)
BI Tools: SSRS, Tableau, Power BI, Amazon
QuickSight
ETL/Middleware: Informatica (IICS DI and AI),
Azure Data Factory, SSIS, Dell Boomi, High
Volume Replicator (Fivetran), AWS Glue, SAP
BODS
Data Modelling: ER Studio, Power Designer,
ERWIN
Languages & API’s : SQL, PL/SQL, MDX, DAX,
C#, Python, Java API’s
Version Control: Azure DevOps, GitHub, VSTS
Governance tools: Databricks Unity Catalog,
Informatica EDC (Enterprise Data Catalog),
Collibra, Alteryx
Education
Master of Science, University of Missouri, Columbia August 2007 – December 2009 GPA: 3.48/4.0 Bachelor of Technology, Jawaharlal Nehru Technological University, India. August 2002 - April 2006 GPA: 3.6/4.0 BigTapp Analytics Inc Kiran Kumar Tati – Data AI Architect ****.*****@****************.***
Professional Experience
Data and AI RSA Practice Leader, Bigtapp Analytics Inc. Omaha, NE July 2024 – Present Role: Databricks Solutions Architect Customer: The Lego Group, Denmark Project: Impala to Databricks Migration o Lead cross functional Databricks Design, Architecture, Migration and Implementation Services. o Migrate Tableau workbooks and data sources from Impala to Databricks using Databricks Accelerator. o Performance tune the Databricks SQL to meet the workbook SLAs. o Migrate Snowflake workloads to Databricks.
o Collaborate with Databricks engineering and presales partners teams on complex custom migration pursuits. Role: Databricks Solutions Architect Customer: Sorenson Global Communications Project: Data Ingestion from Salesforce and Dynamics 365 o Design and Implement data ingestion architecture to dynamically ingest data from Dynamics 365 APIs into Bronze layer for Data Lakehouse architecture. o Design and Implement data ingestion architecture from Salesforce using Databricks native salesforce connector. o Build ingestion framework with fault tolerance and auto-recovering data ingestion pipelines. Analytics Specialist Solutions Architect at Amazon Web Services (AWS), Omaha January 2022– July 2024 o Shape and execute strategies to build mindshare and broad use of AWS within enterprise customers. o Ensure success in building and migrating applications, software and services on the AWS platform. o Educate customers of all sizes on the value proposition of AWS and participate in deep architectural discussions to ensure solutions are designed for successful deployment in the cloud.
o Build deep relationships with senior technical individuals within customers to enable them to be cloud advocates. o Conduct one-to-few and one-to-many training sessions to transfer knowledge to customers considering or already using AWS. o Author or otherwise contribute to AWS customer-facing publications such as whitepapers, blogs etc. Sr. Manager, Data Services at Kiewit Corporation, Omaha January 2021 – January 2022 o Manage data-driven projects involving timelines, vendor relationships, and budgets to ensure projects are delivered with the highest quality and within specified timeframes.
o Architected and lead on-prem Enterprise Data Warehouse (Teradata) to Azure Data Lake Storage (Gen2) and Databricks based Data Lakehouse migration project.
o Successfully deployed and managed large-scale data workloads using Databricks' cluster management capabilities, ensuring cost- efficiency and performance optimization.
o Designed data lakehouse architectures integrating Snowflake with Azure Data Lake. o Integrated Snowflake with BI tools like Tableau, Power BI, and Looker for self-service analytics. o Provided project updates to COE & department Business Champions on a monthly and quarterly basis. Cloud Data Architect, Data Technologies Team at Kiewit, Omaha December 2019 – January 2021 o Lead effort to select technology stack for next generation data platforms, business intelligence and advanced analytics for Kiewit to modernize current data warehouse and BI environments. o Designed and implemented robust ETL pipelines using Databricks' Spark-based processing engine, optimizing performance through advanced techniques like Delta Lake optimizations and Photon engine utilization. o Designed efficient template for ORS projects that involves developing Delta Live Tables (DLT) in Databricks to read data from ADLS (from ingestion layer) and store them in SCD Type1 and 2. o Own and develop technical architecture, design and implementation of big data platforms and business analytics solutions to deliver data driven BI and advanced analytics needs.
o Architected a robust pipeline for aggregating financial datasets from multiple platforms into Snowflake enabling faster decision-making and improved estimating capabilities.
o Design, build and deliver reusable foundational frameworks for ODS, Data Warehouse and Data Lake workloads (both on-prem and cloud).
Data and BI Solution Architect at Kiewit Corporation, Omaha April 2015 – December 2019 o Design and implement Data Marts, Data warehouse/ODS solutions, calculation scripts, data matrix, OLAP, Star Schema Modeling, Snow- Flake Modeling that are used across the organization for Critical business operations. o Collaborate with developers, database administrators, analysts and modelers to understand business requirements and capabilities to strategize and design end-to-end solutions.
o Designed and implemented Snowflake data warehouses, optimizing storage and query performance. o Developed efficient Snowflake pipelines using Snowflake Streams, Tasks, and Stored Procedures. BigTapp Analytics Inc Kiran Kumar Tati – Data AI Architect ****.*****@****************.***
o Designed and Developed a Campaign Management System for the Consumer Marketing department based on Adobe Flex and Java, using the Teradata Active data warehouse architecture. BI Developer/Team Lead at Kiewit Corporation, Omaha July 2013 – April 2015 o During this period worked in multiple roles as a BI Developer, Sr. BI Developer and Team Lead. o Lead cross-functional project team to bring new data sources into the data warehouse and build integrated (3NF) and Semantic layers and use BI tools for visualizations, dashboards.
o Created complex SQL Server Analysis Services (SSAS) cubes with multiple fact measures groups, and multiple dimension hierarchies based on the OLAP reporting needs.
o Coordinate/Perform Code review and design review. Mentor and coach developers and peers. Software Developer/Programmer Analyst at Infolabs Inc., Herndon April 2010 – July 2013 o Learning and applying various programming languages. Individual contributor to various data and application modernization initiatives. o Business requirements, Use Case Development for Application development projects. o Liaison between Business, Development and analytics team. Technical Certifications
Databricks Certified Data Engineer – Professional (November 2023) AWS Certified Data Analytics – Specialty (July 2022) AWS Certified Solutions Architect – Associate (May 2022)
Contact this candidate