Post Job Free

Resume

Sign in

Big Data Architect

Location:
Sunnyvale, CA, 94087
Posted:
September 30, 2016

Contact this candidate

Resume:

Ajay Sharma

+1-408-***-****

acwuit@r.postjobfree.com

SUMMARY

Lot of soft skills leadership, humility, collaboration, adaptability and love to learn and re-learn.

Ideating, Prototyping and building products.

Product Fitment, Gap Analysis.

Designed and developed the architecture for Data Warehousing components across subject areas and various technical domains (e.g. tool integration strategy, data massaging, data cleansing, data source strategy, data staging, movement, and aggregation, information and analytics delivery and data quality strategy).

Responsible for design, develop and implement big data platform including big data infrastructure, data warehouse, data processing pipelines and system integrations

Data modelling and metadata management

Streaming data processing and analysis

Responsible for end-to-end data quality, validation and consistency

End-to-end data processing trouble shooting and problem diagnosis

Performance benchmark, load testing and code reviews

Across team collaborations and effective communications.

Expert in UNIX, Linux, Storage systems, high performance file systems, high performance embedded databases, real time applications, online analytical processing, web services, and cloud storage services.

Amazon Elastic MapReduce (EMR) web service component, design and implement systems to run smoothly at massive scale.

Experience with Amazon S3 providing cost effective object storage including cloud applications, content distribution, backup and archiving, disaster recovery, and big data analytics.

Experience working with Java SE, Java EE, JDBC, JSP, Servlets, Java Script, EJB, Tomcat, WebLogic and WebSphere.

Hands on Experience in Web Services using XML, HTML, JSON, Jquery and Ajax.

Experience in Service Oriented Architecture (SOA) -Web Service Orchestration - framework to orchestrate web services using the BPEL4WS specification.

Technologies – PHP/ LAMP, J2EE, .NET, Oracle, XML, WSDL, UDDI, SOAP. Built a range of tools, products, components and accelerated application development toolkits to help reduce the complexity of the “Application integration spaghetti" paradigm.

Professional Summary

SOACLOUD9 November, 2013 - till date

Technical Lead

Retail Monitoring project specializes in analysis and utilization of data gathered from retail devices, with the goal to gain insight into usage and health of retail devices, to give the business leverage for optimizing retail demo content and behaviour for the best possible user experience for consumers using the devices in sales points

Roles & Responsibilities:

Product Fitment & Gap Analysis.

Effort estimation and prioritization

Design of the data model.

Collected data from different sources like web servers and social media using flume for storing in HDFS and Analyzing the data using Python.

Designed and developed interactive dashboards and reports using Tableau Desktop.

Converted some of the existing excel-based reports into Tableau applications.

Developed QlikView Scripts, Data Models, Dashboards, Charts and Graphs, Reports.

Migrated Corporate OBIEE Dashboards and Reports to QlikView.

Collected the logs data from the web servers and integrated it to HDFS.

Advised file system team on optimizing IO for Hadoop / analytics workloads.

Created Hive tables and analyzing the loaded data in the hive tables using hive queries.

Managing the design and development of the analytics platform using Apache Hadoop and cloud based Amazon Web Services (AWS) Elastic Search S3.

Creation of new database objects/enhancement of existing database objects based on the business requirement.

Involvement in discussion with data visualisation team.

Creation of automated windows GUI applications using Visual C#.NET programming and Teradata .NET provider class Involvement in discussions with integration projects to remove impediments if any, during sprint execution. Development of Teradata SQL scripts to populate the data from different source tables.

Involved in importing and exporting the data from RDBMS to HDFS and vice versa using sqoop.

SOACLOUD9 Jan 2009 – August 2013

Technical Lead

Roles & Responsibilities:

Customer BI Rel 3.0 is aimed to integrate the Sell Thru, Inventory & Target information from Fastrac CV into Data warehouse (NDW).

Business requirements from Customer BI side (i.e. from dependent programs like End to End Visibility, which needs the data from FTCV for Analytical purposes).

Designed and implemented a Cassandra noSQL based database and associated RESTful web service that persists high-volume user profile data for vertical teams. Migrated high-volume OLTP transactions from Oracle to Cassandra in order.

Created architecture stack blueprint for data access with noSQL; used as the technical basis for new Cassandra projects. Lead role in noSQL column family design, client access software, Cassandra tuning; during migration from Oracle based data stores.

Designed and implemented Spring Framework based RESTful and SOAP web services and software stack for high volume (>400TPS) on-line account management, order and payment processing.

Data model and Oracle physical design to support monthly subscription based product offerings.

Implemented AOP based security, database transaction management, and service monitoring using Spring/Aspectj.

SA Technologies FEB 2008 – Dec 2008

American Express Atlanta Georgia

Sr. Consultant

Roles & Responsibilities:

• Analysed data which included investigation and analysis, documentation, filtering of bad data through generation of crystal reports.

• Worked with Data Warehouse Extract and load developers to design mappings for Data Capture, Staging, Cleansing, Loading, and Auditing.

• Analyze data which included investigation and analysis, documentation, filtering of bad data through generation of crystal reports.

• Building workflows for sequential execution of data transfers.

• Establishing standards & guidelines for data conversion.

• Developed, enhanced and maintained Snow Flakes and Star Schemas within data warehouse and data mart conceptual & logical data models.

• Offshore Project Co-ordination including application interface development & delivery.

• Building workflows for sequential execution of data transfers.

• Establishing standards & guidelines for data conversion.

SA Technologies

Adobe San jose CA July 2007 – Jan 2008

Sr. Consultant

Roles & Responsibilities:

Defining the standards: Data Warehousing, Data Management, Teradata and SAP BW integration, Data Governance, Master Data Management, Data Quality.

Defined and implemented large enterprise Operational Data Store Successful operation of onsite – offshore model.

Defined and established production support processes Staging System Refresh & Outage planning

SATYAM COMPUTERS LIMITED Jan 25 2004 – June 2007

Lead Consultant

Client, Statefarm, TRW Automotive, Ford Information Technology, Toshiba America Information Systems, Glaxo Smith Kline

Roles & Responsibilities:

Analysed data which included investigation and analysis, documentation, filtering of bad data through generation of crystal reports.

Participated in system integration, historical load, incremental load and parallel testing.

Established auditing procedures to ensure continued data integrity.

Vergiltech/INTIQUA July 2002 – Jan 17 2004

Singapore /India

• Data Modelling Techniques (Basic Cube, Multicube, ODS and Info source, Info objects, Info source, Info packages ) Activation of Standard Business Contents

• Data Extraction using Generic Data Extractors, Standard Business Content

• Creation of generic data source, info source, info packages

Universal Software Corporation Feb 2001- March 2002

Sun Microsystem/USA

Project Lead

• Prepared detailed task plan, continuous monitoring and execution. Work distribution between offshore and onshore teams.

• Database analysis configuration in the performance testing environment, and recommended, implemented improvements

SSA Global ( A Global ERP Vendor ), Asia March 1997 – Sept 1999

System Consultant

• Translated business requirements into data needs and developed detail E-R and dimensional models.

• Worked closely with Business Analyst to implement data loading specifications.

• Developed enterprise data model management process to manage multiple data models developed by different groups.

• Suggestions for Performance improvement of the system, Supported a Marketing Data warehouse with to provide relational organization data and capability to generate complex ad hoc reports in retail marketing activities.

• SLA monitoring for helpdesk, Client satisfaction managed multi technology teams.

• Managed teams of experienced developers and functional consultants across the countries with onsite-offshore models.

Mastech, India / Indonesia Aug 1995 – Jan 1997

Business Analyst

France Telecom

• Responsible for overall deliverables for blueprint refinement phase.

• Responsible for Infrastructure planning, acquisition and deployment.

• Management of Requests, Billing, Collection.

• Project planning of blueprint refinement activities.

Karrox Technology, India August 1992 July 1995

System Consultant

• Developing and planning technical Infrastructure

• Manage the technical infrastructure.

Education:

• Bachelor Of Commerce, Bombay, K.J Somaiya College, India (12/1994)

• MCSD, MIP Karrox Technologies Ltd, India (03/1997)

• Honours in System & Analysis & Design, National Institute of Information and Technologies, India (03/2004)

TRAININGS:

• PMP/USA/Satyam Computer Service

• Six Sigma/USA/Satyam Computer Service

• Big Data (Hadoop)/Europe/Nokia

Skills

Environments

Hadoop 2.7.2, Hbase 0.94, flume 1.6.0, kafka 0.8.2.1, Python 3.4.3, Strom 0.9.6

Hive 1.2.0, Sqoop 1.4.5.

Teradata SQL, Teradata, Teradata

Viewpoint, Teradata Parallel Transporter, Arcmain, Fastload, Multiload, Tpump,

Fastexport, Bteq, Visual Studio 2015, Xcelsius/Dashboards/Crystal Reports, Oracle 10g/9.2/8.1.7/8.0.6/7.3, Java,PHP, Javascript, REST, JSON, XML,HTML5, C#, Python,React.js

Cloud Storage

Ms Azure, Amazon

Data Warehouse/Business Intelligene

OBIEE(mobile), Tableau, Hadoop, NoSQL, SAP BW, Qlikview(Mobile), HP Autonomy, HP Vertica, Oracle

Informatica, SSIS

Reporting Suit, Business Objects Data Integrator, Erwin, DataStage, Business Objects, FirstLogic, Informatica, WebMethods, Ab Initio, Hyperion, Essbase, Pivotal HD, Oracle Big Data Appliance,

Data Modeling

Infocubes, Multi-Providers, Infosets, ODS/DSO, Info Objects (Characteristics and Key Figures), Master Data. Erwin 7.3

Reporting

Business Objects WEBI, Info View, Web Application Designer, BEx-Analyzer and Query Designer.

ETL

Info-Source, Transformations, Transfer Rules, Update Rules, Start Routines, End Routines, User Exits, DTP, and Data sources, Generic Data Sources, Process chains.

Performance

BIA / BWA, Aggregates, Partitioning, OLAP Cache, Indexes, Statistics, Compression, ABAP/4, Number Range Buffering, Information Broadcasting and Precal Server.

Security

BW/BO Security, User Groups, Roles, Profiles, Analysis Auth.

Trustwave Managed SIEM services.

Upgrades

Technical / Functional Upgrade of SAP BW 3.x to 7x. Migrated Queries, Web Templates, workbooks, BI Security 3.x to 7.0, Migrated 3.x data flow to 7.x.

Global ERP

SAP R/3, Ver ECC 6.0, SAP BI, SAP NetWeaver 2004s,

ABAP/4, SAP ECC 6.0/5.0/4.7/4.6/ 4.0B/3.1I, CRM



Contact this candidate