Post Job Free
Sign in

Hadoop PySpark, Python, Apache Kafka

Company:
TATA Consulting Services
Location:
Charlotte, NC, 28201
Posted:
January 31, 2026
Apply

Description:

Must Have Technical/Functional Skills Primary Skill: Hadoop ecosystem (HDFS, Hive, Spark),PySpark,Python,Apache Kafka Secondary: UI - Angular.

Experience: Minimum 9 years Roles & Responsibilities Architectural Leadership: * Define end-to-end architecture for data platforms, streaming systems, and web applications.

* Ensure alignment with enterprise standards, security, and compliance requirements.

* Evaluate emerging technologies and recommend adoption strategies.

Data Engineering : * Design and implement data ingestion, transformation, and processing pipelines using Hadoop, PySpark, and related tools.

* Optimize ETL workflows for large-scale datasets and real-time streaming.

* Integrate Apache Kafka for event-driven architectures and messaging.

Application Development : * Build and maintain backend services using Python and microservices architecture.

* Develop responsive, dynamic front-end applications using Angular.

* Implement RESTful APIs and ensure seamless integration between components.

Collaboration & Leadership: * Work closely with product owners, business analysts, and DevOps teams.

* Mentor junior developers and data engineers.

* Participate in agile ceremonies, code reviews, and design discussions.

Required Skills & Qualifications: Technical Expertise: * Strong experience with Hadoop ecosystem (HDFS, Hive, Spark). * Proficiency in PySpark for distributed data processing.

* Advanced programming skills in Python.

* Hands-on experience with Apache Kafka for real-time streaming.

* Frontend development using Angular (TypeScript, HTML, CSS). Architectural Skills: * Expertise in designing scalable, secure, and high-performance systems.

* Familiarity with microservices, API design, and cloud-native architectures.

Additional Skills: * Knowledge of CI/CD pipelines, containerization (Docker/Kubernetes). * Exposure to cloud platforms (AWS, Azure, GCP). Education: * Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Experience: * 9+ years in software development, with at least 4 + years in architecture and Big Data technologies.

Preferred Qualifications: * BFSI domain experience or large-scale enterprise systems.

* Understanding of data governance, security, and compliance standards.

Soft Skills: * Strong analytical and problem-solving abilities.

* Excellent communication and leadership skills.

* Ability to thrive in a fast-paced, agile environment.

TCS Employee Benefits Summary: Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Visio n, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $100,000 - $120,000 a year

Apply