Post Job Free
Sign in

Big Data Developer

Company:
Synchron
Location:
Pune, Maharashtra, India
Posted:
April 08, 2024
Apply

Description:

Greetings,

We have immediate opportunity for Engineering Manager -5 - 10yrs _Synechron – Pan India

Job Role: - Data Engineer

Job Location: - Pan India

About Company:

Synechron is a leading digital transformation consulting firm focused on the financial services industry.

JOB DESCRIPTION :

Job Title: Big Data Engineer

Job Description: We are seeking a highly skilled and experienced Big Data Engineer with a minimum of 5 years of expertise in Big Data technologies, SQL, Spark, Hive, Hadoop, and Python. The ideal candidate will play a pivotal role in the development, implementation, and management of our big data infrastructure, ensuring the efficient processing and analysis of large-scale data sets.

Responsibilities:

1. Design, develop, and implement scalable and efficient data processing solutions using Big Data technologies such as Hadoop, Hive, and Spark.

2. Create and optimize data pipelines for data ingestion, processing, and distribution, ensuring high performance and reliability.

3. Collaborate with cross-functional teams to gather data requirements and design data models and processing workflows.

4. Implement ETL processes and data cleansing techniques to ensure data accuracy and consistency.

5. Develop and maintain functional data marts based on business requirements, in collaboration with stakeholders and domain experts.

6. Engage in complex integrations from both internal and external data sources, ensuring seamless data flow and accessibility.

7. Utilize Python for data processing, scripting, and automation tasks within the big data environment.

Requirements:

1. Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

2. Minimum of 5 years of professional experience as a Big Data Engineer, with expertise in SQL, Spark, Hive, Hadoop, and Python.

3. Proficiency in SQL for data querying, analysis, and manipulation within a big data context.

4. Strong understanding and practical experience in Apache Spark for data processing and analytics.

5. Competency in Hive and Hadoop for distributed data processing and storage.

6. Proficient in Python for data processing, scripting, and automation tasks within a big data environment.

If intrested please apply on below link :

Full time

Apply