Please note : This position is focused on development rather than migration.
We are seeking an experienced Data Engineer to join our team.
As a Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure and ensuring the smooth operation of our data platforms.
The ideal candidate should have a strong background in advanced data engineering, scripting languages, cloud and big data technologies, ETL tools, and database structures.
Responsibilities : - Utilize advanced data engineering techniques, including ETL (Extract, Transform, Load), SQL, and other advanced data manipulation techniques.
Develop and maintain data-oriented scripting using languages such as Python.
- Create and manage data structures to ensure efficient and accurate data storage and retrieval.
- Work with cloud and big data technologies, specifically AWS and Azure stack, to process and analyze large volumes of data.
- Utilize ETL tools such as Nifi and Tibco to extract, transform, and load data into various systems.
- Have hands-on experience with database structures, particularly MSSQL and Vertica, to optimize data storage and retrieval.
- Manage and maintain the operations of data platforms, ensuring data availability, reliability, and security.
- Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.
- Stay up-to-date with the latest industry trends and advancements in data engineering and suggest improvements to enhance our data infrastructure.
- Requirements A minimum of 6 years of relevant experience as a Data Engineer.
- Proficiency in ETL, SQL, and other advanced data engineering techniques.
- Strong programming skills in scripting languages such as Python.
- Experience in creating and maintaining data structures for efficient data storage and retrieval.
- Familiarity with cloud and big data technologies, specifically AWS and Azure stack.
- Hands-on experience with ETL tools, particularly Nifi and Tibco.
In-depth knowledge of database structures, including MSSQL and Vertica.
- Proven experience in managing and operating data platforms.
- Strong problem-solving and analytical skills with the ability to handle complex data challenges.
- Excellent communication and collaboration skills to work effectively in a team environment.
- Self-motivated with a strong drive for learning and keeping up-to-date with the latest industry trends.
(ref:hirist.tech)