AWS/Databricks Engineer

Job Description

We are looking for an experienced AWS/Databricks Engineer to join our team in Houston, Texas. This is a long-term contract position ideal for professionals with a strong background in data engineering and cloud technologies. The role will focus on leveraging Python and Databricks to optimize data processes and enhance system performance.

Responsibilities:

• Develop and implement scalable data engineering solutions using Python and Databricks.

• Collaborate with cross-functional teams to design and optimize data workflows.

• Migrate and enhance existing Python scripts to Databricks for improved functionality.

• Utilize cloud technologies to support data integration and analytics processes.

• Implement algorithms and data visualization methods to present actionable insights.

• Design and maintain APIs to streamline data interactions and integrations.

• Work with tools like Apache Kafka, Spark, and Hadoop to manage large-scale data systems.

• Perform data analysis and develop strategies to improve system efficiency.

• Ensure high-quality data pipelines and address performance bottlenecks.

• Stay updated on emerging trends in data engineering and recommend innovative solutions.• Proven experience as a Data Engineer with expertise in Python and Databricks.

• Solid understanding of cloud technologies, particularly AWS.

• Hands-on experience with Apache Kafka, Spark, and Hadoop.

• Proficiency in developing and maintaining APIs.

• Strong background in data visualization and analytics.

• Ability to implement algorithms for data processing and analysis.

• Knowledge of Apache Pig and other data tools.

• Excellent problem-solving skills and attention to detail.