Top 3 Skills
Python
ETL
Experience within structured and un-structured data
Unstructured data into relational databases
AWS
Requirements:
• You have a Bachelor's Degree in Computer Science (or related field) and have 5+ years of relevant work experience in business intelligence, data engineering, data warehousing, or a similar field.
• You have expert level experience with SQL and Python, with intermediate around Hive, Pig
• You remain active in learning emerging practices and technologies in the BI/DW and data science space.
• You are comfortable and confident in your knowledge of multiple database programming languages and your knowledge of relational and columnar databases.
• You have experience integrating data from multiple data sources and have processed large amounts of unstructured data.
• You have experience with Cloud technologies (AWS preferred), Big Data Components (Apache Spark, Hadoop, Presto, etc.), and Continuous Integration tools is desired, but not required.
Data Engineer Job Responsibilities:
• Provide significant contributions to the growth of our Data infrastructure
• Design, develop, test and deploy business intelligence solutions
• Design and document data structures/models and data flows
• Interact with various business units and technical teams to gather requirements
• Review, optimize and document current ETL processes
• Ensure data quality, completeness, and accuracy
• Collaborate with team members in code reviews, discovering better practices and patterns and continuous improvements