Senior Data Engineer

Senior Data Engineer

About Net Zero Insights

Net Zero Insights is a leading provider of market intelligence for the Net-Zero Economy, offering comprehensive insights, data, and research to climate innovation professionals worldwide. Our cutting-edge Net0 Platform provides access to thousands of startups/SMEs, deals, investors, market reports, and more, enabling users to discover new innovations, trends, and opportunities in the rapidly evolving world of climate technology. Learn more at:

At Net Zero Insights, our data infrastructure undergoes rapid daily growth due to the substantial volume of valuable information we gather. To sustain the seamless operation of this expanding database, we are actively searching for a highly skilled Python expert to join our team as a team leader. The successful candidate will manage our team of two data engineers, organise and assign tasks on Jira, and ensure a clean and efficient workflow.

Candidates must have experience in both programming and team management, as well as strong communication skills, which are crucial for this role.

Your responsibilities

Software Development: Write, test, and maintain Python code to create and enhance software applications, APIs, and data processing pipelines.

Documentation: Maintain up-to-date and clear documentation for all processes, code, and systems to ensure easy knowledge transfer and system understanding.

Database Management: Design and interact with databases using Python libraries and tools to store and retrieve data efficiently.

Data Processing: Implement data processing algorithms and workflows in Python to manipulate, clean, and analyze data from various sources.

Automation: Develop Python scripts and tools to automate repetitive tasks and improve overall efficiency in the company's processes.

Integration and APIs: Work with external APIs to integrate third-party services into the company's applications or extract data from external sources (such as ChatGPT)

Code Optimization and Performance: Identify and improve areas of code that require optimization for better performance and scalability.

Testing and Debugging: Write unit tests and debug code to ensure the reliability and quality of software applications.

Requirements

Professional Experience: 3-4 years of professional experience with Python, preferably in a company similar to ours (e.g., Beauhurst, Crunchbase).

Jira: Advanced knowledge in Jira for task management and organization.

GenAI: Advanced knowledge of the latest GenAI technologies (e.g., ChatGPT)

SQL Server: Advanced knowledge of SQL Server.

Cloud Infrastructure: Indeterminate knowledge of cloud infrastructure, including AWS and Azure.

Bitbucket: Advanced knowledge of Bitbucket.

Communication Skills: EXCELLENT communication skills - this requirement is a MUST!

Management and Organizational Skills: Excellent management and organizational skills - this requirement is crucial.

Python Servers: Ability to set up Python servers(FastAPI, Flask).

Language Proficiency: Advanced proficiency in both written and spoken English is required.

Lead the full development lifecycle of projects.

Compensation and benefits

Competitive salary

Stock options

Days off: to be determined based on the candidate's years of experience

Team-building activities.

Employee perks.