Cloudsufi - GCP Data Engineer - SQL/BigQuery

About Us : CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries.

We firmly believe in the power of data to transform businesses and make better decisions.

We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services.

We partner with our customers to monetize their data and make enterprise data dance.

Our Values : We are a passionate and empathetic team that prioritizes human values.

Our purpose is to elevate the quality of lives for our family, customers, partners, and the community.

Equal Opportunity Statement CLOUDSUFI is an equal-opportunity employer . We celebrate diversity and are committed to creating an inclusive environment for all employees.

All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation and national origin status.

We are dedicated to providing equal opportunities in employment, advancement, and all other areas of our workplace.

What we are looking for : CLOUDSUFI is seeking a GCP Data Engineer - Dataform.

In this role, you will spearhead the development and management of data pipelines and analytics solutions on GCP, ensuring they meet and surpass customer expectations.

Your responsibilities will encompass overseeing the entire data engineering process, from quality planning to defect management, while leading a talented team of data engineers.

Your expertise will be crucial in defining and implementing testing strategies, driving process improvements, and mitigating risks to ensure the reliability, accuracy, and performance of data processes.

With your strong communication skills, you will effectively report project status, quality metrics, and issues to stakeholders, ensuring alignment and transparency.

If you're passionate about leveraging GCP for innovative data solutions and thrive in a dynamic environment, join us and make a significant impact on transforming data into actionable insights at CLOUDSUFI.

Responsibilities : Oversee and manage the entire data engineering process within a project on Google Cloud Platform (GCP). Play a crucial role in ensuring that the final data solution meets or exceeds customer expectations.

Develop and implement quality planning strategies for data pipelines and analytics solutions.

Lead and manage a team of data engineers, ensuring efficient collaboration and high-quality output.

Define and implement testing strategies for data pipelines and analytics solutions.

Design and execute tests to ensure the reliability, accuracy, and performance of data processes.

Manage defects and issues in data pipelines, ensuring timely resolution and minimal impact on data integrity.

Drive process improvements in data engineering workflows to enhance efficiency and quality.

Identify and mitigate risks related to data engineering processes and solutions.

Generate reports and effectively communicate project status, quality metrics, and issues to Experience : Education : - Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.

- Advanced degrees (Master's, PhD) can be advantageous but are not always necessary.

Experience : - Previous experience as a data engineer or a related role is typically required, preferably within a cloud environment.

- Hands-on experience with implementing data solutions using GCP services.

Skills : Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.

Proficiency in Google Cloud Platform (GCP) services, particularly those related to data engineering such as BigQuery, Dataflow, Cloud Storage, Cloud Pub/Sub, and Data Catalog.

Strong understanding of SQL for data manipulation and querying in BigQuery.

Experience with data modeling concepts and techniques.

Familiarity with version control systems like Git.

Knowledge of Dataform or other data orchestration and modeling tools is highly desirable.

Proficiency in programming languages commonly used in data engineering such as Python, Java, or Scala.

Experience with scripting languages like Bash for automation tasks.

Understanding of software engineering best practices, including code optimization, testing, and debugging.

Solid understanding of data warehousing concepts and methodologies.

Experience in designing, building, and optimizing ETL (Extract, Transform, Load) pipelines.

Knowledge of data governance and compliance standards.

Ability to work with structured and unstructured data formats.

Hands-on experience with implementing data solutions using GCP services.

Experience in developing and maintaining scalable and reliable data pipelines.

Familiarity with agile development methodologies and practices.

Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.

Strong communication skills with the ability to collaborate effectively with cross-functional teams including data scientists, analysts, and business stakeholders.

Adaptability and willingness to learn new technologies and methodologies.

Attention to detail and a commitment to producing high-quality work.

Project management skills to effectively prioritize tasks and meet deadlines.

Behavioral Competencies : Must have worked with US/Europe based clients in onsite/offshore delivery model, Should have very good verbal and written communication, technical articulation, listening and presentation skills Should have proven analytical and problem-solving skills Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills Should be a quick learner, self-starter, go-getter and team player Should have experience of working under stringent deadlines in a Matrix organization structure Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations (ref:hirist.tech)