Sr Cloud Engineer - Gen AI

CompanyFederal Reserve Bank of San Francisco

When you join the SF Fed, you join a team of people working together to foster an inclusive economy that works for everyone. From data-driven insights to cloud transformation, the information technology team moves the SF Fed forward. We use innovative technologies and Agile methods to positively impact every American across the communities we serve.

The Federal Reserve Bank of San Francisco is looking for a Sr Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. We are a team based out of San Francisco that partners with business lines across the Federal Reserve System to deliver the cloud + big data engineering, advanced analytics products, and solutions. In this role, you will have the opportunity to contribute to several high-quality data solutions and enhance your technical skills across many disciplines. We employ state of the art technologies that are part of the AWS, Hadoop ecosystem, which includes tools used for data integration, data modeling, and data analytics. You will have an opportunity to apply your critical thinking and technical skills across many disciplines.

While the SF Fed is a Reserve Bank, we’re not what you might expect. We’re unreserved here. That means we seek new and diverse perspectives. We spark conversations and encourage debate. We build opportunity. We pursue careers that are true to ourselves. We are looking for people who want to help our country reach its full economic potential. When you join the SF Fed, you join a team of people working together to promote an inclusive economy that works for everyone.

We empower our people to balance their life and work responsibilities. That’s why we offer a flexible hybrid work model that allows you to collaborate with office colleagues on some days, and work from home on others.

Qualifications:

Bachelor’s degree in computer science, Information Systems, or other related technical field or equivalent work

Typically requires 7 or more years of experience in data engineering, data science, and software engineering.

Advanced knowledge of Amazon Web Services (AWS) and cloud infrastructure

Strong programming skills in Java or Python, or Scala

Design, build, and maintain machine learning data pipelines.

Experienced in implementing AI, Data and Advanced Analytics solutions, and SaaS or related experience in the Cloud.

Experience in developing an end-to-end AWS native platform for building Data lakes (S3, Glue (Crawlers, ETL, Catalog), IAM, CodePipeline, CodeCommit, CloudFormation/Terraform, CloudTrail, CloudWatch, AWS Config, Guard Duty, Secrets Manager, KMS, EC2, Data Visualization Tool: Tableau run on an EC2 or AWS Quicksight), Athena, AWS AI (Bedrock, SageMaker, Q)

Hands on experience in Generative AI implementation and optimization (HuggingFace, GPT, NLP, LLM)

Experience in Ansible/Terraform/Cloud Formation scripts and Infrastructure as Code scripting is required.

Experience deploying code on Cloud based Infrastructure, with AWS

Experience in Continuous Integration, Continuous Delivery, and Continuous Deployment software tools to support, enhance and grow our CI and CD capabilities.

Experience in Databricks, Alteryx, Collibra etc.,

Maintain security in accordance with Bank security policies.

Partner with business stakeholders to understand and meet their data requirements.

Lead and communicate to technical and business product managers, as well as third parties, on solution design.

Act as a role model, thought leader, and change management for new software and technology throughout the company.

Participate in an Agile development environment by attending daily standups and sprint planning activities.

Ability to work effectively independently or in a team environment.

Proven ability to write clear and concise communications: technical documents, design documents, specifications.

Must be a U.S. Citizen or a Green Card holder with the intent to become a U.S. Citizen

Responsibilities:

Builds next-generation AI & analytics framework developed on a group of core technologies.

Lead cross-functional teams in designing and implementing cloud-based data and AI solutions.

Ensure data pipelines are scalable, secure, and repeatable.

Collaborate with stakeholders to understand business requirements and turn data into insights.

Designs and creates visualizations to make data actionable and facilitates decision making for the customer.

Develop and maintain cloud infrastructure, including data lakes, warehouses, and analytics platforms.

Implement data governance and security best practices.

Sets standards and best practices, while encouraging other data engineers for input on possible ways to improve the system.

Influences the design of innovative solutions using new technologies.

Acts as a role model, thought leader, and change management for new software and technology throughout the company.

Drives continuous improvements with focus on quality, stability, usability, maintainability and ultimately customer satisfaction.

Works on multiple projects as a technical team member driving business requirements end to end

Takes end to end accountability of all data products and solutions.

Leads training bootcamps, & cross training workshops for internal & stakeholders.

Participates in pilots, Proof of Concepts and research on future data technologies and industry trends.

Desired Skills:

Background in data security, governance and cybersecurity solutions.

Domain experience in HR, Information Security, Finance, Business as IT

Experience with and/or working knowledge the Financial Industry, Government Agencies, Federal Reserve Bank Lines of Business (LoBs) Applications

Base Salary Range: Min: $138,900 - Mid: $180,400 - Max: $221,900 (Location: San Francisco)

Final salary and offer will be determined by the applicant’s background, experience, skills, internal equity, and alignment with market data.

We offer a wonderful benefits package including: Medical, Dental, Vision, Pre-tax Flexible Spending Account, Backup Child Care Program, Pretax Day Care Flexible Spending Account, Vacation Days, Sick Days, Paid Holidays, Pet Insurance, Matching 401(k), and a Retirement / Pension

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

At the Federal Reserve Bank of San Francisco, we believe in the diversity of our people, ideas, and experiences and are committed to building an inclusive culture that is representative of the communities we serve.

Full Time / Part TimeFull time

Regular / TemporaryRegular

Job Exempt (Yes / No)Yes

Job CategoryAnalytical

Work ShiftFirst (United States of America)

The Federal Reserve Banks believe that diversity and inclusion among our employees is critical to our success as an organization, and we seek to recruit, develop and retain the most talented people from a diverse candidate pool. The Federal Reserve Banks are committed to equal employment opportunity for employees and job applicants in compliance with applicable law and to an environment where employees are valued for their differences.

Privacy Notice

R-