Databricks AI Engineer

Role- Databricks AI Engineer

This person will be responsible for training and enabling the use of the Databricks Genie AI Agent (Prompt-To-SQL tool)

Key Responsibilities:

Genie AI Agent Configuration & Training- Experience with Databricks

Genie AI Agent setup and workspace creation, Ability to configure Genie using system prompts, instructions and sample queries.

Text to SQL and Text to Code skills

Train and support stakeholders across departments in adopting and effectively utilizing the Genie agent.

Collaborate with business users to understand domain-specific data and ensure Genie delivers meaningful insights.

Fine-tune and optimize the Databricks Genie AI Agent to improve its performance for diverse business scenarios.

Unity Catalog Integration & Governance- Deep understanding of Unity Catalog for managing Data assets, Access policies, and Lineage tracking.

Ability to link Genie with Unity Catalog to ensure secure, governed access to tables, views, and models.

Integrate Genie with the organizations utility catalog and ensure its consistent use as a knowledge base.

Develop documentation, playbooks, and training materials to enable self-service Genie adoption.

Act as the bridge between technical teams and business stakeholders, translating requirements and feedback into improvements for the AI agent.

Monitor performance and iterate on agent capabilities to align with evolving business needs. Utilize user feedback loop to improve Genie.

Required Skills & Qualifications:

3+ years of experience working with Databricks and large-scale data platforms.

Hands on experience with SQL, RDBMS, programming language including Python, user defined functions (UDFs) and data visualization tools.

Familiarity with Databricks Genie, MLflow, Unity Catalog, or other Databricks-native tooling, and how they interface with AI agents.

Familiarity with Prompt engineering and LLMs (Large Language Models) and their application within enterprise environments.

Excellent communication and collaboration skills able to guide non-technical stakeholders and lead workshops.

Comfortable working in fast-paced, cross-functional teams.