Machine Learning Engineer

Date Posted: 04/10/2025

Hiring Organization: Rose International

Position Number: 481050

Job Title: Machine Learning Engineer

Job Location: Atlanta, GA, USA, 30328

Work Model: Hybrid

Shift:

8 am to 5 pm CST

Onsite 3 days per week

Two

Locations: Minneapolis, MN and Atlanta, GA

Employment Type : Temporary

Estimated Duration (In months): 6

Min Hourly Rate : 70.00

Max Hourly Rate : 80.00

Must Have Skills/Attributes: Artificial Intelligence (AI), Azure, Banking/Financial, Cloud, Machine Learning

Job Description

Required Skills/ Experience & Education:

• Fiddler tool (3-5 years)

• Lumenova tool (3-5 years)

• Azure/cloud knowledge (3-5 years)

• AI use case implementation (3-5 years)

Details:

To effectively monitor using Fiddler AI or Lumenova tools implemented use cases, key skills include:

• Understanding AI model metrics, data analysis, statistical knowledge, familiarity with bias detection techniques, prompt engineering, LLM specific monitoring capabilities, visualization skills, and the ability to interpret model explanations to identify potential issues like hallucinations, safety violations, and data drift; all while being able to leverage Fiddler AI s or Lumenova features for comprehensive monitoring and analysis across different AI applications

Specific skills to focus on when monitoring Fiddler AI and Lumenova AI tools:

Model performance metrics:

1. Accuracy, precision, recall, F1-score, perplexity, BLEU score (depending on the AI task)

2. Monitoring changes in these metrics over time to detect model drift

Data analysis:

1. Identifying patterns and anomalies in input data and model outputs

2. Analyzing data distributions to detect potential biases

Bias detection:

1. Understanding protected attributes and how to assess bias across different demographic groups

2. Utilizing Fiddler's fairness metrics like disparate impact and equal opportunity

Prompt engineering:

1. Crafting effective prompts to test model behavior and identify potential issues

2. Understanding how different prompts can influence model responses

LLM specific monitorin g:

1. Identifying and mitigating hallucinations (generated text that is factually incorrect)

2. Detecting safety violations like toxic language or personal information leaks

3. Monitoring for prompt injection attacks

Visualization skills:

1. Creating dashboards and visualizations to effectively communicate model performance and potential issues

2. Using tools like 3D UMAP to identify clusters and patterns in data

Model explainability:

1. Interpreting model explanations provided by Fiddler to understand why a model made a certain prediction

2. Utilizing these explanations to identify areas for model improvement

Fiddler AI or Lumenova platform knowledge:

1. Familiarity with Fiddler's / Lumenova features like data ingestion, model monitoring, bias detection, and root cause analysis

Azure/cloud knowledge:

1. Maintain/debug the cloud platform stack, working with the cloud engineers, and work with vendors to upgrade the software, and debug user issues

Only those lawfully authorized to work in the designated country associated with the position will be considered.

Please note that all Position start dates and duration are estimates and may be reduced or lengthened based upon a client's business needs and requirements.

Benefits:

For information and details on employment benefits offered with this position, please visit here. Should you have any questions/concerns, please contact our HR Department via our secure website.

California Pay Equity:

For information and details on pay equity laws in California, please visit the State of California Department of Industrial Relations' website here.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender (expression or identity), national origin, arrest and conviction records, disability, veteran status or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

If you need assistance in completing this application, or during any phase of the application, interview, hiring, or employment process, whether due to a disability or otherwise, please contact our HR Department.

Rose International has an official agreement (ID ), effective June 30, 2008, with the U.S. Department of Homeland Security, U.S. Citizenship and Immigration Services, Employment Verification Program (E-Verify). (Posting required by OCGA 13/10-91.).

Job Types: Full-time, Temporary

Pay: $70.00 - $80.00 per hour

Benefits:

401(k) matching

Dental insurance

Health insurance

Health savings account

Vision insurance

Schedule:

8 hour shift

Monday to Friday

Application Question(s):

How many years of experience do you have in Machine Learning / AI Engineering?

Do you have 3-5 years of Fiddler tool experience?

Do you have 3-5 years of Lumenova tool experience?

Are you authorized to work on Rose International's W2 without sponsorship?

Experience:

Fiddler tool: 3 years (Required)

Ability to Commute:

Atlanta, GA 30328 (Required)

Work Location: In person

Permanent