This role directly contributes to improving world-class AI systems through high-quality automation, DevOps, and infrastructure scripting expertise.
Key Responsibilities
Review and evaluate AI-generated Bash and PowerShell scripts for correctness, clarity, safety, performance, and portability
Analyze step-by-step reasoning and troubleshooting workflows behind automation solutions
Identify logical errors, edge cases, security risks, and inaccuracies in scripts
Write expert-level explanations and model solutions demonstrating best practices
Compare, rate, and rank multiple AI responses based on correctness and reasoning quality
Create detailed prompts and responses for AI training across automation topics
Fact-check technical content and validate accuracy
Test AI outputs for reliability, bias, and real-world usability
Required Qualifications
Expert-level proficiency in Bash and/or PowerShell scripting
2–3+ years of hands-on scripting and automation experience
Strong ability to write, debug, and maintain shell or object-based scripts
Experience evaluating scripts for safety, readability, performance, and portability
Background in Software Engineering, DevOps, IT Automation, or Infrastructure roles
Bachelor’s degree in Computer Science or a closely related technical field
Experience using LLMs for coding, troubleshooting, or reviewing scripts
Excellent written and spoken English communication skills
Preferred Qualifications
Bash tools expertise: awk, sed, grep
PowerShell experience with PowerShell Core, DSC, and Azure PowerShell
Familiarity with CI/CD pipelines, DevOps workflows, and cloud automation
Contributions to open-source CLI, DevOps, or infrastructure projects
Previous AI data training or model evaluation experience
Minimum C1 English proficiency
Why Join SME Careers
Fully remote contract role (U.S.-based)
Competitive hourly compensation up to $55/hour
Work with leading AI companies and foundation model labs
Flexible schedule and high-impact technical work
fullTime