Post Job Free
Sign in

Senior AI Quality Analyst and Operations Lead

Location:
Wroclaw, Lower Silesian Voivodeship, Poland
Salary:
20/25$/hour
Posted:
May 08, 2026

Contact this candidate

Resume:

LEONARDO EVANGELISTI

Wrocław, Poland (EU Citizen) +48-512-***-*** ***********.********@*****.*** LinkedIn: https://www.linkedin.com/in/leonardo-evangelisti-56677a15b SENIOR AI QUALITY ANALYST — OPERATIONS LEAD

Senior AI Quality Analyst and Operations Lead, bridging the gap between rigorous technical QA and rapid organizational scaling.

Expertise in aligning global LLMs and architecting proprietary production pipelines that drastically reduce delivery times and stabilize large-scale operations for international studios, driving high- volume strategic directives for Tier-1 technology companies. CORE COMPETENCIES & TECHNICAL SKILLS

AI & Data: Reinforcement Learning from Human Feedback (RLHF), LLM Evaluation, Multimodal AI QA, Algorithmic Debugging, Data Quality Control, generative AI Pipelines. Operations & Leadership: Agile Project Management, KPI & AHT Optimization, Cross- Functional Leadership, Talent Acquisition, Process Standardization (SOPs), Bottlenecks. Software & Tools: Jira, Git/Fork Version Control, Hubstaff, Trello, Asana, Google Workspace, Advanced 3D/Technical Pipelines (Unreal Engine 5 + multiple 3D software). CORE EXPERIENCE

micro1 Remote, US

Senior AI Quality Reviewer & QA Lead (Contract) Sep 2025 – Present

• AI Quality Assurance: Advanced to a peer-review role, independently handling up to 5% of total project output across massive multimodal datasets (Text, Audio, Video) for Tier-1 Tech Companies.

• Process Optimization: Proposed KPI strategies advocating for compensated training time, successfully protecting AHT metrics, mitigating turnover risks, and helping to maximize team productivity and guidelines success.

• Algorithmic Debugging: Conducted advanced model evaluation, consistently interfacing with management to troubleshoot edge cases, aligning Large Language Models with complex human directives.

Invisible Technologies Remote, US

AI Data Quality Specialist / Multimodal Analyst (Contract) Aug 2025 – Present

• Large-Scale Evaluation: Evaluated and optimized thousands of AI-generated outputs, directly driving the alignment of leading tech global LLMs (under NDA).

• Efficiency & AHT Mastery: Consistently exceeded baseline productivity benchmarks

(100% efficiency via Hubstaff), frequently halving Average Handle Time while maintaining high quality standards.

• Systemic Error Tracking: Proactively isolated model hallucinations, delivering actionable, structured feedback to core engineering teams for core algorithm refinement. STRATEGIC LEADERSHIP - CONSULTING

Director of Operations & Project Lead (Consultant – Project-Based) Mortalis LLC Project Lead & T. QA Manager Oct 2025 – Apr 2026 Remote, Estonia o Executive Turnaround: Directed a 15+ cross-functional team within a 50+ person studio, improving the pipeline to streamline in months what was achieved in 6 years. o Agile Management & QA: Authored SOPs, managed global Jira boards, and acted as the final QA gatekeeper prior to implementation. o Talent Acquisition: Personally led recruitment and onboarding for the technical department, hiring over 12% of the company’s workforce during 2026. Raviosoft Studio Director & Creative QA Oct 2025 – Apr 2026 Remote, India o Organizational Scaling: Architected a scalable management hierarchy and multi- tier reporting system for an international studio of 80-100 concurrent contractors. o QA Pipeline Architecture: Implemented a rigorous Quality Assurance pipeline, delegating initial screening while serving as executive for enterprise-level standards. o Crisis Management: Centralized communication and acted as the primary mediator, and stabilized the workforce across a pool of 180 contractors. Indie Games LLC Project & AI Integration Lead Feb 2025 – Mar 2026 Remote, US o AI R&D Pipeline: Engineered a proprietary multi-model AI pipeline that enabled a team of 5 people to achieve the output of a 50-person department. o Agentic Prototyping: Partnered with Sapient AI to co-develop, QA test, and troubleshoot early-stage agentic AI prototypes.

o KPI Growth: Led an operational pivot that elevated the team from the lowest percentile up to the top 3 (15 competitors) + an 8x total reduction in projected time. TECHNICAL 3D & ENTERPRISE QA

Leartes Studios Technical 3D Specialist Remote, Turkey May 2025 – Present

• Enterprise QA: Produced digital assets adhering to extensive AAA technical documentation, achieving a consistent first-pass approval rate.

• Performance Optimization: Engineered scalable technical logic (Master Materials) and optimized assets to meet aggressive computing performance benchmarks. Visionary Realms Technical Environment Specialist Remote, US May 2022 – Jul 2024

• Extreme Optimization: Engineered large-scale environments for a massive multiplayer online (MMO) framework, actively managing memory logic and culling for server stability.

• Version Control: Managed multi-branch version control using Git/Fork, routinely debugging repository conflicts across a globally distributed team of professionals. EDUCATION & CERTIFICATIONS

• Google Project Management Certificate Google Issued on March 2026

• Bachelor’s Degree - Industrial Design University of Ferrara Graduated with Honors

• Think Tank Training Centre Vancouver Advanced 3D Art Average evaluation A/A



Contact this candidate