LLM Data Quality & Annotation Analyst

MUHAMED BADHUSHA S

AI Data Quality Analyst LLM Evaluation & Annotation Specialist

***************.*@*****.*** • +91-628******* • Palakkad, Kerala • LinkedIn • GitHub SUMMARY

Data Quality Analyst with hands-on production experience evaluating LLM outputs, structured annotation, and RLHF response ranking at Innodata, backed by prior QA/overtime work reviewing labeling accuracy. Combines strong attention-to-detail annotation instincts with SQL, Python, and dashboarding skills — able to both execute high-volume review work and build the QA frameworks/metrics that track accuracy, rejection rate, and throughput. Seeking a remote contract AI training, data annotation, or QA analyst role. EXPERIENCE

LLM Analyst (Data Annotation & QA) Innodata Inc. (Remote) Nov 2025 – Jul 2026

● Evaluate LLM outputs for accuracy, coherence, and safety across production AI systems; perform structured annotation and response ranking to support RLHF fine-tuning pipelines.

● Applied prompt-based evaluation and NLP techniques to surface edge cases and bias patterns; maintained QA frameworks and guideline adherence checks for training data quality.

● Worked overtime in a Quality Analyst capacity — auditing peer annotations against rubric standards, flagging inconsistencies, and helping tighten labeling guidelines to reduce rejection rate. Data Analyst Intern Unified Mentor (Remote) Mar 2025 – Sep 2025

● Delivered 6 end-to-end analytics projects across supply chain, financial markets, global health, and pharma domains — from raw data ingestion through to reporting.

● Built Power BI dashboards using star schema models and DAX; processed 5GB+ datasets in Snowflake with optimized SQL; automated reporting workflows using Python (Pandas, Matplotlib).

● Developed a Snowflake Python UDF for sentiment classification achieving 90% accuracy on a labeled validation set across 1M+ Yelp reviews — direct experience validating model output quality against ground truth. Sub Engineer Kerala State Electricity Board Aug 2024 – Mar 2025

● Conducted infrastructure fault detection and produced technical documentation for internal project tracking — early grounding in methodical inspection and structured reporting.

RELEVANT SKILLS

AI / Annotation / QA: LLM output evaluation, RLHF response ranking, structured data annotation, rubric-based QA auditing, guideline adherence review, edge-case & bias surfacing, prompt-based evaluation SQL & Databases: PostgreSQL, Snowflake — window functions, CTEs, subqueries, views, query optimization Python: Pandas, NumPy, Matplotlib, Scikit-learn, TextBlob, REST API integration BI & Visualization: Power BI (DAX, star schema, drill-through), Tableau, Excel Platforms & Tools: Snowflake, PostgreSQL, Git, DBeaver, Streamlit, data modeling PROJECTS

Yelp Business Intelligence Python · Snowflake · SQL · TextBlob GitHub

● Processed 5GB+ semi-structured JSON in Snowflake; built Python UDF for sentiment classification validated at 90% accuracy across 1M+ reviews — annotation/labeling validation at scale. Supply Chain Analytics Dashboard PostgreSQL · SQL Views · Power BI · DAX GitHub

● Designed 8 SQL views feeding a star schema Power BI model across 5 dashboard pages; built DAX KPIs including Availability Rate and Inspected Units % — QA/inspection-style metrics. Spotify Real-Time Dashboard Python · Spotify API · PostgreSQL · Power BI GitHub

● Built a full-stack analytics pipeline extracting live music data via the Spotify API, loading into PostgreSQL, and visualizing in an interactive Power BI dashboard.

Also: Stock Market Analysis (PostgreSQL) • Life Expectancy Study (SQL + Power BI, 100K+ WHO records) • Bank Loan Risk Analysis (Excel) EDUCATION & CERTIFICATIONS

BTech, Electrical and Electronics Engineering — Kerala Technical University (2020 – 2024) Certifications: Data Analyst Essentials • Data Engineering Foundations • Project Management Foundations

Contact this candidate