Statistician (AI & Psychometrics Rasch Model)

Astrom Training Solutions Inc. is a prominent and forward-thinking leader in the aviation industry, specializing in the provision of state-of-the-art training solutions that cater to the evolving demands of both commercial and private aviation sectors. Renowned for its pioneering approach, the company has been recognized by governmental bodies and awarded grant each year for its innovative development of cutting-edge pilot training programs. These programs incorporate the latest technological advancements, offering unparalleled training in operational safety, flight performance, and efficiency.

Job Title: Statistician (AI & Psychometrics – Rasch Model)

Location: Vancouver (or Remote)

Department: Data Science / Training Technology

Reports to: Head of Product / CTO

Role Overview

We are seeking a Statistician with strong knowledge of AI and Rasch modeling to support the development of an intelligent, adaptive examination and learning system.

This role will focus on assessment design, psychometric modeling, and data-driven insights, enabling accurate measurement of learner competency and supporting adaptive learning features in our LMS.

Key Responsibilities

1. Psychometric Modeling (Core Focus)

• Design and implement Rasch models for assessment calibration and validation

• Analyze item difficulty, discrimination, and learner ability

• Ensure reliability and validity of examination results

• Support competency-based assessment frameworks

2. Adaptive Assessment Support

• Define statistical logic for:

o Dynamic difficulty adjustment

o Question sequencing based on performance

• Identify patterns in incorrect responses to detect knowledge gaps

• Support AI-driven probing and clarification question strategies

3. Data Analysis & Insights

• Analyze learner performance data to identify:

o Skill gaps

o Learning trends

o Competency progression

• Build statistical models to support proficiency scoring

• Validate and improve recommendation logic for learning pathways

4. Collaboration with AI & Engineering Teams

• Translate statistical models into implementable system logic

• Work with developers to integrate psychometric models into the platform

• Support development of dashboards and reporting metrics

Key Qualifications

Experience

• ~3 years of experience in statistical analysis, data science, or psychometrics

• Experience working with assessment data or educational/testing systems is a strong asset

Technical Skills

• Strong understanding of:

o Rasch Model / Item Response Theory (IRT)

o Statistical modeling and hypothesis testing

• Proficiency in tools such as:

o Python (preferred), R, or similar statistical tools

• Familiarity with:

o Machine learning basics

o Data visualization and reporting

Skills

• Strong analytical and problem-solving ability

• Ability to translate statistical findings into practical applications

• Attention to detail in model validation and data quality

• Clear communication with technical and non-technical teams

Preferred Qualifications

• Experience in learning systems (LMS), CBT, or training environments

• Exposure to adaptive testing or AI-driven assessment systems

• Understanding of competency-based training frameworks

Success Metrics

• Reliable and validated assessment models (Rasch-based)

• Accurate measurement of learner ability and competency gaps

• Improved effectiveness of adaptive examination logic

• Actionable insights from learner performance data