Job Description
We are sharing a specialised part-time consulting opportunity for PhD-level mathematicians interested in contributing to the evaluation and improvement of advanced AI systems.
This role supports collaborations with leading AI labs focused on improving how conversational AI models reason about mathematical concepts, proofs, and problem-solving processes.
Experts will evaluate AI-generated responses to mathematical questions, ensuring rigorous reasoning, conceptual accuracy, and clear explanations aligned with academic mathematical standards.
Key Responsibilities
Write and refine prompts to guide AI model behavior in mathematical contexts
Evaluate AI-generated responses for correctness, logical consistency, and rigor
Verify mathematical claims, derivations, and proofs using domain expertise
Conduct fact-checking using authoritative mathematical sources
Annotate model responses by identifying strengths, weaknesses, and inaccuracies
Assess clarity, structure, and pedagogical quality of explanations
Apply structured evaluation guidelines and benchmarking standards
Ensure model responses align with expected reasoning quality and system guidelines
Ideal Profile
Strong candidates will have:
PhD in Mathematics or a closely related field
Expertise in one or more areas such as:
Probability & Statistics
Algebra & Number Theory
Calculus & Analysis
Geometry & Topology
Discrete Mathematics, Logic & Computation
Additional qualities include:
Experience working with large language models (LLMs)
Excellent technical writing and explanation skills
Strong analytical reasoning and mathematical rigor
Ability to identify subtle conceptual or logical issues in mathematical arguments
Location Requirements
Candidates should be based in one of the following regions:
United States
United Kingdom
Canada
European Union
Nice-to-Have Experience
Experience with RLHF, model evaluation, or AI data annotation
Experience teaching or mentoring mathematics
Familiarity with evaluation rubrics or structured review frameworks
Experience reviewing or editing academic or technical writing
Why This Opportunity
Contribute directly to improving the mathematical reasoning of advanced AI systems
Apply deep theoretical expertise to real-world AI development
Work with cutting-edge AI research teams
Flexible remote work with competitive compensation
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Compensation: $73.29/hr
Weekly payments via Stripe or Wise
Projects may extend depending on performance and project needs
About the Platform
This opportunity is available through a leading AI-driven work platform.
Part-time
Hybrid remote