Data Engineer II (LLM Evaluation Expert - Domain: Mathematics)
Apply NowCompany: Intelliswift
Location: Seattle, WA 98115
Description:
Job ID: 25-07529 Pay rate - $60/hr. to $65/hr. Bill rate
100% Remote
Key Responsibilities:
Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)
Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs
Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities
Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Compelling Story & Candidate Value Proposition
Being able to work on a team working to improve products in the client's family continuously.
Job Description:
As an LLM Evaluation Expert specializing in Mathematics, you will play a crucial role in assessing and improving our language models' mathematical capabilities.
Your expertise will be instrumental in evaluating LLM-generated mathematical solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted mathematical problem-solving.
Key Responsibilities:
Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)
Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs
Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities
Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Required Qualifications:
Advanced degree (Ph.D. preferred) in Mathematics, Applied Mathematics, or a closely related field
Extensive experience (5+ years) in mathematical research, problem-solving, or applied mathematics across multiple subfields
Demonstrated ability to critically evaluate mathematical proofs, solutions, and reasoning for correctness, efficiency, and elegance
Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
Excellent written and verbal communication skills, with the ability to explain complex mathematical concepts clearly
Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials
Preferred Qualifications:
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
Experience in creating or contributing to mathematical textbooks, research papers, or educational content
This role requires a unique blend of mathematical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world mathematical applications.
Your work will directly influence the development of next-generation AI mathematical assistants, potentially transforming fields such as scientific computing, data analysis, and mathematical research.
If you're passionate about mathematics, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing mathematical understanding and problem-solving, we encourage you to apply for this pivotal role at AGI Data Services.
looking for candidates with a very strong Math background.
A bachelors degree in Math or Masters's degree in Math or a similar demonstration of proficiency will be required.
100% Remote
Key Responsibilities:
Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)
Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs
Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities
Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Compelling Story & Candidate Value Proposition
Being able to work on a team working to improve products in the client's family continuously.
Job Description:
As an LLM Evaluation Expert specializing in Mathematics, you will play a crucial role in assessing and improving our language models' mathematical capabilities.
Your expertise will be instrumental in evaluating LLM-generated mathematical solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted mathematical problem-solving.
Key Responsibilities:
Critically analyze and evaluate mathematical responses generated by our LLMs across various fields of mathematics (e.g., algebra, calculus, statistics, number theory)
Exercise expert judgment to select the most appropriate and efficient mathematical solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous mathematical standards, are logically sound, and address specific research or application needs
Develop and write mathematical demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of mathematical concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's mathematical reasoning and problem-solving capabilities
Stay abreast of the latest developments in mathematics, mathematical software, and AI to ensure our evaluations remain cutting-edge
Required Qualifications:
Advanced degree (Ph.D. preferred) in Mathematics, Applied Mathematics, or a closely related field
Extensive experience (5+ years) in mathematical research, problem-solving, or applied mathematics across multiple subfields
Demonstrated ability to critically evaluate mathematical proofs, solutions, and reasoning for correctness, efficiency, and elegance
Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
Excellent written and verbal communication skills, with the ability to explain complex mathematical concepts clearly
Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials
Preferred Qualifications:
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
Experience in creating or contributing to mathematical textbooks, research papers, or educational content
This role requires a unique blend of mathematical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world mathematical applications.
Your work will directly influence the development of next-generation AI mathematical assistants, potentially transforming fields such as scientific computing, data analysis, and mathematical research.
If you're passionate about mathematics, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing mathematical understanding and problem-solving, we encourage you to apply for this pivotal role at AGI Data Services.
looking for candidates with a very strong Math background.
A bachelors degree in Math or Masters's degree in Math or a similar demonstration of proficiency will be required.