Research Scientist II (LLM Evaluation Expert - Domain: Physics)
Apply NowCompany: Intelliswift
Location: Seattle, WA 98115
Description:
Job ID: 25-07920 100% Remote
Pay rate range $45/hr. to $48/hr. on W2
Must Have
Advanced degree (Ph.D. preferred) in Physics or a closely related field
Extensive experience (5+ years) in Physics research, problem-solving, or applied Physics across multiple subfields
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Job Description:
Company Overview:
Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs).
Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Job Description:
As an LLM Evaluation Expert specializing in Physics, you will play a crucial role in assessing and improving our language models' Physics capabilities.
Your expertise will be instrumental in evaluating LLM-generated Physics solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted Physics problem-solving.
Key Responsibilities:
Critically analyze and evaluate Physics responses generated by our LLMs across various fields of Physics
Exercise expert judgment to select the most appropriate and efficient Physics solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous Physics standards, are logically sound, and address specific research or application needs
Develop and write Physics demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Physics concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities
Stay abreast with the latest developments in Physics and AI to ensure our evaluations remain cutting-edge
Using your expertise, to provide step-by-step solutions and explanations to complex problems in Physics. This could include solving problems related to projectile motion, electromagnetic fields, wave interference, energy conservation, and relativity etc.
Required Qualifications:
Advanced degree (Ph.D. preferred) in Physics or a closely related field
Extensive experience (5+ years) in Physics research, problem-solving, or applied Physics across multiple subfields
Demonstrated ability to critically evaluate Physics proofs, solutions, and reasoning for correctness, efficiency, and elegance
Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
Excellent written and verbal communication skills, with the ability to explain complex Physics concepts clearly
Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials
Preferred Qualifications:
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
Experience in creating or contributing to Physics textbooks, research papers, or educational content.
This role requires a unique blend of Physics expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world applications in Physics. Your work will directly influence the development of next-generation AI Physics assistants, potentially transforming fields such as scientific computing, data analysis, and Physics research.
If you're passionate about Physics, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing the understanding of Physics we encourage you to apply for this pivotal role at AGI Data Services.
Pay rate range $45/hr. to $48/hr. on W2
Must Have
Advanced degree (Ph.D. preferred) in Physics or a closely related field
Extensive experience (5+ years) in Physics research, problem-solving, or applied Physics across multiple subfields
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Job Description:
Company Overview:
Artificial General Intelligence (AGI) Data Services is at the forefront of AI innovation, specializing in the development and refinement of large language models (LLMs).
Our mission is to create AI systems that can understand and generate high-quality code, revolutionizing the software development landscape.
Job Description:
As an LLM Evaluation Expert specializing in Physics, you will play a crucial role in assessing and improving our language models' Physics capabilities.
Your expertise will be instrumental in evaluating LLM-generated Physics solutions, making high-level judgments, and setting the standard for what constitutes excellent AI-assisted Physics problem-solving.
Key Responsibilities:
Critically analyze and evaluate Physics responses generated by our LLMs across various fields of Physics
Exercise expert judgment to select the most appropriate and efficient Physics solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected solutions meet rigorous Physics standards, are logically sound, and address specific research or application needs
Develop and write Physics demonstrations to illustrate "what good looks like" in AI-generated solutions, setting benchmarks for accuracy, elegance, and insight
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output of Physics concepts
Collaborate with the AI research team to identify areas for improvement in the LLM's reasoning and problem-solving capabilities
Stay abreast with the latest developments in Physics and AI to ensure our evaluations remain cutting-edge
Using your expertise, to provide step-by-step solutions and explanations to complex problems in Physics. This could include solving problems related to projectile motion, electromagnetic fields, wave interference, energy conservation, and relativity etc.
Required Qualifications:
Advanced degree (Ph.D. preferred) in Physics or a closely related field
Extensive experience (5+ years) in Physics research, problem-solving, or applied Physics across multiple subfields
Demonstrated ability to critically evaluate Physics proofs, solutions, and reasoning for correctness, efficiency, and elegance
Strong analytical and decision-making skills, with the ability to make complex judgments in abstract and theoretical contexts
Excellent written and verbal communication skills, with the ability to explain complex Physics concepts clearly
Experience in technical writing, particularly in creating mathematical proofs, explanations, or tutorials
Preferred Qualifications:
Previous experience working with or evaluating AI systems, particularly in the context of mathematical problem-solving
Familiarity with computer algebra systems, numerical computing environments, and mathematical software packages
Understanding of machine learning concepts, particularly as they apply to mathematical reasoning and problem-solving
Experience in creating or contributing to Physics textbooks, research papers, or educational content.
This role requires a unique blend of Physics expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world applications in Physics. Your work will directly influence the development of next-generation AI Physics assistants, potentially transforming fields such as scientific computing, data analysis, and Physics research.
If you're passionate about Physics, have a keen eye for elegant solutions, and are excited about the potential of AI in advancing the understanding of Physics we encourage you to apply for this pivotal role at AGI Data Services.