Job Description

Role Overview

Apply social science research expertise to help train and benchmark next-generation AI systems through complex, realistic evaluation tasks grounded in professional research practice. This remote contract role focuses on creating rigorous research scenarios, artifacts, and assessment materials. Prior AI experience is not required.

Key Responsibilities

• Design and author complex evaluation tasks based on real-world social science research, including survey analysis, qualitative coding, literature reviews, and statistical analysis.
• Source, synthesize, and create realistic research artifacts such as survey instruments, coded datasets, statistical outputs, and source documents.
• Select appropriate methodologies and provide clear, defensible interpretations consistent with social science best practices.
• Create comprehensive grading rubrics with 35 or more items to assess methodological decisions, execution fidelity, and interpretation quality.
• Ensure tasks reflect the nuance of advanced day-to-day research rather than simplified textbook exercises.
• Collaborate asynchronously with project leads and reviewers to refine tasks, data, and evaluation frameworks.
• Maintain rigorous, detailed, transparent, accurate, and reproducible work across all deliverables.

Qualifications

• Bachelor''s or Master''s degree in sociology, economics, psychology, political science, or a related social science discipline.
• At least 2 years of hands-on experience with survey instrument design, qualitative data coding, literature reviews, and statistical software such as SPSS, R, or Stata.
• Strong methodological rigor, source synthesis skills, research mastery, and the ability to develop or apply detailed grading rubrics and evaluation guidelines.
• Ability to construct well-documented data artifacts from diverse research sources.
• Comfort with detailed, methodical research assignments involving multiple data types and sources.
• Proficient written English for technical research content and evaluation materials.

Work Terms

• Remote, independent contractor engagement.
• Compensation is output-based and paid for each task that meets project specifications. Completion time may vary based on experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks submitted each week.
• Selected candidates should be ready to begin their first tasks within 24 to 48 hours after completing onboarding.

Compensation

$30 to $50 per hour.

Job Tags

Similar Jobs