Note: The job is a remote job and is open to candidates in USA. Prolific is a leader in AI data collection, aiming to build the largest pool of quality human data. The role involves training and evaluating AI models by reviewing and rating AI-generated responses to engineering scenarios.
Responsibilities
- Reviewing AI-generated responses to engineering scenarios and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Skills
- Verified status as a Industrial engineer (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Company Overview
- Building the most advanced global infrastructure for People Science. It was founded in 2014, and is headquartered in London, England, GBR, with a workforce of 51-200 employees. Its website is https://www.prolific.com/.
Company H1B Sponsorship
- Prolific has a track record of offering H1B sponsorships, with 12 in 2025, 7 in 2024, 16 in 2023, 39 in 2022, 16 in 2021, 8 in 2020. Please note that this does not guarantee sponsorship for this specific role.