Job Description
Note: The job is a remote job and is open to candidates in USA. Prolific is a leading company in the AI space focused on building a vast pool of quality human data. They are seeking Concierges to train and evaluate AI models, where successful candidates will be invited to participate as Domain Experts and help enhance the performance of AI systems.
Responsibilities
- Reviewing AI-generated responses to scenarios a Concierge would face and rating them for accuracy, appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Skills
- Verified status as a Concierge (e.g., by providing a professional profile that shows both educational and professional experience)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Benefits
- Flexible hours
- Ability to work from home
Company Overview
Company H1B Sponsorship
Apply To This Job