Bilingual Evaluator - Fully Remote | Upto $50/hr
mercor
Source: Himalayas ↗
Location & working arrangement
Working arrangement is supplied by the provider. Check the original advert for attendance and travel requirements.
Provider location / applicant eligibility: United Kingdom
About the role
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Dutch Audio Generalist Evaluator ExpertType:ContractCompensation:$50/hourLocation:RemoteDuration:3–6 months
Role Responsibilities
Transcribe audio and video with precision in Dutch and English. Ensure adherence to multiple constraints and instructions.
Define and document evaluation standards for consumer audio contexts. Develop comprehensive rubrics and guidelines in Dutch and English.
Conduct model testing by running prompts and assessing outputs against expectations.
Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor.
Maintain consistency and reliability before integration into official benchmarks. Work independently and meet deadlines.
Qualifications
Must-Have
Strong writing and critical thinking skills
Ability to work independently and meet deadlines
Fluent in Dutch and English
Able to work within GMT or PST working hours
Preferred
College students or graduates
Application Process (Takes 20–30 mins to complete)
Complete an AI-led interview (approximately 15 minutes)
If selected, you will be invited to work on the project
Resources & Support
For details about the interview process and platform information, please check:
For any help or support, reach out to:
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Originally posted on Himalayas
Skills mentioned in the listing
Quality assurance
Recognised skills are extracted from the supplied description using canonical names and aliases. They are mentions, not verified essential requirements. Check the source advert for the employer’s full requirements and location restrictions.
Why these skills appear
Quality assurance · mentioned
g prompts and assessing outputs against expectations. Support benchmarking and quality assurance. Collaborate in QA review processes to ensure high standards of rigor. Maintain consistency and reliability before integr