Permanent

Prompt Evaluation Reviewers

Posted on 21 March 24 by Jordyn Knoll

  • Toronto, ON
  • $54000 - $
Logo

Powered by Tracker

Job Description

Our client, a leading data engineering company is looking for MULTIPLE Prompt Evaluation Reviewers for PERMANENT positions.

  • Seeking 10 Thai/English Prompt Evaluators
  • Seeking 10 Indonesian/English Prompt Evaluators
  • Seeking 10 Vietnamese/English Prompt Evaluators
Schedule:
  • Monday - Friday (preference for those able to work EST hours)

100% REMOTE ANYWHERE IN CANADA - This is an assignment that can be worked from the comfort of your home 

As a Prompt Evaluation Reviewer, you will be tasked to evaluate prompt responses for quality and accuracy, as well as ensure that they are helpful, relevant, and concise.

Responsibilities

· Evaluate a prompt response and assess them according to a set of client-mandated standards and metrics that includes accuracy, relevance, and helpfulness.

· Conduct in-depth research to gather precise and relevant information to provide an accurate response.

· Ensure the accuracy, coherence, and clarity of a prompt response.

· Provide constructive feedback and valuable insight regarding techniques and strategies for writing responses.

· Keep abreast of the latest trends and advancements in different subject areas to ensure quality and relevant responses.

· Contribute to the continuous improvement of our language model by identifying potential areas of enhancement and suggesting new prompt ideas.

· Collaborate with other SMEs to maintain consistency and quality across the prompt generation process.

Requirements

· English AND any of the following languages at a native or advanced level (Thai, Indonesian, Vietnamese)

· Ideally a Degree in English and/or their native language, Journalism or other related courses.

· Work experience in the native language will be considered beneficial.

· Should be fluent in Native language proficiency, English should also be good.

· Should be open to extended work hours.

· Familiarity and knowledge of various writing and art styles, as well as domains.

· Deep understanding of how AIs, MLs, LLMs, and NLPs work is considered an asset

· Demonstrate ability to generate clear, concise, and engaging content.

· Strong research skills and ability to gather information from credible sources.

· Native Language proficiency, with excellent written communication skills.

· Strong research skills and ability to gather information from credible sources.

· Ability to work independently and meet deadlines.

· Attention to detail and commitment to delivering high-quality work.

· Flexibility to adapt to changing project requirements and priorities.

· Collaborative mindset and willingness to work with a multidisciplinary team.

· Own a laptop with a secure internet connection.

Job Information

Rate / Salary

$54000 - $

Sector

IT Managed Services

Category

Not Specified

Skills / Experience

Not Specified

Benefits

Not Specified

Our Reference

JOB-14371

Job Location