NLP Annotation Judge

What are we looking for in our NLP Annotation Judge?

Russell Tobin & Associates is currently seeking an NLP Annotation Judge, 10 Months Contract role for one of our Fortune 500 clients, at Remote, PST Hours. Apply today for immediate consideration.

Hourly Pay: $17 to $20 W2

Location: Remote, PST Hours

Duration: 10 Months Contract until Jul 2025

Major responsibilities:

• Review and/or evaluate annotated data to ensure it meets quality standards and project requirements.
• Collaborate with internal teams to optimize model performance based on annotated data.
• Help develop and maintain annotation guidelines and best practices.
• Annotate training data to establish Ground Truth data.
• Identify gaps in training content and suggest improvements.

Basic Qualifications:

• Excellent attention to detail and analytical skills.
• Enthusiasm for the AI space and willingness to learn.
• Ability to work in ambiguous situations.
• Ability to work effectively in a collaborative team environment.

Preferred Qualifications              

• Experience or affinity for linguistics.
• Experience with copywriting, UX authoring, content development around voice and brand guidelines.
• Experience following complex processes.
• Ability to work both independently and with a team to achieve a goal.

Bonus Qualifications

• Bachelor's degree in English, Linguistics or a related field.
• Experience with Machine-generated Speech evaluation, Prompt Engineering, Search Results Evaluation, Search Query Categorization
• Experience with tools and software used for NLP annotation is a plus. 

Russell Tobin is a leading minority-owned professional and technical recruitment and staffing advisory organization. We are comprised of specialized practices focusing on a variety of skill sets and industries. Having a depth and breadth of industry expertise, our subject matter experts are able to provide tailored and swift sourcing solutions to fulfill client hiring needs. In other words, we connect top talent with companies.

As a certified minority-owned business, Pride Global and its affiliates - including Russell Tobin, Pride Health, and Pride Now - are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.

Russell Tobin offers eligible employees comprehensive healthcare coverage (medical, dental, and vision plans), supplemental coverage (accident insurance, critical illness insurance and hospital indemnity), a 401(k)-retirement savings, life & disability insurance, an employee assistance program, identity theft protection, legal support, auto and home insurance, pet insurance, and employee discounts with some preferred vendors.

Rate/Salary: Hourly Pay: $17 to $20 W2