WeLocalize Logo

WeLocalize

Search Relevance SME - Digital Content

Job Posted 16 Days Ago Reposted 16 Days Ago
In-Office or Remote
8 Locations
Junior
In-Office or Remote
8 Locations
Junior
As a Search Relevance SME, you will evaluate data submissions, monitor quality, provide feedback to raters, and recommend training sessions based on error trends.
The summary above was generated by AI
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:

ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.

Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.

Role Overview

We are seeking a Search Relevance Subject Matter Expert (SME) to join our team. In this role, you will act as a Subject Matter Expert for a high-profile streaming platform. Working closely with our raters, you will evaluate submissions in Label Studio, monitoring the data quality. By identifying recurring errors and offering actionable feedback, you will ensure our team consistently meets and exceeds client expectations.

Key Responsibilities

  • Quality Assurance & Guideline Adherence
  • Evaluate/correct data annotations for accuracy and compliance with the client’s rating guidelines.
  • Collaborate with team members to clarify and update guidelines as needed.

Qualifications

  • Previous QA experience: Prior exposure to any kind of QA is highly desirable.
  • Strong Analytical & Communication Skills: Ability to synthesize error trends and present clear, actionable insights.
  • Multicultural & Pop Culture Awareness: Deep understanding of multicultural perspectives and global pop culture trends is essential for enhancing search relevance.
  • Strong English Proficiency: Good command of written and spoken English, as all communication, documentation, and task guidelines are in English.
  • Availability for 10–20 hours per week: Flexible schedule with some overlap in working hours for communication with global teams.
  • Self-Motivated & Detail-Oriented: Capable of working independently, meeting deadlines, and maintaining strict quality standards in a remote setting.

Top Skills

Label Studio

Similar Jobs

7 Hours Ago
Easy Apply
Remote or Hybrid
Mississauga, ON, CAN
Easy Apply
Senior level
Senior level
Artificial Intelligence • eCommerce • Information Technology • Mobile • Payments • App development • Utilities
The Director of Strategic Alliances will identify and negotiate partnerships to drive revenue growth, assess market opportunities, and lead cross-functional collaboration for successful alliance execution.
Top Skills: BillingBusiness DevelopmentFintechPayments
7 Hours Ago
Remote or Hybrid
8 Locations
240K-359K Annually
Senior level
240K-359K Annually
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
As Product Lead for Retention at Square, you will strategize to improve seller retention through cross-functional collaborations, data analysis, and implementing effective save strategies.
Top Skills: Data Science
7 Hours Ago
Remote or Hybrid
8 Locations
240K-359K Annually
Senior level
240K-359K Annually
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead product development for Square's lending solutions, managing a team of PMs and driving strategy for business financing options.
Top Skills: Data AnalysisProduct Management

What you need to know about the Seattle Tech Scene

Home to tech titans like Microsoft and Amazon, Seattle punches far above its weight in innovation. But its surrounding mountains, sprinkled with world-famous hiking trails and climbing routes, make the city a destination for outdoorsy types as well. Established as a logging town before shifting to shipbuilding and logistics, the Emerald City is now known for its contributions to aerospace, software, biotech and cloud computing. And its status as a thriving tech ecosystem is attracting out-of-town companies looking to establish new tech and engineering hubs.

Key Facts About Seattle Tech

  • Number of Tech Workers: 287,000; 13% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Amazon, Microsoft, Meta, Google
  • Key Industries: Artificial intelligence, cloud computing, software, biotechnology, game development
  • Funding Landscape: $3.1 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Madrona, Fuse, Tola, Maveron
  • Research Centers and Universities: University of Washington, Seattle University, Seattle Pacific University, Allen Institute for Brain Science, Bill & Melinda Gates Foundation, Seattle Children’s Research Institute
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account