Freelance Search Relevance Annotator
Job Type: Freelance / Remote
Languages Required: Native-level of Polish and fluent English
Project Summary: We are seeking freelance contributors to participate in a search relevance annotation project aimed at improving e-commerce search quality across multiple international markets. This is a remote, task-based opportunity suitable for individuals with a strong command of the English language and an eye for detail. Your input will directly influence the quality of search algorithms used in retail and e-commerce environments.
Project Objective: The project’s main goal is to build high-quality, human-labelled datasets that help evaluate and improve the performance of search engines. These datasets will be used for machine learning model training, benchmarking, and metric development across diverse general markets.
Key Responsibilities
– Evaluate the relevance of product search results returned for specific queries on e-commerce platforms
– Analyze each task consisting of a search query and a corresponding product listing
– Use provided context (e.g., search query, search category, and marketplace) to make informed judgments
– Review and compare search engine results from multiple sources to determine relevance matches
– Follow detailed annotation guidelines to ensure high-quality, consistent judgments
Requirements
– Native or near-native proficiency in Polish and fluent English
– Strong decision-making skills and previous experience with shopping online
– Ability to follow detailed instructions and quality standards
– Reliable internet access and a computer or laptop for task execution
Project Details
– Compensation will be task-based and depend on the number of judgments completed
– Flexible work hours; contributors can complete tasks at their own pace within project timelines
– Tasks are completed via a secure online platform; full guidelines are provided