Search engine evaluator jobs: what the work is, who hires and how to apply

Search engine evaluator jobs are among the most searched remote roles, and among the most misunderstood. They are not a way to change a website's ranking. They do not pay the same everywhere, and they are not open in every country. This guide explains what the work involves, who actually hires, how much the published offers pay and how to prepare for the qualification exam. It also explains how to avoid the scams that copy these job titles.

These numbers show the scale of the job. Thousands of people do it, the rulebook is long, pay is modest, and the eligibility rules are strict. The rest of this article explains each of these points.

What does a search engine evaluator actually do?

A search engine evaluator looks at real or realistic search queries and the results returned for them. You then give structured ratings following a detailed rulebook. In job ads, the role goes by several names: search quality rater, internet assessor, online rater, web evaluator. Job titles vary by market and listing.

Google publishes the rulebook used for this work, the Search Quality Rater Guidelines. The current version is 182 pages long and is dated September 11. It describes two main types of rating.

Needs Met: does the result answer the query?

The "Needs Met" rating asks one question: does this result satisfy what the person was trying to do? You first have to understand the intent behind the query. Someone may want a quick fact, a local business, a product page or a long explanation. Then you judge how well the result serves that intent.

Page Quality and E-E-A-T: can this page be trusted?

The "Page Quality" rating looks at the page itself: its purpose, its content and its reputation. A key concept is E-E-A-T, which stands for Experience, Expertise, Authoritativeness and Trustworthiness. For example, a medical page written by an identifiable expert is judged differently from an anonymous page making health claims.

Do ratings change a website's ranking?

No, not directly. Rater scores are used to measure how well search systems are working. They do not move a specific page up or down. Google explains its general approach on its How Search Works site. Any ad that promises you can "boost websites" as a rater is misleading.

Search evaluation belongs to the wider family of human judgment work behind AI and search. It is close to data annotation jobs, where people label data or rate AI answers. It also overlaps with paid AI training work such as RLHF and red-teaming.

What does a rating task look like, step by step?

Project tools and rules vary by employer and listing. The example below is fictional. It is built only from the general method described in Google's public guidelines, and it is not taken from any real project.

What this example shows: the work is less about speed and more about consistent judgment. Two raters reading the same guidelines should reach similar ratings. The qualification and project rules are meant to test consistent judgment.

Who hires for search engine evaluator jobs?

Search engines do not usually hire raters themselves. They work through vendors that recruit, test and manage raters country by country. The table below lists what we could verify in published offers and official pages.

How to read this table: the employer matters less than the country-specific offer. The same company can pay very different rates and set different requirements from one market to another.

TELUS search engine evaluator roles

TELUS International became TELUS Digital on September 18, 2024, according to its official announcement. Its "TELUS Digital AI Community" recruits by country and project. Each project comes with its own assessments.

The Canadian "Personalized Internet Assessor" offer lists an estimated USD 13.50/h, paid per task. It requires excellent English, 5 consecutive years of residency in Canada and a qualification exam. Current openings appear on the TELUS Digital jobs site.

Welocalize / Welo Data, OneForma and RWS

Welo Data's US offer is a part-time employee role. It covers 10 to 29 hours a week, is paid every two weeks and starts with an exam. OneForma's MilkyWay project covers queries, maps, images and ads, and requires 5 years of residency in the target country. RWS TrainAI recruits search engine evaluators and online raters, but does not publish a pay scale.

How much do search quality rater jobs pay?

Pay for search quality rater jobs is set per country, and published figures are rare. Here are the three hourly rates we could verify in actual offers.

What this chart shows: the Mexican offer pays roughly a third of the US and Canadian ones for similar work. Before applying, look for the rate in your country's listing. Do not rely on figures quoted in viral posts, which are often taken from the US market.

Two other points matter as much as the hourly rate. First, "estimated" pay at TELUS is per task. Your real income depends on how much work is available and how fast you complete tasks within the quality rules. Second, hours are often capped: the Welo Data offer stops at 29 hours a week. These are side jobs, not guaranteed full-time incomes.

Who is eligible to become a search engine evaluator?

Eligibility is where most applicants are filtered out. The offers we reviewed share three requirements.

• Residency: often 5 years in the country you will rate for, consecutive in the TELUS Canada offer. Raters judge local relevance, so they need to know local culture, brands and habits.
• Language: a high level in the market's language, such as excellent English for Canada or Spanish for Mexico.
• Qualification exam: a test based on the guidelines, which you must pass before you get any paid work.

Illustrative example: Chidi, a fictional graduate in Lagos, finds a well-paid "internet assessor" ad. When he reads the details, it requires 5 years of residency in Canada. He is not eligible, and no workaround is legitimate. Do not use someone else's identity or address; check each offer's official rules. Chidi's options are offers that target Nigeria or remote work that is open worldwide. Our guide to making money online in Nigeria covers those.

How to become a search engine evaluator: applying and passing the exam

If you meet the residency and language rules, preparation makes the biggest difference. Here is a realistic path, from the application to your first project.

A good habit for any reviewed work, whether ratings, annotation or micro-tasks, is to reread the instructions before every session. Our guide to passing quality control the first time explains why this habit pays off.

How do you spot a fake search evaluator job?

Popular job titles attract scammers. In December 2024, the US Federal Trade Commission (FTC) reported a surge in "task scams". These fake jobs show you growing "earnings", then ask you to deposit money, often in crypto, to unlock them.

What this chart shows: in six months, reports were about four times higher than in the whole previous year. The FTC also counted USD 223 million in reported losses to job scams of all kinds in the first half of 2024, compared with USD 286 million for all of 2023. One rule protects you from almost all of these scams: never pay to get paid.

Never pay to get paid; requests for deposits are a major task-scam warning sign. For a broader list of red flags, read our checklist for legit work from home without paying upfront.

Are search engine evaluator jobs worth it?

The answer depends on where you live and what you expect. Here is our assessment, based only on the verified facts above.

What can you do if you are not eligible for search evaluation?

If no rater offer targets your country, other kinds of online work still use your judgment and care for detail.

Research studies and data work

Prolific runs academic studies. It requires researchers to pay at least GBP 6 or USD 8 per hour and recommends GBP 9 or USD 12. Its list of eligible countries includes the US, the UK, Canada and India, but not Nigeria. CloudResearch Connect and UserTesting are other options. Amazon Mechanical Turk closed permanently on September 30; these sites are active alternatives. Our guide to sites like MTurk compares them.

If you are drawn to AI work, annotation projects have their own entry tests. DataAnnotation.tech, for example, uses a one-time assessment with no second chance, according to its FAQ. Read our guide to data annotation jobs before you take one.

Micro-tasks on Microtaches

It offers micro-tasks: you accept a task, follow the instructions shown and submit your answer. Each task must be completed within 60 minutes, and you can have up to 3 tasks in progress. You can drop a task without penalty during the first 10 minutes. A task that expires without an answer costs 20 Ops. Every task is reviewed before you are credited.

The platform is open to all nationalities, and its community has more than 44,000 approved workers. More than two thirds live in Africa, including close to 350 in Nigeria; the community also includes over 500 workers in India. Registration is free but is reviewed by the team, so approval is not instant. Completing your profile earns a 10-Ops bonus. No income is guaranteed: the number of available tasks varies by day, country and profile.

Earnings are counted in Ops. 1 Ops is worth €0.0082 in the shop (gift cards, products) and €0.0042 when withdrawn. The shop therefore gives you about 1.95 times as much value per Ops.

What this chart shows: the same Ops balance is worth almost twice as much as gift cards as it is in cash. To understand the conditions before you start, read how to convert Ops into euros and gift cards. The main conditions are:

• Identity verification (KYC) becomes available once you have 1,000 Ops. It takes up to 7 business days and is required before your first withdrawal or shop order. See our KYC guide.
• The minimum withdrawal is 5,000 Ops per request, and 10,000 Ops must stay in your account as a non-withdrawable reserve. Your balance must therefore reach at least 15,000 Ops for a first bank transfer.
• Bank transfers outside Europe have a fixed fee of 800 Ops. Payouts arrive up to 3 weeks after your request is approved, and shop orders up to 2 weeks.
• An internal cap of €2,500 per year applies. This is a Microtaches rule, not a law.

Withdrawal methods on Microtaches

Your Ops can be withdrawn to a bank account, a mobile money account or an online wallet. Bank transfer is available from the usual minimum; MVola, Orange Money, Wave, MTN MoMo, PayPal, Skrill and Neteller are available from 25,000 Ops; Revolut and Crypto are coming soon.

Mobile money options (MVola, Orange Money, Wave, MTN MoMo), PayPal, Skrill and Neteller are available from 25,000 Ops. You request them from the Withdrawals page of your account. Airtel Money, M-Pesa and Payoneer are not offered by Microtaches, so choose one of the listed methods instead.

Sources

• Google Search Quality Rater Guidelines: Needs Met, Page Quality and E-E-A-T (182 pages)
• Google, How Search Works: how Google describes its ranking and evaluation process
• TELUS Digital jobs: Personalized Internet Assessor offers by country
• TELUS Digital rebrand announcement: TELUS International became TELUS Digital on September 18, 2024
• OneForma MilkyWay FAQ: evaluation tasks and the residency requirement
• RWS TrainAI community: recruitment of search engine evaluators and online raters
• FTC Data Spotlight on task scams: number of reports, reported losses and how the scams work
• Prolific eligible countries: where you can take part in paid research studies

Is search engine evaluator a real job?

Yes. Vendors such as TELUS Digital, Welocalize/Welo Data, OneForma and RWS TrainAI recruit raters, and Google stated it had about 16,000 external raters in a November 2023 document. Many fake offers copy the title, though, so apply only through official career sites.

How much do search engine evaluators make per hour?

It depends on the country. Published offers show about USD 13.50/h estimated in Canada (TELUS Digital), USD 14.50/h in one US posting (Welo Data) and USD 5/h estimated in Mexico. Check each listing for hours and how work is assigned.

Do search engine evaluators work directly for Google?

No. Raters are hired and managed by contractors such as TELUS Digital or Welo Data. Appen no longer does this work for Google: their contract ended no later than March 19, 2024.

Can I become a search engine evaluator from Nigeria or India?

Only if an offer targets your country. Most offers require several years of residency in the market you rate for, such as 5 consecutive years in Canada for TELUS's Canadian offer. Check each listing, and never use someone else's identity.

Do I have to pay for the search engine evaluator exam?

No. Legitimate employers never charge for the qualification exam, training or software. A request for payment, especially in crypto, is the classic sign of a task scam described by the FTC.

How many hours a week do search quality raters work?

It varies, and it is usually part-time. The Welo Data US offer covers 10 to 29 hours a week, while TELUS's Canadian offer is paid per task. Do not plan on it as a full-time income.

Do search engine evaluators change Google rankings?

No. Ratings are used to measure how well search systems work, not to move a specific page up or down. An offer promising that you will "rank websites" is misleading.

How do I prepare for the search quality rater exam?

Read Google's 182-page guidelines, focusing on Needs Met, Page Quality and E-E-A-T. Then practice rating your own searches for a week. Check whether retakes are allowed before you start the exam.

Does Microtaches offer search engine evaluator jobs?

No. Microtaches offers micro-tasks that you complete by following the instructions shown, and every task is reviewed before you are credited. It is open worldwide, but no income is guaranteed.