General Guidelines General Guidelines Overview 5 Introduction to Search Quality Rating 6 0.0 The Search Experience 6 0.1 The Purpose of Search Quality Rating 6 0.2 Raters Must Represent People in their Rating Locale 7 0.3 Browser Requirements 7 0.4 Ad Blocking Extensions 7 0.5 Internet Safety Information 7 0.6 The Role of Examples in these Guidelines 8 Part 1: Page Quality Rating Guideline 9 1.0 Introduction to Page Quality Rating 9 2.0 Understanding Webpages and Websites 9 2.1 Important Definitions 9 2.2 What is the Purpose of a Webpage? 10 2.3 Your Money or Your Life (YMYL) Topics 11 2.4 Understanding Webpage Content 13 2.4.1 Identifying the Main Content (MC) 13 2.4.2 Identifying the Supplementary Content (SC) 14 2.4.3 Identifying Advertisements/Monetization (Ads) 14 2.4.4 Summary of the Parts of the Page 14 2.5 Understanding the Website 15 2.5.1 Finding the Homepage 15 2.5.2 Finding Who is Responsible for the Website and Who Created the Content on the Page 16 2.5.3 Finding About Us, Contact Information, and Customer Service Information 17 2.6 Reputation of the Website and Creator of the Main Content 18 2.6.1 Research on the Reputation of the Website and Creator of the Main Content 18 2.6.2 Sources of Reputation Information 19 2.6.3 Customer Reviews of Stores/Businesses 19 2.6.4 How to Search for Reputation Information 19 2.6.5 What to Do When You Find No Reputation Information 21 3.0 Overall Page Quality Rating 22 3.1 Page Quality Rating: Most Important Factors 22 3.2 Expertise, Authoritativeness, and Trustworthiness (E-A-T) 22 4.0 High Quality Pages 23 4.1 Characteristics of High Quality Pages 23 4.2 A Satisfying Amount of High Quality Main Content 24 4.3 Clear and Satisfying Website Information: Who is Responsible and Customer Service 24 4.4 Positive Reputation 24 4.5 A High Level of Expertise/Authoritativeness/Trustworthiness (E-A-T) 25 4.6 Examples of High Quality Pages 25 5.0 Highest Quality Pages 29 Copyright 2022 1 August 16, 2022 5.1 Very High Quality MC 29 5.2 Very Positive Reputation 29 5.3 Very High Level of E-A-T 30 5.4 Examples of Highest Quality Pages 30 6.0 Low Quality Pages 37 6.1 Lacking Expertise, Authoritativeness, or Trustworthiness (E-A-T) 37 6.2 Low Quality Main Content 38 6.3 Unsatisfying Amount of Main Content 38 6.4 Distracting Ads/SC 38 6.5 Mixed or Mildly Negative Reputation of the Website or Creator of the Main Content 38 6.6 Unsatisfying Amount of Information about the Website or Creator of the Main Content 39 6.7 Examples of Low Quality Pages 39 7.0 Lowest Quality Pages 43 7.1 Harmful to Self or Other Individuals 44 7.2 Harmful to Specified Groups 45 7.3 Harmfully Misleading Information 46 7.4 Untrustworthy Webpages or Websites 47 7.4.1 Inadequate Information about the Website or Creator of the MC for the Purpose of the Page 47 7.4.2 Lowest E-A-T and Lowest Reputation of the Website or Creator of the MC 48 7.4.3 Deceptive Page Purpose and Deceptive MC Design 48 7.4.4 Deliberately Obstructed or Obscured MC 49 7.4.5 Suspected Malicious Behavior 50 7.5 Spammy Webpages 50 7.5.1 Cannot Determine a Purpose, No MC, Little MC, or Lowest Quality MC 51 7.5.2 Hacked, Defaced, or Spammed Pages 51 7.5.3 Auto-generated MC 51 7.5.4 Copied MC 52 7.5.5 How to Determine if Content is Copied 52 7.6 Examples of Lowest Quality Pages 54 8.0 Medium Quality Pages 62 8.1 Examples of Medium Quality Pages 62 9.0 Page Quality Rating Tasks 65 9.1 Instructions for Rating Page Quality Tasks 65 9.2 Reputation and E-A-T: Website or the Creators of the Main Content? 66 10.0 Page Quality Criteria for Specific Types of Pages 66 10.1 Ratings for Encyclopedia Pages 66 10.2 Ratings for Pages with Error Messages or No MC 66 10.3 Ratings for Forums and Q&A pages 68 11.0 Page Quality Rating FAQs 72 Part 2: Understanding Search User Needs 74 12.0 Understanding Search Users, Queries, and Results 74 12.1 Important Rating Definitions and Ideas 74 12.2 Understanding the Query 75 12.3 Locale and User Location 75 12.4 Queries with an Explicit Location 76 Copyright 2022 2 12.5 Queries with Multiple Meanings 76 12.6 Query Meanings Can Change Over Time 78 12.7 Understanding User Intent 78 12.7.1 Know and Know Simple Queries 79 12.7.2 Do Queries 80 12.7.3 Website Queries 80 12.7.4 Visit-in-Person Queries and User Location 81 12.7.5 Queries with Multiple User Intents 83 12.8 Understanding Result Blocks 84 12.8.1 Web Search Result Block Examples 84 12.8.2 Special Content Result Block Examples 85 Part 3: Needs Met Rating Guideline 89 13.0 Rating Using the Needs Met Scale 89 13.1 Rating Result Blocks: Block Content and Landing Pages 89 13.2 Fully Meets (FullyM) 92 13.2.1 Examples of Fully Meets (FullyM) Result Blocks 92 13.2.2 Examples of Queries that Cannot Have Fully Meets Results 98 13.3 Highly Meets (HM) 99 13.3.1 Examples of Highly Meets (HM) Result Blocks 99 13.4 Moderately Meets (MM) 109 13.4.1 Examples of Moderately Meets (MM) Result Blocks 109 13.5 Slightly Meets (SM) 111 13.5.1 Examples of Slightly Meets (SM) Result Blocks 111 13.6 Fails to Meet (FailsM) 114 13.6.1 Examples of Fails to Meet (FailsM) Result Blocks 114 14.0 The Relationship between Page Quality and Needs Met 123 15.0 Rating Porn, Foreign Language, and Did Not Load Results 126 15.1 Porn Flag 126 15.2 Needs Met Rating for Porn Results 126 15.2.1 Needs Met Rating for Clear Non-Porn Intent Queries 126 15.2.2 Needs Met Rating for Possible Porn Intent Queries 127 15.2.3 Needs Met Rating for Clear Porn Intent Queries 127 15.3 Reporting Illegal Images 128 15.4 Foreign Language Flag 128 15.4.1 Using the Foreign Language Flag 128 15.4.2 Needs Met Rating for Foreign Language Results 129 15.5 Did Not Load Flag 131 15.5.1 Using the Did Not Load Flag 131 15.5.2 Needs Met Rating and the Did Not Load Flag 131 15.6 Additional Flags in Some Rating Tasks 133 16.0 Rating Queries with Multiple Interpretations and Intents 133 16.1 Rating Queries with Both Website and Visit-in-Person Intent 133 17.0 Specificity of Queries and Landing Pages 135 18.0 Needs Met Rating and Freshness 143 19.0 Misspelled and Mistyped Queries and Results 145 Copyright 2022 3 19.1 Misspelled and Mistyped Queries 145 19.2 Name Queries 146 20.0 Non-Fully Meets Results for URL Queries 146 21.0 Product Queries: Importance of Browsing and Researching 148 22.0 Rating Visit-in-Person Intent Queries 149 22.1 Examples Where User Location Does (and Does Not) Matter 150 23.0 Rating English Language Results in Non-English Locales 152 23.1 Examples of English (and Non-English) Results in Non-English Locales 153 24.0 Rating Dictionary and Encyclopedia Results for Different Queries 157 Appendix: Using the Evaluation Platform 160 25.0 Overview 160 26.0 Acquiring Tasks 160 27.0 Rating Tasks Using the Rating Interface 160 28.0 Releasing Tasks 161 29.0 Understanding the User Location on the Task Page 163 30.0 Reporting Duplicate Results in Tasks 163 30.1 Pre-Identified Duplicates 163 30.2 Rater-Identified Duplicates 164 30.3 Reporting Duplicate Results 165 31.0 Simplified Needs Met Tasks 166 Appendix 2: Guideline Change Log 167 Copyright 2022 4 General Guidelines Overview Welcome to the Search Quality Rating Program! As a Search Quality Rater, you will work on many different types of rating projects. The General Guidelines primarily cover Page Quality (PQ) rating and Needs Met (NM) rating; however, the concepts are also important for many other types of rating tasks. For brevity, we refer to

الإبلاغ عن إساءة

تفاصيل ال-PDF

معلومات الاتصال

searchqualityevaluatorguidelines-08-16-2022.pdf