Query tagging: key to query understanding.
§ Using human judgments to evaluate tag precision.
– Extremely accurate (> 99%) for identifying person names.
– Harder to distinguish company vs. title vs. skill (e.g., oracle dba).
§ Comparing CTR for tag matches vs. non-matches.
– Difference can be large enough to suggest filtering vs. ranking: