The ABCs of spelling in Google SearchThe ABCs of spelling in Google SearchGoogle Fellow and Vice President

B is for Better models to solve for the unknown

Despite how common our mistakes are, many misspelled queries appear only once, making spelling a unique challenge for Search. And regardless of what kind of spelling error was made, our systems find ways to understand what you mean. Previously, to solve for these never-before-seen misspellings, our systems found inspiration in the keyboard design. For example, if you tried to type “u” but made a mistake, our systems learned you were more likely to have typed “y” than “z” because “y” is adjacent to “u” on a standard English language keyboard. Our models applied the general concept to all new misspellings, walking down nearby letter replacements until a popular replacement term was identified. While this may have seemed like an obvious way to solve for slip-of-finger mistakes, this general approach effectively corrected all kinds of spelling errors, including conceptual mistakes. 

Thanks to advancements in deep learning, we now have a better way to understand spelling. Late last year, we announced a new spelling algorithm that uses a deep neural net that better models and learns from less-common and unique spelling mistakes. This advancement enables us to run a model with more than 680 million parameters in under two milliseconds — a very large model that works faster than the flap of a hummingbird’s wings — so people can search uninterrupted by their own spelling errors. 

And how do our systems know what someone is looking for, no matter the type of mistake and if we’ve never seen the misspelling before? This is where context comes into play. Our natural language understanding models look at a search in context, like the relationship that words and letters within the query have to each other. Our systems start by deciphering or trying to understand your entire search query first. From there, we generate the best replacements for the misspelled words in the query based on our overall understanding of what you’re looking for. For example, we can tell from the other words in the query “average home coast” that you’re probably looking for information on “average home cost.” 

C is for Correcting your query — nicely

You might see these spelling technologies pop up in Google Search in different ways. When we’re pretty sure we know what you’re looking for, we may politely ask, “did you mean…” and show the alternative we think you intended to search for. When we’re very confident that we’ve correctly identified your misspelling, we’ll automatically show results for what we think you’re looking for — but we’ll always let you know and provide a way to get back to your original spelling. And whether you take our suggestion or not, we’re constantly learning and improving our systems based on that feedback to make Search more helpful.

So whether you’re a spelling bee champ or can’t quite nail “I before E except after C,” we’ll always be working to improve our spelling so you can keep searching. 

Posted by Contributor