Skip to content

search

1 post with the tag “search”

A Map of Blocks

How a search engine keeps every word it knows in a few bytes each.

A search engine has to remember every word it has ever seen, keep them in order, and find any one of them in a fraction of a microsecond, often from a file it has not even read yet. The thirtieth familiar is really two: a tiny machine that spells out a whole vocabulary in about six bytes a word, and the dictionary that uses it as a table of contents.