What is a shingling algorithm and how is it used?
A shingling algorithm is a page segmentation method similar to VIPS, but less resource intensive and more likely to be used in search engine algorithms. These shingling algorithms look for blocks of content that do not occur frequently across a web site and look for blocks with certain desired features. When the engine stores this information, the navigational, advertisements, and other non-content areas are omitted.