NOT KNOWN DETAILS ABOUT PDF COMPRESSION

To prevent undesirable content from the lookup indexes, website owners can instruct spiders never to crawl specific files or directories in the common robots.txt file in the foundation directory of the domain. Additionally, a web page is usually explicitly excluded from a search engine's database by utilizing a meta tag specific to robots (usually