Robots.txt Disallow Pattern

A specific directive in the robots.txt file that instructs search engine crawlers not to access particular URLs or sections of a website, using pattern matching to identify the paths to exclude from crawling.