Google's Gary Illyes recommends using robots.txt to block crawlers from "add to cart ... often stemming from search engine bots crawling URLs intended for user actions. “Looking at what we ...

Recent discussions on Reddit are no longer showing up in non-Google search engine results ... Reddit's Robots Exclusion Protocol (robots.txt file) blocks bots from scraping the site.