Adding NoIndex to SiteSearch

by @casey92 (119), 9 months ago

Hi there,

I have an ecommerce client who launched their online store without a robot.txt file to block the crawling of filters and site search. Due to this, they have thousands "Site Search" URLs indexed. I want to noindex these results before blocking crawling in the rpbots.txt file.

Does anyone know how you can do this with Magento? Or other suggestions on how to get these results removed before adding it to the robots.txt file?

2 Replies
2 Users
Sort replies:
by @binayjha (4999), 9 months ago

Indexed URLs can be removed using Webmasters Tools or Search Console of search engines. For example, the Removals section can be used in the Google Search Console to remove all URLs with a specific prefix. After removing the URLs, restrict for crawling.

by @casey92 (119), 9 months ago

Hi @binayjha

Thanks for your reply, but I believe this tool only "filters" these pages/URLs from the results for 6 months. However, it might be worth attempting, as I don't think we can noindex these site search results/

Join the forum to unlock true power of SEO community

You're welcome to become part of SEO Forum community. Register for free, learn and contribute.

Log In Sign up