What is the use of robots.txt file?? How we can use it??

Forum Forums On Page SEO What is the use of robots.txt file?? How we can use it??

This topic contains 2 replies, has 3 voices, and was last updated by  hariomyoga 1 month ago.

Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
    Posts
  • #213

    admin
    Keymaster

    What is the use of robots.txt file?? How we can use it for website??

    #237

    creativethinks01
    Participant

    Robots. txt – In a simple words what we want to index and what we want to no-index from Google this process is done by Robots.txt file you can also block any spam links as well. for example, take a look – https://creativethinksmedia.com/robots.txt

    #814

    hariomyoga
    Participant

    A robots.txt file tells search engine crawlers which pages or files the crawler can or can’t request from your site. This is used mainly to avoid overloading your site with requests; it is not a mechanism for keeping a web page out of Google.
    100 Hour Yoga TTC in Rishikesh

Viewing 3 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic.