Wong Ndeso + Katrox's mo nanya ni...

saya mo nanya URLs restricted by robots.txt punya saya ada 25item

artinya apa ya? mohon bantuannya..

dan kegunaan robot.txt itu buat apa ya?

thank's sebelumnya

 

artinya ada 25 tempat yang nggak bisa dicrawl sama google dan adsense crawler

 

wadew na trus gimana cara memperbaikinya boss??

thank's sebelumnya

 

quoting google:

If you would like to grant our crawler access to your pages, you can do so without granting permission to any other bots. Simply add the following two lines of text to the top of your robots.txt file:

User-agent: Mediapartners-Google*
Disallow:

This change will allow our crawler to index the content of your site and provide you with the most relevant Google ads for that content.

 

thank's atas infonya mas NK Person