1. Halo Guest, pastikan Anda selalu menaati peraturan forum sebelum mengirimkan post atau thread baru.

[ASK] Cara melakukan block pada bot seo tools seperti ahrefs, moz, semrush

Discussion in 'SEO' started by oscasapparel, Jun 9, 2020.

  1. oscasapparel

    oscasapparel Ads.id Starter

    Joined:
    Mar 22, 2018
    Messages:
    50
    Likes Received:
    17
    melakukan block pada bot seo tools seperti ahrefs, moz, semrush. Gan ada yang bisa bantu lakuin ini. Saya ingin webiste backlink gak di inti sama kompetitor.

    Terima agan2
     
  2. rahmadotcom

    rahmadotcom Ads.id Starter

    Joined:
    Jun 27, 2018
    Messages:
    82
    Likes Received:
    9
    Kalau di block kira2 nanti google bot bisa crawl gak?

    Sent from my Redmi Go using Tapatalk
     
  3. oscasapparel

    oscasapparel Ads.id Starter

    Joined:
    Mar 22, 2018
    Messages:
    50
    Likes Received:
    17
    Bisa katanya gan. Jadi kiliha lihat backlink kita di GCS
     
  4. Tapuy

    Tapuy Ads.id Pro

    Joined:
    May 15, 2014
    Messages:
    358
    Likes Received:
    82
    Bisa, kan yang diblock bukan bot google nya tapi ahref, moz, dan bot seo tools kawan-kawannya.
     
  5. rahmadotcom

    rahmadotcom Ads.id Starter

    Joined:
    Jun 27, 2018
    Messages:
    82
    Likes Received:
    9
    Cara ngeblocknya gmn? Kayaknya jg semua web yg tempat kita nanem backlink jg harus ngeblock jg.

    Sent from my Redmi Go using Tapatalk
     
  6. Aphrodite

    Aphrodite Ads.id Fan

    Joined:
    Sep 22, 2016
    Messages:
    170
    Likes Received:
    39
    dari robots.txt nya

    coba code ini:
    User-agent: googlebot
    Disallow: /bedven/bedrijf/*
    Crawl-delay: 10

    User-agent: google
    Disallow: /bedven/bedrijf/*
    Crawl-delay: 10

    User-agent: bingbot
    Disallow: /bedven/bedrijf/*
    Crawl-delay: 10

    User-agent: bing
    Disallow: /bedven/bedrijf/*
    Crawl-delay: 10

    User-agent: *
    Disallow: /
     
  7. agssbuzz

    agssbuzz Newbie

    Joined:
    May 23, 2016
    Messages:
    14
    Likes Received:
    8
    Hati hati baris terakhir gan. Bisa ngeblock bot google juga

    Sent from my POCOPHONE F1 using Tapatalk
     
  8. rahmadotcom

    rahmadotcom Ads.id Starter

    Joined:
    Jun 27, 2018
    Messages:
    82
    Likes Received:
    9
    Tp kalau web tempat nanem backlink gak ngeblock jg kan tetap ketahuan?

    Sent from my Redmi Go using Tapatalk
     
  9. Aphrodite

    Aphrodite Ads.id Fan

    Joined:
    Sep 22, 2016
    Messages:
    170
    Likes Received:
    39
    Iya gan,..
    Robots.txt biasanya dipake untuk nyumputin PBN agan aja, krena robots.txt di PBN agan kan bisa di modif.
    Kompetitor bakal cuma liat backlink2 dri web2 spammy laen, tpi mereka bakal heran knp backlink spammy kaya gini bisa nge rank,
    padahal agan punya backlink PBN yg robots.txt di PBN agan itu udh ngeblock semua crawler bots selain google..

    itu kan tujuannya?
     
  10. fenfive

    fenfive Banned

    Joined:
    Jan 26, 2020
    Messages:
    140
    Likes Received:
    27
    Nyimak. Bru smalam buka ahref jg. Dan info2nya beneran kaya ditelanjangi smua web. [emoji22]

    Ada cara lain/plugin khusus gt gk y buat ngeblok ?

    Sent from my Pixel 2 XL using Tapatalk
     
  11. kunbi

    kunbi Ads.id Pro

    Joined:
    Oct 10, 2009
    Messages:
    385
    Likes Received:
    40
    kalau saya biasanya dari scriptnya sendiri dimodif buat ngeblok bot. jadi yang di baca bot sama manusia beda.
    yang dibaca bot A, Bot B dan sterusnya beda2.
     
  12. Xenia

    Xenia Newbie

    Joined:
    Dec 11, 2014
    Messages:
    46
    Likes Received:
    14
    Majestic SEO -> User-agent: MJ12bot
    MOZ OpenSiteExplorer -> User-agent: rogerbot
    Ahrefs -> User-agent: Ahrefs

    kode di robot.txt

    Code:
    User-agent: Rogerbot 
    User-agent: Exabot 
    User-agent: MJ12bot 
    User-agent: Dotbot 
    User-agent: Gigabot 
    User-agent: AhrefsBot 
    User-agent: BlackWidow
    User-agent: ChinaClaw 
    User-agent: Custo 
    User-agent: DISCo 
    User-agent: Download\ Demon 
    User-agent: eCatch 
    User-agent: EirGrabber 
    User-agent: EmailSiphon 
    User-agent: EmailWolf 
    User-agent: Express\ WebPictures 
    User-agent: ExtractorPro 
    User-agent: EyeNetIE 
    User-agent: FlashGet 
    User-agent: GetRight 
    User-agent: GetWeb! 
    User-agent: Go!Zilla 
    User-agent: Go-Ahead-Got-It 
    User-agent: GrabNet 
    User-agent: Grafula 
    User-agent: HMView 
    User-agent: HTTrack 
    User-agent: Image\ Stripper 
    User-agent: Image\ Sucker 
    User-agent: Indy\ Library
    User-agent: InterGET 
    User-agent: Internet\ Ninja 
    User-agent: JetCar 
    User-agent: JOC\ Web\ Spider 
    User-agent: larbin 
    User-agent: LeechFTP 
    User-agent: Mass\ Downloader 
    User-agent: MIDown\ tool 
    User-agent: Mister\ PiX 
    User-agent: Navroad 
    User-agent: NearSite 
    User-agent: NetAnts 
    User-agent: NetSpider 
    User-agent: Net\ Vampire 
    User-agent: NetZIP 
    User-agent: Octopus 
    User-agent: Offline\ Explorer 
    User-agent: Offline\ Navigator 
    User-agent: PageGrabber 
    User-agent: Papa\ Foto 
    User-agent: pavuk 
    User-agent: pcBrowser 
    User-agent: RealDownload 
    User-agent: ReGet 
    User-agent: SiteSnagger 
    User-agent: SmartDownload 
    User-agent: SuperBot 
    User-agent: SuperHTTP 
    User-agent: Surfbot 
    User-agent: tAkeOut 
    User-agent: Teleport\ Pro 
    User-agent: VoidEYE 
    User-agent: Web\ Image\ Collector 
    User-agent: Web\ Sucker 
    User-agent: WebAuto 
    User-agent: WebCopier 
    User-agent: WebFetch 
    User-agent: WebGo\ IS 
    User-agent: WebLeacher 
    User-agent: WebReaper 
    User-agent: WebSauger 
    User-agent: Website\ eXtractor 
    User-agent: Website\ Quester 
    User-agent: WebStripper 
    User-agent: WebWhacker 
    User-agent: WebZIP 
    User-agent: Wget 
    User-agent: Widow 
    User-agent: WWWOFFLE 
    User-agent: Xaldon\ WebSpider 
    User-agent: Zeus
    Disallow: /
    
    .htaccess file
    Code:
    SetEnvIfNoCase User-Agent .*rogerbot.* bad_bot
    SetEnvIfNoCase User-Agent .*exabot.* bad_bot
    SetEnvIfNoCase User-Agent .*mj12bot.* bad_bot
    SetEnvIfNoCase User-Agent .*dotbot.* bad_bot
    SetEnvIfNoCase User-Agent .*gigabot.* bad_bot
    SetEnvIfNoCase User-Agent .*ahrefsbot.* bad_bot
    SetEnvIfNoCase User-Agent .*sitebot.* bad_bot
    <Limit GET POST HEAD>
    Order Allow,Deny
    Allow from all
    Deny from env=bad_bot
    </Limit>
    
     
    hanif48, newbiefans, naekbang and 2 others like this.
  13. naekbang

    naekbang Ads.id Starter

    Joined:
    Dec 8, 2017
    Messages:
    68
    Likes Received:
    13
    Location:
    Bumi
    Lagi pengen nyobain, makasih referensinya
    Ujicoba dulu gan, makasih gan
     
  14. newbiefans

    newbiefans Super Hero

    Joined:
    Sep 5, 2009
    Messages:
    2,087
    Likes Received:
    365
    Location:
    DKI JAKARTA
    thanks saya tes dulu gan
     
  15. hanif48

    hanif48 Hero

    Joined:
    Jan 30, 2015
    Messages:
    569
    Likes Received:
    37
    Location:
    Cikarang, Bekasi
    Makasih udah bantu ngelist user-agent bot bot seotool gan. Mantap :kacapembesar:
     
  16. rinirina

    rinirina Aged Domains Seller

    Joined:
    Nov 17, 2014
    Messages:
    1,380
    Likes Received:
    142
    Location:
    Rivendale
    cara bacanya gimana tuh artinya bedven/bedrijf Crawl-delay: 10
    penjelasannya piye iki? :D
     
  17. JerrySalim

    JerrySalim Newbie

    Joined:
    Nov 7, 2018
    Messages:
    30
    Likes Received:
    12
    Location:
    Indonesia
    Untuk pengguna WP, harusnya bagian Plugins dapat kita cari dengan kata kunci "block bad robot"
     
  18. Arya Wiguna

    Arya Wiguna Ads.id Pro

    Joined:
    Sep 30, 2016
    Messages:
    263
    Likes Received:
    36
    adakah yang usah berhasil???? :hmm2:
     
  19. bajingan2203

    bajingan2203 Newbie

    Joined:
    Dec 19, 2019
    Messages:
    30
    Likes Received:
    1
    blm ngerti, ada referensi link belajar seo dari 0 om om?


    Sent from my iPhone using Tapatalk
     

Share This Page