AhrefsBot Engellemek
AhrefsBot tm interneti google gibi tarayan hergn servernzdan istek yapan bir bot gereksiz bant ve enerji kaybna yol ayor geri dn olarak pek birey verdii yok
Peki nasl engelleriz

Bu kodu robots.txt dosyanza ekleyin

Kod:
user-agent: AhrefsBot
disallow: /
Baka zararl botlar??
olmaz m ama pek ziyaret grmyoruz temel olarak ahrefi engellemek yeterli.

Kod:
ADmantX
AdnormC
AhrefsBot
AppEngine-Google
BLEXBot
Bad-Neighborhood
BellPages
BrokenLinkCheck
Chilkat
CommonCrawler
DomainCrawler
DomainSONOCrawler
DomainStatsBot
DwnldBot
FlippyBear
GetProxi.es
Grapeshot
InterNaetBoten
Ironpoke
Java/1
Jeode
Kiodia
LinkpadBot
LinqiaS
Lipperhey
MJ12bot
Mechanize
MegaIndex
Mixrank
NetSeer
Nmap
RavenCrawler
SEOkicks
SISTRIX
Scrapy
Screaming
ScreenerBot
SemrushBot
Siteimprove
TeeRaidBot
TurnitinBot
TweetmemeBot
Typhoeus
UXCrawlerBot
Uptimebot
VegeBot
WBSearch
WadWeaver
Wappalyzer
WebArtexBot
WoTBoT
Xovi
YesupBot
YottaBot
aol-soft
backlinktest
baidu
betaBot
bitlybot
brandwatch
carsopict.com
cmscrawler
crazywebcrawler
crystalsemantics.com
digincore
domainoptima.com
domainrea
domainsigma.com
etoolsbot
exif-search.com
grierf
import.io
infegy.com
integralads
linkchecker
linkdexbot
linkfluence
ltx71
masscan
matuschek
meanpath
mediatoolkit.com
****inspector
****uri.com
mfibot
openlinkprofiler
opensiteexplorer
petitsage
privacyaware
saleslift
searchie.org
seo***er
seomoz
seoscanners.net
seplinkbot
siteexplorer.info
thewebminer
trendiction
woobot
zipcomma
htaccess den engellemek iin ise yani kkten zm
bunu htaccess dosyanza ekleyin gein
bylece servernz bouna isteklere hizmet iin abalamaz.

Kod:
RewriteCond %{HTTP_USER_AGENT} ^.*(ADmantX|AdnormC|AhrefsBot|AppEngine-Google|BLEXBot|Bad-Neighborhood|BellPages|BrokenLinkCheck|Chilkat|CommonCrawler|DomainCrawler|DomainSONOCrawler|DomainStatsBot|DwnldBot|FlippyBear|GetProxi.es|Grapeshot|InterNaetB oten|Ironpoke|Java/1|Jeode|Kiodia|LinkpadBot|LinqiaS|Lipperhey|MJ12bot|Mechanize|MegaIndex|Mixrank|NetSeer|Nmap|RavenCrawler|SEOkicks|SISTRIX|Scrapy|Screaming|ScreenerBot|SemrushB ot|Siteimprove|TeeRaidBot|TurnitinBot|TweetmemeBot|Typhoeus|UXCrawlerBot|Uptimebot|VegeBot|WBSearch|WadWeaver|Wappalyzer|WebArtexBot|WoTBoT|Xovi|YesupBot|YottaB ot|aol-soft|backlinktest|baidu|betaBot|bitlybot|brandwatch|carsopict.com|cmscrawler|crazywebcrawler|crystalsemantics.com|digincore|domainoptima.com|domainrea|domainsig ma.com|etoolsbot|exif-search.com|grierf|import.io|infegy.com|integralads|linkchecker|linkdexbot|linkfluence|ltx71|masscan|matuschek|meanpath|mediatoolkit.com|****inspector|****uri.co m|mfibot|openlinkprofiler|opensiteexplorer|petitsage|privacyaware|saleslift|searchie.org|seo***er|seomoz|seoscanners.net|seplinkbot|siteexplorer.info|thewebmine r|trendiction|woobot|zipcomma).*$ [NC,OR]
# Optional if you have a lot of referer spam from some domains.
RewriteCond %{HTTP_REFERER} \.(ru|in)(/|$) [NC]
RewriteRule .* - [F,L]