Blocking scrapers, bots, and AI
BotB Academy News
 
 
211220
Hey, folks, anyone remember last Wednesday when ChatGPT basically DDOSed this website? Yeah, BotB wouldn't load for about an hour and I had to get help from Dreamhost to get it running again. The technician that helped me, Nick, pointed out we were getting obscene traffic from some bots.

So what I've been doing since then is looking for groups of self-similar IP addresses loading pages from the site. Using https://viewdns.info I can get some semblance of where the requests are coming from. A lot of these IP clusters are coming from web host IP ranges so what I've been doing is blocking their entire IP range in kind.

List of Hosts now Blocked:
Alibaba/Aliexpress Cloud
Anexia.at
AWS (but not the IP where BotB Bot lives)
ChatGPT
DZCRD
ethr.net
Global Connections Network
Huawei Cloud
ImageSift
NetCup
RIPE (which may or might not be some positive european google initiave)
Semrush
Tesonet
Web2Objects

I have not been blocking potential search engine web spiders like Google and Microsoft. I've had 5 of these "whack a mole" sessions since "the attack". I'm sure there are more to come.

Potential Issues:
It is absolutely possible that I am blocking folks that have nothing to do with scummy bots. If this is the case then they are being denied access to BotB. If you or anyone you know (that isn't banned from BotB) has had this experience please let me know and I will unblock them! You can find out what your IP address is by using this: https://whatismyipaddress.com/

Sorry it didn't occur to me sooner to do this. So far it seems to be helping quite a bit with page load times. Thanks, everyone!
 
 
211221
battle of the bots
 
 
211223
Level 30 Hostist
puke7
 
 
 
post #211223 :: 2025.02.20 12:37pm
  
  Flaminglog, RevvoBolt, sean, Caffeinator, ItsDuv, mirageofher, Bingies24, SRB2er and arceus413 liēkd this
...and by last Wednesday I meant last week's Wednesday and not yesterday's Wednesday
 
 
211224
Level 25 Chipist
arceus413
 
 
 
help my definitely not ai generated essay keeps talking about some guy called Vombot (főzelékfaló)
 
 
211226
Level 12 Mixist
Da Flarf
 
 
post #211226 :: 2025.02.20 1:14pm
  
  RevvoBolt, qjesse, YQN and arceus413 liēkd this
Can vombot help me write my college application essay?
 
 
211234
fuck 'em! get that LLM training shit off our lawn
 
 
211243
Level 12 Mixist
Da Flarf
 
 
post #211243 :: 2025.02.20 6:44pm :: edit 2025.02.21 10:40am
  
  RevvoBolt, TiffanyNeat and mirageofher liēkd this
A month from now we need a lyceum article for the bot wars
 
 
211244
Level 18 Chipist
SweatyNoodle
 
   
 
post #211244 :: 2025.02.20 6:52pm
  
  RevvoBolt, Collidy and SweatyNoodle liēkd this
oh shoot it just went up to 100 guests again
 
 
211252
Level 26 Chipist
Collidy
 
 
 
post #211252 :: 2025.02.21 2:52am
  
  SRB2er liēkd this
ooh first time ever saw announcement news created by this day and age
 
 
211255
Level 22 Chipist
SRB2er
 
 
 
post #211255 :: 2025.02.21 4:30am :: edit 2025.02.21 11:25am
  
  Collidy, YQN and retrokid104 liēkd this
@SweatyNoodle ..did you just like your own post?

what the fuck-
 
 
211257
Level 19 Mixist
luna197
 
 
 
post #211257 :: 2025.02.21 4:43am
  
  Flaminglog, YQN, SweatyNoodle, Collidy and luna197 liēkd this
yeah they did
 
 
211276
Level 18 Chipist
retrokid104
 
 
 
post #211276 :: 2025.02.21 9:04am
  
  Collidy, luna197, YQN, SweatyNoodle and retrokid104 liēkd this
it's easy
 
 
211288
Level 22 Chipist
SRB2er
 
 
 
post #211288 :: 2025.02.21 11:34am
  
  retrokid104, Collidy and Da Flarf liēkd this
what the fuck am I missing here
there is no liek button on my posts
is this a firki markup thing or smth
because if not, then im gonna


,?!?!?@?÷(×(]@♧3$2₩29•0☆¿
 
 
211290
Level 12 Mixist
Da Flarf
 
 
post #211290 :: 2025.02.21 12:04pm
  
  Viraxor, Xaser, Surfcroc, Luigi64, retrokid104, Collidy, puke7, ItsDuv and arceus413 liēkd this
bro swearing in 2 different currencies
 
 
211297
Level 25 Chipist
YQN
 
 
 
i just hope that now LLM's will use "slug" as a synonym for "result"
 
 
211320
deez LLMs can Lick Lick Muh balls
 
 
211343
Level 20 XHBist
CouldntBeMe
 
 
 
post #211343 :: 2025.02.21 9:16pm :: edit 2025.02.21 9:17pm
  
  YQN, Lasertooth and CouldntBeMe liēkd this
oh hey i just figured it out
 
 
211387
Level 29 Chipist
nitrofurano
 
 
 
post #211387 :: 2025.02.22 2:42pm
  
  kinkinkijkin, retrokid104 and LukeIGuess_ liēkd this
  
  Da Flarf hæitd this
I'd block microsoft
 
 
211457
Level 30 Hostist
puke7
 
 
 
post #211457 :: 2025.02.23 8:49am
  
  Viraxor, kinkinkijkin, Da Flarf, arceus413, DuccBoi, mirageofher, Lasertooth, Jangler, retrokid104 and nitrofurano liēkd this
but not google?

that's fucked
 
 
211502
Level 12 Mixist
Da Flarf
 
 
post #211502 :: 2025.02.23 12:32pm
  
  Viraxor, Luigi64, Jangler, pedipanol, arceus413, kinkinkijkin and SweatyNoodle hæitd this
  
  retrokid104 liēkd this
say what you will about microsoft... but at least their OS can run .exe
 
 
211550
Level 25 Chipist
arceus413
 
 
 
post #211550 :: 2025.02.23 7:56pm
  
  Viraxor, kinkinkijkin and big lumby liēkd this
sorry i use reactos
 
 
211579
Level 12 Mixist
Da Flarf
 
 
post #211579 :: 2025.02.24 7:01am
  
  VirtualMan liēkd this
  
  Viraxor, arceus413, Lasertooth and kinkinkijkin hæitd this
come to think of it, I should have guessed that BOTB would be full of linux stans
 
 
211580
Level 19 Mixist
kinkinkijkin
 
 
 
post #211580 :: 2025.02.24 7:28am
  
  Viraxor and arceus413 liēkd this
ReactOS isn't Linux, everything can run windows executables these days. Everything. Haiku can run windows executables. PPC OSX can run windows executables. Android can run windows executables. The fuckin wii u can run windows executables if you've got enough time on your hands.

Filename extension also isn't real, by the way. Hasn't been since the early 90s.
 
 
211582
Level 12 Mixist
Da Flarf
 
 
post #211582 :: 2025.02.24 8:07am
Ah I was mistaken. I see that ReactOS is Aldi brand Windows. I thought it was a niche linux distro. My bad.
 
 
211588
Level 18 Chipist
Stupe
 
 
 
post #211588 :: 2025.02.24 9:05am
  
  dobra, VirtualMan, Gordon Freeman and Da Flarf liēkd this
ur mom is aldi brand windows lololol
 
 
211594
Level 12 Mixist
Da Flarf
 
 
post #211594 :: 2025.02.24 9:30am
HEY MAN!!! MY MOM IS A KIND AND CARING PERSON!!! HOW DARE YOU :(

TAKE THAT BACK RIGHT NOW OR MY DAD IS GONNA COME TO YOUR HOU-
 
 
211670
Level 31 Chipist
damifortune
 
 
 
post #211670 :: 2025.02.25 11:47am
  
  retrokid104, YQN, VirtualMan, lasersphaser, Viraxor, kinkinkijkin, Stupe, Da Flarf, Luigi64, arceus413, Jangler and Lasertooth liēkd this
any thread can be a thread about operating systems if you try hard enough
 
 
211696
Level 21 Pixelist
The Diad
 
 
 
post #211696 :: 2025.02.25 6:16pm
  
  dobra, retrokid104, VirtualMan, Viraxor, Gordon Freeman, Baron Knoxburry, Da Flarf and kinkinkijkin liēkd this
Maybe the real operating system was the friends we made along the way
 
 
211700
Level 12 Mixist
Da Flarf
 
 
post #211700 :: 2025.02.25 8:01pm
  
  Viraxor liēkd this
This conversation was a Window to my soul
 
 
211729
Level 18 Chipist
SweatyNoodle
 
   
 
post #211729 :: 2025.02.26 3:00am
  
  Wegfrei and Stupe liēkd this
scraper? hardly know 'er
 
 
211747
Level 18 Chipist
Stupe
 
 
 
post #211747 :: 2025.02.26 8:23am :: edit 2025.02.26 8:26am
  
  qjesse, Viraxor, mirageofher, Baron Knoxburry, YQN, Wegfrei, SRB2er, Da Flarf, arceus413 and DefenseMechanism liēkd this
Has your computing experience got you feeling BLUE? SCREENing your calls in fear of that big software BILL? GATES through which you used to pass with ease are now closing to you? Fellas, nobody likes talking about it, but maybe it even has you feeling MICROSOFT? Well, I think that once you try this GEM, you'll TOS all your old favorite operating systems out your WINDOWS

 
 
211877
Level 12 Mixist
Da Flarf
 
 
post #211877 :: 2025.02.28 2:32pm
Question: since we banned ChatGPT from the site, does that mean that if an inexperienced chiptuner were to query it about chiptune, it wouldn't reference this site?
 
 
211882
Level 30 Chipist
TristEndo
 
 
 
post #211882 :: 2025.02.28 4:58pm
  
  DoctaProtolin, puke7, Viraxor, mirageofher, Wegfrei, Stupe, kinkinkijkin, arceus413, Lasertooth, Da Flarf and CouldntBeMe liēkd this
Chat gpt came to battle of the bits to seek the guidance and wisdom of the great vombot. lord of all chatting robots known to mankind.
 
 
212184
Level 4 Criticist
Gordon Freeman
 
 
post #212184 :: 2025.03.03 9:29pm
  
  retrokid104, Da Flarf and SweatyNoodle liēkd this
whacking robot ai drones with a crowbar seems to work in my experience
 
 
212260
Level 25 Chipist
Viraxor
 
 
 
post #212260 :: 2025.03.05 2:23am
  
  Da Flarf liēkd this
sue openai for collateral damage
 
 
216842
Level 11 Playa
VirtualMan
 
 
post #216842 :: 2025.05.09 9:26am
  
  arceus413 liēkd this
@puke7, have you considered this traffic blocker designed to stop AI bots from overrunning your servers DDoS-style? It is used by <kernel.org>, <archlinux.org>, and other Windows-fanboi domains:

https://github.com/TecharoHQ/anubis

If the mole-whacking gets you to the finish line, great—but that goalpost moves faster by the day.

 
 
216855
Level 30 Hostist
puke7
 
 
 
post #216855 :: 2025.05.09 1:16pm :: edit 2025.05.09 1:58pm
  
  VirtualMan, big lumby and Flaminglog liēkd this
i see .js and .go files

how do i run this on shared hosting where i'm not allowed to install any services and am expected to run lamp stack only?

i appreciate the suggestion but it would require upgrading hosting to a VPS or similar and the size of the archive makes this prohibitively expensive unless the current monthly pull from patreon tripled and even then i would be wary of it receding and myself being left with an inability to continue making hosting payments
 
 

LOGIN or REGISTER to add your own comments!