Blocking scrapers, bots, and AI
BotB Academy News
 
 
Hey, folks, anyone remember last Wednesday when ChatGPT basically DDOSed this website? Yeah, BotB wouldn't load for about an hour and I had to get help from Dreamhost to get it running again. The technician that helped me, Nick, pointed out we were getting obscene traffic from some bots.

So what I've been doing since then is looking for groups of self-similar IP addresses loading pages from the site. Using https://viewdns.info I can get some semblance of where the requests are coming from. A lot of these IP clusters are coming from web host IP ranges so what I've been doing is blocking their entire IP range in kind.

List of Hosts now Blocked:
Alibaba/Aliexpress Cloud
Anexia.at
AWS (but not the IP where BotB Bot lives)
ChatGPT
DZCRD
ethr.net
Global Connections Network
Huawei Cloud
ImageSift
NetCup
RIPE (which may or might not be some positive european google initiave)
Semrush
Tesonet
Web2Objects

I have not been blocking potential search engine web spiders like Google and Microsoft. I've had 5 of these "whack a mole" sessions since "the attack". I'm sure there are more to come.

Potential Issues:
It is absolutely possible that I am blocking folks that have nothing to do with scummy bots. If this is the case then they are being denied access to BotB. If you or anyone you know (that isn't banned from BotB) has had this experience please let me know and I will unblock them! You can find out what your IP address is by using this: https://whatismyipaddress.com/

Sorry it didn't occur to me sooner to do this. So far it seems to be helping quite a bit with page load times. Thanks, everyone!
 
 
battle of the bots
 
 
Level 30 Hostist
puke7
 
 
 
post #211223 :: 2025.02.20 12:37pm ::
  
  Flaminglog, RevvoBolt, sean, Caffeinator, ItsDuv, mirageofher, Bingies24, SRB2er and arceus413 liēkd this
...and by last Wednesday I meant last week's Wednesday and not yesterday's Wednesday
 
 
help my definitely not ai generated essay keeps talking about some guy called Vombot (főzelékfaló)
 
 
Level 15 Chipist
Da Flarf
 
 
post #211226 :: 2025.02.20 1:14pm ::
  
  RevvoBolt, qjesse, YQN and arceus413 liēkd this
Can vombot help me write my college application essay?
 
 
fuck 'em! get that LLM training shit off our lawn
 
 
Level 15 Chipist
Da Flarf
 
 
post #211243 :: 2025.02.20 6:44pm :: edit 2025.02.21 10:40am ::
  
  RevvoBolt, TiffanyNeat and mirageofher liēkd this
A month from now we need a lyceum article for the bot wars
 
 
Level 22 Chipist
SweatyNoodle
 
   
 
post #211244 :: 2025.02.20 6:52pm ::
  
  RevvoBolt, Collidy and SweatyNoodle liēkd this
oh shoot it just went up to 100 guests again
 
 
Level 27 Chipist
Collidy
 
 
 
post #211252 :: 2025.02.21 2:52am ::
  
  SRB2er liēkd this
ooh first time ever saw announcement news created by this day and age
 
 
Level 24 Chipist
SRB2er
 
 
 
post #211255 :: 2025.02.21 4:30am :: edit 2025.02.21 11:25am ::
  
  Collidy, YQN and retrokid104 liēkd this
@SweatyNoodle ..did you just like your own post?

what the fuck-
 
 
Level 24 Signalist
luna197
 
 
 
post #211257 :: 2025.02.21 4:43am ::
  
  Flaminglog, YQN, SweatyNoodle, Collidy and luna197 liēkd this
yeah they did
 
 
Level 23 Chipist
retrokid104
 
 
 
post #211276 :: 2025.02.21 9:04am ::
  
  Collidy, luna197, YQN, SweatyNoodle and retrokid104 liēkd this
it's easy
 
 
Level 24 Chipist
SRB2er
 
 
 
post #211288 :: 2025.02.21 11:34am ::
  
  retrokid104, Collidy and Da Flarf liēkd this
what the fuck am I missing here
there is no liek button on my posts
is this a firki markup thing or smth
because if not, then im gonna


,?!?!?@?÷(×(]@♧3$2₩29•0☆¿
 
 
Level 15 Chipist
Da Flarf
 
 
post #211290 :: 2025.02.21 12:04pm ::
  
  Viraxor, Xaser, Surfcroc, Luigi64, retrokid104, Collidy, puke7, ItsDuv and arceus413 liēkd this
bro swearing in 2 different currencies
 
 
Level 25 Chipist
YQN
 
 
 
i just hope that now LLM's will use "slug" as a synonym for "result"
 
 
deez LLMs can Lick Lick Muh balls
 
 
Level 21 Mixist
CouldntBeMe
 
 
 
post #211343 :: 2025.02.21 9:16pm :: edit 2025.02.21 9:17pm ::
  
  YQN, Lasertooth and CouldntBeMe liēkd this
oh hey i just figured it out
 
 
Level 29 Chipist
nitrofurano
 
 
 
post #211387 :: 2025.02.22 2:42pm ::
  
  kinkinkijkin, retrokid104 and LukeIGuess_ liēkd this
  
  Da Flarf hæitd this
I'd block microsoft
 
 
Level 30 Hostist
puke7
 
 
 
but not google?

that's fucked
 
 
Level 15 Chipist
Da Flarf
 
 
post #211502 :: 2025.02.23 12:32pm ::
  
  Viraxor, Luigi64, Jangler, pedipanol, arceus413, kinkinkijkin and SweatyNoodle hæitd this
  
  retrokid104 liēkd this
say what you will about microsoft... but at least their OS can run .exe
 
 
Level 29 Chipist
arceus413
 
 
 
post #211550 :: 2025.02.23 7:56pm ::
  
  Viraxor, kinkinkijkin and big lumby liēkd this
sorry i use reactos
 
 
Level 15 Chipist
Da Flarf
 
 
post #211579 :: 2025.02.24 7:01am ::
  
  VirtualMan liēkd this
  
  Viraxor, arceus413, Lasertooth and kinkinkijkin hæitd this
come to think of it, I should have guessed that BOTB would be full of linux stans
 
 
Level 20 Mixist
kinkinkijkin
 
 
 
post #211580 :: 2025.02.24 7:28am ::
  
  Viraxor and arceus413 liēkd this
ReactOS isn't Linux, everything can run windows executables these days. Everything. Haiku can run windows executables. PPC OSX can run windows executables. Android can run windows executables. The fuckin wii u can run windows executables if you've got enough time on your hands.

Filename extension also isn't real, by the way. Hasn't been since the early 90s.
 
 
Level 15 Chipist
Da Flarf
 
 
post #211582 :: 2025.02.24 8:07am ::
Ah I was mistaken. I see that ReactOS is Aldi brand Windows. I thought it was a niche linux distro. My bad.
 
 
Level 22 Chipist
Stupe
 
 
 
post #211588 :: 2025.02.24 9:05am ::
  
  dobra, VirtualMan, Gordon Freeman and Da Flarf liēkd this
ur mom is aldi brand windows lololol
 
 
Level 15 Chipist
Da Flarf
 
 
post #211594 :: 2025.02.24 9:30am ::
HEY MAN!!! MY MOM IS A KIND AND CARING PERSON!!! HOW DARE YOU :(

TAKE THAT BACK RIGHT NOW OR MY DAD IS GONNA COME TO YOUR HOU-
 
 
Level 31 Chipist
damifortune
 
 
 
any thread can be a thread about operating systems if you try hard enough
 
 
Level 23 Pixelist
The Diad
 
 
 
post #211696 :: 2025.02.25 6:16pm ::
  
  dobra, retrokid104, VirtualMan, Viraxor, Gordon Freeman, Baron Knoxburry, Da Flarf and kinkinkijkin liēkd this
Maybe the real operating system was the friends we made along the way
 
 
Level 15 Chipist
Da Flarf
 
 
post #211700 :: 2025.02.25 8:01pm ::
  
  Viraxor liēkd this
This conversation was a Window to my soul
 
 
Level 22 Chipist
SweatyNoodle
 
   
 
post #211729 :: 2025.02.26 3:00am ::
  
  Wegfrei and Stupe liēkd this
scraper? hardly know 'er
 
 
Level 22 Chipist
Stupe
 
 
 
post #211747 :: 2025.02.26 8:23am :: edit 2025.02.26 8:26am ::
  
  qjesse, Viraxor, mirageofher, Baron Knoxburry, YQN, Wegfrei, SRB2er, Da Flarf, arceus413 and DefenseMechanism liēkd this
Has your computing experience got you feeling BLUE? SCREENing your calls in fear of that big software BILL? GATES through which you used to pass with ease are now closing to you? Fellas, nobody likes talking about it, but maybe it even has you feeling MICROSOFT? Well, I think that once you try this GEM, you'll TOS all your old favorite operating systems out your WINDOWS

 
 
Level 15 Chipist
Da Flarf
 
 
post #211877 :: 2025.02.28 2:32pm ::
Question: since we banned ChatGPT from the site, does that mean that if an inexperienced chiptuner were to query it about chiptune, it wouldn't reference this site?
 
 
Level 30 Chipist
TristEndo
 
 
 
Chat gpt came to battle of the bits to seek the guidance and wisdom of the great vombot. lord of all chatting robots known to mankind.
 
 
Level 4 Criticist
Gordon Freeman
 
 
post #212184 :: 2025.03.03 9:29pm ::
  
  retrokid104, Da Flarf and SweatyNoodle liēkd this
whacking robot ai drones with a crowbar seems to work in my experience
 
 
Level 25 Chipist
Viraxor
 
 
 
post #212260 :: 2025.03.05 2:23am ::
  
  Da Flarf liēkd this
sue openai for collateral damage
 
 
Level 12 Playa
VirtualMan
 
 
post #216842 :: 2025.05.09 9:26am ::
  
  arceus413 liēkd this
@puke7, have you considered this traffic blocker designed to stop AI bots from overrunning your servers DDoS-style? It is used by <kernel.org>, <archlinux.org>, and other Windows-fanboi domains:

https://github.com/TecharoHQ/anubis

If the mole-whacking gets you to the finish line, great—but that goalpost moves faster by the day.

 
 
Level 30 Hostist
puke7
 
 
 
post #216855 :: 2025.05.09 1:16pm :: edit 2025.05.09 1:58pm ::
  
  VirtualMan, big lumby and Flaminglog liēkd this
i see .js and .go files

how do i run this on shared hosting where i'm not allowed to install any services and am expected to run lamp stack only?

i appreciate the suggestion but it would require upgrading hosting to a VPS or similar and the size of the archive makes this prohibitively expensive unless the current monthly pull from patreon tripled and even then i would be wary of it receding and myself being left with an inability to continue making hosting payments
 
 

LOGIN or REGISTER to add your own comments!