[18:23:45] <Jiyoshi> I wonder if it is feasible to download every single song off of botb

I haven't worked out any specifics of how it would work, but I think it would be a good idea to have some sort of botb torrent tracker, similar to the one on ModArchive. I'm not sure who would host this initially but I guess if enough people kept seeding it, it'd be alive.

http://tracker.modarchive.org/

How the torrents would be allocated could be like modarchive, by year so new additions will just be added every year. Another idea discussed was by format, but this would probably also need to be by year as well.

Great idea, i'm seconding this

well.. someone wanna set up a private tracker with a common login/password? don't want someone scraping peoples' passwords, etc.

usa is probably gonna crack down with public tracker torrenting name servers in a bit with mandatory blacklisting via main ISPs or new ICANN administration. (fucking fascists... :( )

I've recently got a new server for my sav.estate domain. I'll look into it!

nice nice... let's try to keep the tracker fairly legal and clean. all general botb guidelines and standards should be respected in association. :)

edit: I know puke set up some old, backdoor links for leeching. You just have to private message him if you're a responsible host of BotB-associated material and will seed. :)

i also have server power and can help host :o

can provide services too


that means malmen will provide as well

alright! we're online. see if you guys can download this here fancy magnet link

it's an nsf file

the tracker is udp://sav.estate:6969

it's currently set to whitelist torrents, so you can't use it as your everyday tracker

Next I'll ask pukez about dling all of BotB's entries. i'll need to see how many gigs/tb it is so i can figure out how big of an HDD to get.

btw i made the tracker by building opentracker in whitelist mode. if any of you guys want to set up trackers as well as backup, in case mine goes down for any reason, that'd be sick !

Tracker works. Smooth DPCM. :)

If you DL all the entries, you may want to set up some sort of throttling and be patient. :)

If you include renders the archive is around 65gb.

My life is pretty hectic right now until around Feb 12th.

Don't worry about it. I'll make a bot to scrape entries at a sane pace if that's alright (think programmed to go about the speed of what a human can do)

I'll have them (the torrents) separated by year, and renders / original formats.

hey did you take down that test torrent, savestate? i can't download it. maybe i did something rong tho

My computer is unplugged rn lol. I took it to a game night and haven't gotten around to setting it back up. I'm gonna hook up my PI and my external HDD tho so I always got a connection. You'll have to give me a few days tho to get everything setup (school)

So uh, if there's going to be renders included, would there be interest in having the .mp3s tagged? It would be awesome if there could be a way for them to be auto-tagged, but if not, I could always just keep doing this :
http://imgur.com/a/Cw8tw
and maybe put *some* on the tracker/reupload? idk.
_{I like having my mp3s tagged is that ocd}

Hmm, I'll see if i can pull off some BotB API magic ~

i think i had a botb autotagging script at one point

it would be pretty easy to rewrite one even without the api

I thought about doing a non-api tagging system using the HTML, but then I don't get to use the BotB API ):

i made an API-using botb autotagging program. didn't realize the API returned all that info! wasn't sure what to do about track numbers, so it doesn't do that. built for: linux 64, windows 64, osx 64, linux arm. the only doc is in the usage/help message and source code.

uhh there's probably other stuff i'm forgetting to say

https://github.com/jangler/botbtools/releases/tag/botbtag-1.0.0

edit: oh yeah, it's not perfect with titles with entries with periods (maybe other special characters? probly. not at home and didn't have time to test). this is because the API does not like periods. also ambiguous titles (ones that match multiple entries).

fixed the bad things

https://github.com/jangler/botbtools/releases/tag/botbtag-1.1.0

yeah... pay for that bump, jitch!

progress !!

(its an image)

the github page

now i just need to implement saving cookies so u dont do the login notif each time you open the app

cookies!! mm
http://i.imgur.com/ohZILF1.png

how is this coming along?

forgot about it aha, many things have distracted me. gonna work on this again now that you've reminded me

hells yeah http://i.imgur.com/JUjnyo6.png
mp3 tagging thanks to the api and a cool library

gonna start the dling tonite, 2 seconds in between each download, just the 1st year tho, and i'll put a link to the torrent when done

edit: aha ! it seems ive been thwarted by technology http://i.imgur.com/mDikaVn.png

gonna work on this one,...

posting this here so i can reference it later:

from decadent decade
------------------------------
oh hey! it's x e m o g a s a for a brand new tutorial on b o t b !!!!!
today we're gonna learn how to use gloggy-chan's soundclop (thx R3M for hosting) to search for one song per year for botb's new compo, BotB's Decadent Decade!!
first, go to gloggy's soundclop : http://botb.club/~golgi/soundclop/
see that blue wtfizer part? enter the following values for each year you want :
2005: min1-max83
2006: min84-max1035
2007: min1036-max1728
2008: min1729-max3060
2009: min3061-max4049
2010: min4050-max5599
2011: min5600-max7156
2012: min7157-max9790
2013: min9791-max13675
2014: min13676-max17747
now, click the wtf??? button for a random track! when you hear a track you like, click the blue number just above the wtfizer to open it in a new tab!
and that's it!! happy (sound)clopping!!!!

figuring out the character set problem made me hate encodings and my solution is not very elegant but i guess it works ? ? currently dling 1-83

I'm pretty sure the current server uses UTF-8 for filenames, but I could be wrong. For most of the site's history it was ISO-8859. I don't know if that helps at all. Liek, it could still be ISO, because the site intercepts donloads and uses redirects/forwarding to give the intended UTF-8 filenames. I have no idea how well glogi's soundclop handles this, but many illegal filename characters are replaced with an underscore.

this commit

(for the most part) fixed the problem. by double decoding the url on an entry page's donload button, i was able to get a sane filename, utf-8 compatible too!