Really old, really BIG league

ovccsteve · 03-01-2018, 03:26 PM

I have a fictional league that is approaching its 100th anniversary, but I'm afraid it's not going to make it. It takes up about 100 gig on my hard drive, which is just too much, and I'm afraid if I move it external it would be too slow. Right now, backing it up to an external takes over an hour, and the year-end transition is measured in hours (and hours).
Does anyone know of a way that I can retire the league, but still have access to some of its memories, like old versions of OOTP had almanacs?

NoOne · 03-02-2018, 04:49 PM

zip up the asthetic / unused old stuff per directory -- can even leave the archive in there if you wanted to.. i'd suggest a safe "off-site" location.

the images and news and just about everyhting can be compresses ~99%. maybe just he text stuff reaches 99%, but it's more than it looks like. you also save on 'blocks'... a 1kb file takes up 4kb of space on most modern HDD. (check block size, older hdd typically have larger blocks -- doubt they are still running today.)

if you don't care bout 100,000 face pics, delete them for old players. (date on image file may tell you where that horizon is safe to cut)

you can set it so it only creates a face pic on demand... that will save a tone of space. if you haven't clicked them, it's not generated.

the type of data you save can be slimmed down -- some thigns can be rebuilt... e.g. you can disable those thigns that can be rebuilt solely from a boxscore as needed.

mil stuff-- turn off completely? or same personal choices you used for MLB etc.

deleting players doesnt' do anything to size.. they remain in dB, unless purged, see below - don't do it.

with 100 years i don't think a purge will really make much of a difference, and that will 100% screw up all th old newspaper links to player profiles. it'll reak okay, but clicks will take yo to the new player with that playerid...

(playerid is key field, it's auto-incremented and must stay in order... so it re-organizes after a "purge" of the dB. same players, new playerid's across board inevitable. and not a huge savings in space... 10,000players is nothing, for exmaple. it's text in a dB. Mbytes, not Gbytes. unlike above it's part of a larger contigous file, so it's not 1kb taking up 4kb situation)

So, before making any choices i'd perus which directories are the hogs... prbably news and messages stuff. you don't have to get rid f it all, but it might require you to unzip it when you want ot read it or use it.

almanac? not experienced on available options.. if each time you make it it is a new copy and "whole" you can delete old copies.. ?? have to read screen and apply some critical thought in that realm...

zipping/rar'ing is always an option for somethign that sits unused on the side.

I made a suggestion about he game archiving this stuff or somethign similar on more than one occasion. another thread won't hurt in the suggestions forum

programs can read from an archive and only uncompress specific files as needed and it wouldn't even be noticeable to a human's eye as far as load times. not only that it'll be way less wear'n'tear on hdd/ssd i bet. i've never seen a game so write/read intense in my life. it cuases larger and constant queueing than a torrent download.

not a great parralel becaue i don't keep much outside of boxscores and do not make an almanac, face pics are disabled -- ~55years it's upto 1.2GB ... 100gb? holy %$#@! what are you doing, lol... kidding a bit.. 95% joking. really 100gb? lol

if it were a "full" world with all international leagues i'd wager 5gb or so. so you shoudl have a goal of ~15-20GB or less.. i think that'd be easily possible and retain all that you want to keep. (plus any size of 1 almanac? extra?)

ovccsteve · 03-02-2018, 05:59 PM

Thanks! I'll see if I can put this world on a diet.

(Almanacs used to be large files kept separate from league files, so you could access them using a browser, or even delete if you decided you didn't want access to the old info.)

bwburke94 · 03-02-2018, 07:25 PM

Quote:

Originally Posted by ovccsteve

(Almanacs used to be large files kept separate from league files, so you could access them using a browser, or even delete if you decided you didn't want access to the old info.)

Aren't they still stored in a format where they can be kept separate?

03-01-2018, 03:26 PM	#1
ovccsteve All Star Reserve Join Date: Jan 2004 Location: Sanford, NC Posts: 571	Really old, really BIG league I have a fictional league that is approaching its 100th anniversary, but I'm afraid it's not going to make it. It takes up about 100 gig on my hard drive, which is just too much, and I'm afraid if I move it external it would be too slow. Right now, backing it up to an external takes over an hour, and the year-end transition is measured in hours (and hours). Does anyone know of a way that I can retire the league, but still have access to some of its memories, like old versions of OOTP had almanacs?

03-02-2018, 04:49 PM	#2
NoOne Banned Join Date: Apr 2015 Posts: 7,273 Infractions: 0/1 (3)	zip up the asthetic / unused old stuff per directory -- can even leave the archive in there if you wanted to.. i'd suggest a safe "off-site" location. the images and news and just about everyhting can be compresses ~99%. maybe just he text stuff reaches 99%, but it's more than it looks like. you also save on 'blocks'... a 1kb file takes up 4kb of space on most modern HDD. (check block size, older hdd typically have larger blocks -- doubt they are still running today.) if you don't care bout 100,000 face pics, delete them for old players. (date on image file may tell you where that horizon is safe to cut) you can set it so it only creates a face pic on demand... that will save a tone of space. if you haven't clicked them, it's not generated. the type of data you save can be slimmed down -- some thigns can be rebuilt... e.g. you can disable those thigns that can be rebuilt solely from a boxscore as needed. mil stuff-- turn off completely? or same personal choices you used for MLB etc. deleting players doesnt' do anything to size.. they remain in dB, unless purged, see below - don't do it. with 100 years i don't think a purge will really make much of a difference, and that will 100% screw up all th old newspaper links to player profiles. it'll reak okay, but clicks will take yo to the new player with that playerid... (playerid is key field, it's auto-incremented and must stay in order... so it re-organizes after a "purge" of the dB. same players, new playerid's across board inevitable. and not a huge savings in space... 10,000players is nothing, for exmaple. it's text in a dB. Mbytes, not Gbytes. unlike above it's part of a larger contigous file, so it's not 1kb taking up 4kb situation) So, before making any choices i'd perus which directories are the hogs... prbably news and messages stuff. you don't have to get rid f it all, but it might require you to unzip it when you want ot read it or use it. almanac? not experienced on available options.. if each time you make it it is a new copy and "whole" you can delete old copies.. ?? have to read screen and apply some critical thought in that realm... zipping/rar'ing is always an option for somethign that sits unused on the side. I made a suggestion about he game archiving this stuff or somethign similar on more than one occasion. another thread won't hurt in the suggestions forum programs can read from an archive and only uncompress specific files as needed and it wouldn't even be noticeable to a human's eye as far as load times. not only that it'll be way less wear'n'tear on hdd/ssd i bet. i've never seen a game so write/read intense in my life. it cuases larger and constant queueing than a torrent download. not a great parralel becaue i don't keep much outside of boxscores and do not make an almanac, face pics are disabled -- ~55years it's upto 1.2GB ... 100gb? holy %$#@! what are you doing, lol... kidding a bit.. 95% joking. really 100gb? lol if it were a "full" world with all international leagues i'd wager 5gb or so. so you shoudl have a goal of ~15-20GB or less.. i think that'd be easily possible and retain all that you want to keep. (plus any size of 1 almanac? extra?) Last edited by NoOne; 03-02-2018 at 04:58 PM.

03-02-2018, 05:59 PM	#3
ovccsteve All Star Reserve Join Date: Jan 2004 Location: Sanford, NC Posts: 571	Thanks! I'll see if I can put this world on a diet. (Almanacs used to be large files kept separate from league files, so you could access them using a browser, or even delete if you decided you didn't want access to the old info.)