Server- Forum Issues

TC Dale · 09-30-2005, 03:54 AM

Quick update about the forums.

On Wednesday, Sept. 28th, the server "hanged" and we requested a reboot. But the server didn't start again and support told us that they will have to install a new harddisk with a fresh system on it, also installing the old harddisk as a slave drive.

The crash occured at noon during the backup run, and it's obviously not been a hardware problem, but a file system problem. The only backups that were not on the server HD and the forums HD, were two backup sets from July 17th, the other one from March.

After long discussions about trying to rescue the old HD file system which turned out to be corrupt, we found out we were not able to recover the latest backups since there were bad sectors, and total sections that were unrecoverable.

The crash occured at the backup around noon like all scheduled backups, which also regretfully interrupted files that were needed to reinstall the most recent forum file system information. When the server reset, it also left us without a complete backup except for the July and March backups which were in other locations.

For now I believe that Andreas will build from the July 17th database, and go from there since all the other backup databases from the 7/17 on were unusuable due to the catastrophic crash during a backup, and a HD failure.

This isn't a lot, but some info in a nutshell on the situation.

ctorg · 09-30-2005, 04:20 AM

Wow. That's a lot to lose!

SandMan · 09-30-2005, 04:28 AM

It is just hard to imagine losing all that data. I would have thought they would have had this database mirrored somewhere..... seems too valuable to lose.

Wow: even the post count go back into history...bummer, took me a while to hit the 1000 mark but did it and now I got to go back to 760.....

metsgeek · 09-30-2005, 04:32 AM

Seriously unbelievable, guys. The first thing that everyone learns is to back up your data and put it on a mirror server.

It's beyond amateur. You're going to have a barrage of pissed off users, especially in the Dynasty Forums

fhomess · 09-30-2005, 04:33 AM

That's pretty sad. And by sad, I really mean pathetic. The backup should never be able to be affected by the main server's crash. That's the whole point of the backup. I'm almost surprised there's a July 17th backup to revert to given the rest of the information.

endgame · 09-30-2005, 04:49 AM

Quote:

Originally Posted by SandMan

It is just hard to imagine losing all that data. I would have thought they would have had this database mirrored somewhere..... seems too valuable to lose.

Wow: even the post count go back into history...bummer, took me a while to hit the 1000 mark but did it and now I got to go back to 760.....

Shame...., it really is, the value of that information was comparitively priceless to some of us. I'm assuming the issue is a done deal: irrevocable, corrupt is corrupt and no hope. But who am I?

With this catastrophe on their minds, I'm sure the attention is spread in many directions. I'm thinking it's up to us, or those willing, to begin some resurrection of key concepts and threads at work the last we knew. Specifically, the 6.5b feedback thread. I see Larry has already regenerated an introduction the the Anderson Utilities. And of course, opinions will differ, but a major hit on the updates in Feedback, Troubleshooting, etc...

Here's hoping there's a hope I'm unaware of, but we forge on nonetheless. I'm glad you guys are out there. It felt a little strange when I found the dugout emptied. Not a good feeling.

sebastian0622 · 09-30-2005, 04:54 AM

Wait, does this mean I'm not a Hall-of-Famer any more? :sad:

SandMan · 09-30-2005, 04:56 AM

Quote:

Originally Posted by metsgeek

Seriously unbelievable, guys. The first thing that everyone learns is to back up your data and put it on a mirror server.

It's beyond amateur. You're going to have a barrage of pissed off users, especially in the Dynasty Forums

This is MY New Orleans!!!! Not really pissed, but amazed that they had no contingency plans in the event of this. Every company I worked for had something to prevent this from happening. Can you imagine Ford saying, "We lost data on our system and now we don't know how many orders were placed for the next two months.".... This board is what made OOTP the game what it is today. Without this board I think the game would have died a while back....or be in the $5 discount CD bin at Office Max (where I first found Season Ticket Baseball).........

sebastian0622 · 09-30-2005, 05:01 AM

This sucks, but not for me. I mostly feel for dynasty writers. Tib and his crew of loyal readers (of which I was starting to be part) come to mind first.

Some really poor professional decisions were made along the line. If something like this happened at any company with more than a handful of employees, heads would roll and people would be fired.

Y0DA55 · 09-30-2005, 05:05 AM

Since July 17, I think Tib has written like 3 chapters. But I wouldn't be surprised if he saves them.

But yeah, big hit for the dynasties.

GForce · 09-30-2005, 05:16 AM

yup...my Austin James dynasty is effectively killed.

GH

theasfl · 09-30-2005, 05:20 AM

manually override post counts might cheer up the moral a little bit, but it would take a long ass time and not everyone knows their previous count...

either way its sad, pathetic and sad, sad all in one. When the boards didnt come right back I knew something horrible had gone wrong and look where we are now.

Logos have been lost, dynasties are dead...its the equivilent of Hiroshima to OOTP...its completely obliterated everything built, but the foundations are still there. Will radiation poisoning eradicate the rest? or can we build from the foundations of the great board this was?

Kevin · 09-30-2005, 05:25 AM

???

Backing up to the same hard drive, ...... unbelievable.

CONN CHRIS · 09-30-2005, 05:30 AM

This is tough to swallow, I lost 1,400 or so posts, roughly 1,300 or so were in the nature of photos and fighter files for others to download, so it isn't just mindless spam that is gone.

Thankfuly, I have my TBCB 'dynasty' on a seperate site, but we have a number of folks who had great little universes going down in the basement that have just been wiped out.

It hardly is the end of the world as we know it, but the best part of these games for many here are the communities that have evolved on-line based upon the games. Hopefully some lessons can be learned by the powers that be and we can all cut them a little slack while they re-group.

However, this does indeed suck.

LeiterFanatic · 09-30-2005, 05:36 AM

And you wonder why they can't kill some of these bugs!

AnotherAlias · 09-30-2005, 05:39 AM

Stupid question #1

Doesn't .400 software studios have any older data that they could sell us.

There are a ton of great posts of mine that are now in cyberspace hell.

GForce · 09-30-2005, 05:49 AM

Quote:

Originally Posted by CONN CHRIS

This is tough to swallow, I lost 1,400 or so posts, roughly 1,300 or so were in the nature of photos and fighter files for others to download, so it isn't just mindless spam that is gone.

Thankfuly, I have my TBCB 'dynasty' on a seperate site, but we have a number of folks who had great little universes going down in the basement that have just been wiped out.

It hardly is the end of the world as we know it, but the best part of these games for many here are the communities that have evolved on-line based upon the games. Hopefully some lessons can be learned by the powers that be and we can all cut them a little slack while they re-group.

However, this does indeed suck.

Suck doesn't even begin to cover it. How these guys, supposed professionals, allowed this to happen, is just ridiculous. I'm just curious if someone is actually going to step up and take the blame for the positively asinine decision to back up to the same hard drive. A lot of people have lost a lot of things they put a great deal of time and effort into....not meaningless posts but major contributions. All washed away.

GH

GForce · 09-30-2005, 05:50 AM

Quote:

Originally Posted by theasfl

manually override post counts might cheer up the moral a little bit, but it would take a long ass time and not everyone knows their previous count...

either way its sad, pathetic and sad, sad all in one. When the boards didnt come right back I knew something horrible had gone wrong and look where we are now.

Logos have been lost, dynasties are dead...its the equivilent of Hiroshima to OOTP...its completely obliterated everything built, but the foundations are still there. Will radiation poisoning eradicate the rest? or can we build from the foundations of the great board this was?

Who gives a rat's ass about post counts? So much that was so vastly more important than that has been lost through this debacle.

GH

pompeytir · 09-30-2005, 05:53 AM

SA's get fired for this type of incompetance; it really is ridiculus that there wasn't a better plan of action.

IatricSB · 09-30-2005, 05:55 AM

Snit happens

09-30-2005, 04:20 AM	#2
ctorg Global Moderator Join Date: Nov 2002 Location: Queens, NY Posts: 9,848	Wow. That's a lot to lose! __________________ My music "When the trees blow back and forth, that's what makes the wind." - Steven Wright Fjord emena pancreas thorax fornicate marmalade morpheme proteolysis smaxa cabana offal srue vitriol grope hallelujah lentils

09-30-2005, 04:28 AM	#3
SandMan Hall Of Famer Join Date: Aug 2003 Posts: 2,946	Wow.... It is just hard to imagine losing all that data. I would have thought they would have had this database mirrored somewhere..... seems too valuable to lose. Wow: even the post count go back into history...bummer, took me a while to hit the 1000 mark but did it and now I got to go back to 760..... Last edited by SandMan; 09-30-2005 at 04:30 AM.

09-30-2005, 04:32 AM	#4
metsgeek Hall Of Famer Join Date: Dec 2002 Location: Norwood, MA Posts: 5,450	Seriously unbelievable, guys. The first thing that everyone learns is to back up your data and put it on a mirror server. It's beyond amateur. You're going to have a barrage of pissed off users, especially in the Dynasty Forums __________________ Commissioner - PBRL - Just finished 2009 109 seasons and still running strong!!! Last edited by metsgeek; 09-30-2005 at 04:39 AM.

09-30-2005, 04:33 AM	#5
fhomess Hall Of Famer Join Date: Nov 2002 Posts: 3,693	That's pretty sad. And by sad, I really mean pathetic. The backup should never be able to be affected by the main server's crash. That's the whole point of the backup. I'm almost surprised there's a July 17th backup to revert to given the rest of the information. __________________ StatsLab- PHP/MySQL based utilities for Online Leagues Baseball Cards - Full list of known templates and documentation on card development.

09-30-2005, 05:05 AM	#10
Y0DA55 All Star Starter Join Date: Apr 2004 Location: In the middle of the Yankees/Red Sox Rivalry Posts: 1,771	Since July 17, I think Tib has written like 3 chapters. But I wouldn't be surprised if he saves them. But yeah, big hit for the dynasties. __________________ Do, or do not, there is no try!

09-30-2005, 03:54 AM	#1
TC Dale Global Moderator Join Date: May 2002 Posts: 4,979	Server- Forum Issues Quick update about the forums. On Wednesday, Sept. 28th, the server "hanged" and we requested a reboot. But the server didn't start again and support told us that they will have to install a new harddisk with a fresh system on it, also installing the old harddisk as a slave drive. The crash occured at noon during the backup run, and it's obviously not been a hardware problem, but a file system problem. The only backups that were not on the server HD and the forums HD, were two backup sets from July 17th, the other one from March. After long discussions about trying to rescue the old HD file system which turned out to be corrupt, we found out we were not able to recover the latest backups since there were bad sectors, and total sections that were unrecoverable. The crash occured at the backup around noon like all scheduled backups, which also regretfully interrupted files that were needed to reinstall the most recent forum file system information. When the server reset, it also left us without a complete backup except for the July and March backups which were in other locations. For now I believe that Andreas will build from the July 17th database, and go from there since all the other backup databases from the 7/17 on were unusuable due to the catastrophic crash during a backup, and a HD failure. This isn't a lot, but some info in a nutshell on the situation. __________________ ----------------------------------

09-30-2005, 04:54 AM	#7
sebastian0622 Banned Join Date: Apr 2003 Posts: 3,465	Wait, does this mean I'm not a Hall-of-Famer any more? :sad:

09-30-2005, 05:01 AM	#9
sebastian0622 Banned Join Date: Apr 2003 Posts: 3,465	This sucks, but not for me. I mostly feel for dynasty writers. Tib and his crew of loyal readers (of which I was starting to be part) come to mind first. Some really poor professional decisions were made along the line. If something like this happened at any company with more than a handful of employees, heads would roll and people would be fired.

09-30-2005, 05:16 AM	#11
GForce Banned Join Date: May 2004 Posts: 3,458 Infractions: 0/2 (2)	yup...my Austin James dynasty is effectively killed. GH

09-30-2005, 05:20 AM	#12
theasfl Hall Of Famer Join Date: Apr 2004 Location: Coral Springs, FL or Orlando, FL (UCF) Posts: 7,988	manually override post counts might cheer up the moral a little bit, but it would take a long ass time and not everyone knows their previous count... either way its sad, pathetic and sad, sad all in one. When the boards didnt come right back I knew something horrible had gone wrong and look where we are now. Logos have been lost, dynasties are dead...its the equivilent of Hiroshima to OOTP...its completely obliterated everything built, but the foundations are still there. Will radiation poisoning eradicate the rest? or can we build from the foundations of the great board this was? __________________ All-Sports Fantasy League The ASFL 22 different games, 9 sports. Please check out the website (www.theasfl.com/asfl2/). The league is free- if you're interested please fill out the signup form and/or email the commissioner. Miami Talons (ABL): 2004, 2005 & 2008 Champs

09-30-2005, 05:25 AM	#13
Kevin All Star Reserve Join Date: Dec 2001 Location: Nova Scotia Posts: 503	??? Backing up to the same hard drive, ...... unbelievable. __________________ It seems more like today than it did all day yesterday.

09-30-2005, 05:30 AM	#14
CONN CHRIS Global Moderator Join Date: Oct 2004 Posts: 29,077	This is tough to swallow, I lost 1,400 or so posts, roughly 1,300 or so were in the nature of photos and fighter files for others to download, so it isn't just mindless spam that is gone. Thankfuly, I have my TBCB 'dynasty' on a seperate site, but we have a number of folks who had great little universes going down in the basement that have just been wiped out. It hardly is the end of the world as we know it, but the best part of these games for many here are the communities that have evolved on-line based upon the games. Hopefully some lessons can be learned by the powers that be and we can all cut them a little slack while they re-group. However, this does indeed suck. __________________ Check Out My Cards! Last edited by CONN CHRIS; 09-30-2005 at 05:31 AM.

09-30-2005, 05:36 AM	#15
LeiterFanatic All Star Starter Join Date: Mar 2003 Location: Miami, FL Posts: 1,358	And you wonder why they can't kill some of these bugs!

09-30-2005, 05:39 AM	#16
AnotherAlias Hall Of Famer Join Date: Aug 2002 Location: I'm back...for now Posts: 4,190	Stupid question #1 Doesn't .400 software studios have any older data that they could sell us. There are a ton of great posts of mine that are now in cyberspace hell.

09-30-2005, 05:53 AM	#19
pompeytir Minors (Rookie Ball) Join Date: Jun 2002 Posts: 33	SA's get fired for this type of incompetance; it really is ridiculus that there wasn't a better plan of action.

09-30-2005, 05:55 AM	#20
IatricSB Hall Of Famer Join Date: Dec 2001 Location: California Posts: 3,493	Snit happens __________________ Life is not a journey to the grave with the intention of arriving safely in a pretty and well preserved body; but rather to skid in broadside, thoroughly used up, totally worn out, and loudly proclaiming, "Wow! What a Ride!" Chicago(N) - Boys of Summer Oakland - 20th Century League Bakersfield - Wild Things Brooklyn - QBA Dodge City - NBSL California - ABC Dodger's Senioriest fan on the OOTP Boards