Historical database issues go here!

[actionjackson]

Another thing about the MLB Aaron Thompson bastige? He's a Bickerson, despite debuting in 2011. I think I have an old FaceGen of him sitting around somewhere, though. The Aaron M. Thompson thing sounds familiar from a past collection. I'll have a poke around for that, too. Ok, this dude is without the glorious facial hair, but at least he's not a Bickerson, anymore. I'll post him the FaceGen Pack Thread.

[actionjackson]

Ok, no dupes in that MiLB Master in either the LahmanID column, or the BBRefMLBid column, so all should be well. That's where these parasites latch on to unsuspecting big leaguers. Also, shuffling down the two columns, if there are any MLB IDs, they're in both columns. I think. *Fingers crossed*

Here's your Aaron Thompson guy with the no facial hair FaceGen, and proper ID. No other Aaron Thompson came in on import, and the stats are unique to him. He's...Uh...Somewhat different in the face than he was when that FaceGen was done, as you can see here:

https://www.baseball-reference.com/p...hompaa01.shtml

[actionjackson]

Imported MiLB SP Aaron Thompson, and MLB RP Aaron Thompson. RL Stats pages. No more tangly bits. MiLB guy on top. MLB guy on bottom.

MiLB guy has doubling up on everything error in 2009. Doesn't matter 'cause it's all about the ratios. At least that's what Spritze used to tell me.

[LansdowneSt]

https://www.baseball-reference.com/r...d=espino001hec

Mexican League legendary HR hitter, prob ought to be Hispanic as a facial type. For the list when the db is ready for historic correction review.

[Elbs]

Billy Southworth was born in Harvard, Nebraska. Please fix this, thanks

[LansdowneSt]

Originally Posted by Elbs

Billy Southworth was born in Harvard, Nebraska. Please fix this, thanks

There are a bunch of these. I think it is either because of limitations with the current database or because the city list is from an outside source that doesn't have all the little, small towns. Hence Willie Mays being from Massachusetts and not Alabama in the game... because there is a Mass town called Westfield in the provided database but not the little Alabama town of the same name.

[LansdowneSt]

Hovering over George Crosby's year in his Real Stats tab, the 1884 Chicago White Stockings came up as the Indianapolis Blues in error. Screenshot attached. The team abbreviation is correct. Just not sure why this name would come up for 1884. Indy was around for 1878 only and even if they merge into the Cubs for game purposes, that's not the name that should come up when hovering over the 1884 line.

[Lukas Berger]

Originally Posted by LansdowneSt

There are a bunch of these. I think it is either because of limitations with the current database or because the city list is from an outside source that doesn't have all the little, small towns. Hence Willie Mays being from Massachusetts and not Alabama in the game... because there is a Mass town called Westfield in the provided database but not the little Alabama town of the same name.

Yeah, both of these are reasons for the incorrect cities of birth.

The good news is that we're working on fixing this up. Both by adding a lot more missing cities to the db (we've added something like 8k missing US cities in the last couple months, with even more to come) and by fixing up the historical db to use the cities from the cities db, rather than picking random cities.

Even once we do that, we'll still have to work through fixing up any incorrect entries in the db that came from the old system, so this will probably be something of a multi-year project to get things totally fixed up. But it's very much on the to do list.

[SamNotSamuel]

*Post Deleted*

[AESP_pres]

Not sure if it goes here (at least that make sense to me)

The player first name is wrong in the game... looks like a typo since he is listed in the game as "Jophrey" but is real name is "Jophery".

Jophery Brown BBRef page

[Garlon]

I did not know that the game is showing the wrong Inningout totals in the historical record for players even when the files are correct. I do not know why that should happen.

For catchers the game never puts their SB and CS into their historical stats even though they are in the files. I do not know why.

As far as catcher arm rating is concerned, those are created based on their defensive stats and added to another column. The arm rating is based on their CS% relative to the league each season, and there are 3yr and career versions too. For seasons in which they did not have many attempts against them we then used their 3yr value or career value in order to obtain a realistic sample.

Originally Posted by actionjackson

@Garlon:

Two questions/observations, about discrepencies I've noticed when viewing the fielding.csv vs in game numbers:

1) Players who played less than one inning at a position (i.e. 0.1 innings or 1 InnOuts, or 0.2 innings, or 2 InnOuts), in a given year, will be given credit for 8.1 innings (if 0.1 innings), and 8.2 innings (if 0.2 innings) respectively. The figures are right in the fielding.csv files, but somehow, the game cannot accept fielding stints of less than 1.0 IP. Don't understand why it's doing it, but it happens for anyone who played for one or two outs at a position, in a given season.

2) I may have mentioned this before upthread, but a catcher's CS number is not shown in game. It's just zero. His SB/CS numbers are right there in the fielding.csv file, but nowhere to be found in game. The question is, is the game getting this info, but not displaying it, or is it not getting it at all?

Thanks in advance.

[LansdowneSt]

Was setting out to make a facegen for Rob Johnson (MLB Catcher, 2007-13, johnsro07) but in the historical database he has the incorrect Minors ID. He has johnso001tay which belongs to a contemporary that played rookie and independent ball. His ID should be johnso009rob.

[LansdowneSt]

Was having trouble finding a Pirates prospect as OOTP and bRef disagree on the spelling of the name. ID is correct though. Not sure if can be updated or if it comes from (or will ultimately be corrected by) a third-party data provider. MILB.com also has no "h" in the first name. Posting to add to the big list of little things to check...

[LansdowneSt]

Phil Clark came into my Random Debut game with the wrong Historical Minors ID. It's tangled with Mark Clark.

[Crash Hairston]

I've been importing historical players for my fantasy league. I noticed Horacio Pina's arm slot has been changed from Sidearm (inaccurate) to 3/4 (inaccurate). Also, Gene Garber and Shingo Takatsu's arm slots (both are listed as 3/4) have never been accurate. One more thing - I am no longer able to import an accurate 1978 Larvell Blanks (ok hitting, terrible fielding). I try every combination but he's always a reasonable fielder. In earlier versions I was able to to this easily. Thanks

[TBird]

I started a 1935 season replay and by chance noticed one glaring error: Joe DiMaggio was on the 25 man active roster for the Brooklyn Dodgers. Scratching my head, I did some digging and determined the reason to be the SF Seals incorrectly assigned as a Dodger affiliate. But that wasn't the only one, just the most notable. I went through the list of all 20 minor leagues and found a fair number of improper and/or missing affiliates. Sorry I didn't make a list as I was going along since I was more focused on making the changes. I don't think too many players were affected, and most are inconsequential anyway. I found five that were on the 40 man rosters that had to reassigned after I realigned the teams. I know the mists of time have clouded affiliate history (even Baseball Reference has errors), but I wonder how many seasons may be similarly affected.

[thehef]

Originally Posted by TBird

I started a 1935 season replay and by chance noticed one glaring error: Joe DiMaggio was on the 25 man active roster for the Brooklyn Dodgers. Scratching my head, I did some digging and determined the reason to be the SF Seals incorrectly assigned as a Dodger affiliate. But that wasn't the only one, just the most notable. I went through the list of all 20 minor leagues and found a fair number of improper and/or missing affiliates. Sorry I didn't make a list as I was going along since I was more focused on making the changes. I don't think too many players were affected, and most are inconsequential anyway. I found five that were on the 40 man rosters that had to reassigned after I realigned the teams. I know the mists of time have clouded affiliate history (even Baseball Reference has errors), but I wonder how many seasons may be similarly affected.

This appears to simply be an error in the milbteams.csv file, where the affiliation that's right next to it alphabetically (Sacramento, affiliated with Brooklyn), probably got copied into the wrong cell (Sacramento is correct).

If there are others errors like this, please let me know so we can start compiling a list... And if there are more than a few (TBird seems to indicate there may be many), then I should probably coordinate a project with Lukas and BigRod to address it.

FWIW, if you start a game - with historical minors - from 1932-1935, Joltin' Joe will import to the SF Seals. And if you also have real historical transactions enabled, the he will be moved to the Yankees on 11/21/34. But here's where it can get a little weird:

Joe D was traded by the Seals to Yankees on 11/21/34. However, as was typical at the time - especially in the PCL - major league teams often swung trades for PCL players but had those players remain for another year in the PCL (typically for more seasoning). And that's what happened with Joe D: he played another season (1935) with the Seals before joining the Yankees. So if you play with real minors and historical transactions on...

- If you start any year prior to the 1935 season, Joe will import in 1932 to the Seals. And then - regardless of where he finishes the 1934 season (probably with the Seals unless the gamer moves him to another team) - on 11/21/34 he will become the property of the Yankees. And given that his ratings will be commensurate with the way he punished PCL pitching, OOTP AI will almost assuredly see fit to promote him to the 1935 Yankees.

- If you start with the 1935 season, Joe D will import to the Seals, and will remain with them unless the gamer (or other OOTP settings) sends him elsewhere. In absence of intervention, Joe would likely remain with the Seals (absolutely destroying PCL pitching) until 1941, when the Seals become and affiliate of the Detroit; at which point OOTP AI would surely promote him to the Tigers. NOTE: This is what would happen once the affiliation error is fixed. As we know, with the affiliation error in place, he would a part of the Dodgers organization if you start with the 1935 season.

- If you start a game in 1936 or after, he will import to the Yankees...

[TBird]

Originally Posted by thehef

This appears to simply be an error in the milbteams.csv file, where the affiliation that's right next to it alphabetically (Sacramento, affiliated with Brooklyn), probably got copied into the wrong cell (Sacramento is correct).

If there are others errors like this, please let me know so we can start compiling a list...

I opened the milbteams.csv file with the intent of comparing affiliate designations with other sources in order to make a list. It's going to be messy - the various sources do not always agree, but I'll give it a shot on another rain/snow day.

What I did notice after reading your post is that both the SF Seals and Sacramento Senators are abbreviated as "SaSe" in the spreadsheet, and both are listed as Dodger affiliates. That's definitely where the error occurred. Luckily 1935 was the only year the Senators were not independent, otherwise there could have been similar issues in other years.

[thehef]

Originally Posted by TBird

I opened the milbteams.csv file with the intent of comparing affiliate designations with other sources in order to make a list. It's going to be messy - the various sources do not always agree, but I'll give it a shot on another rain/snow day.

I don't know if there's one official or unofficial source for affiliates. Two best sources that I know of for minor league data in general are baseball-reference.com and statscrew.com... and they do not agree... To what degree they disagree, I dunno. So any project to double-check and/or update affiliates would first need to include determining what the official source is for the data.

Originally Posted by TBird

What I did notice after reading your post is that both the SF Seals and Sacramento Senators are abbreviated as "SaSe" in the spreadsheet, and both are listed as Dodger affiliates. That's definitely where the error occurred. Luckily 1935 was the only year the Senators were not independent, otherwise there could have been similar issues in other years.

Not sure if that prompted the error or not. I mean, those two teams having the same abbreviation in the milbteams.csv file occurs every year from 1921-35... (As far as the abbrev's themselves, I don't think much thought went into them. They were basically arrived at by taking the first two letters of the city and the first two letters of the nickname. In my experience, one can edit this field to show, for example, the type of abbreviation one might see on a sports page, and there are no issues; IOW, I'm fairly certain the field is used for nothing other than display.)

[thehef]

This isn't an OOTP data error. Rather, it's a source data issue:

The unknown "Evans" (https://www.baseball-reference.com/r...d=evans-015---) who went 20-10 with the 1916 Spokane Indians of the Northwestern League is actually Evan "Rube" Evans (https://www.baseball-reference.com/r...d=evans-001eva, who played the Texas League, Southern Assoc, and PCL from 1910-17 (and Western Canada Lg in 1920).

There are multiple references to "Rube" Evans - and that he was a lefty pitcher - in the (Spokane) Spokesman-Review during the 1916 season. So there is no doubt who this particular Evans is... Apparently he played mostly (33 games) with Spokane in 1916 but also appeared in 12 games with Salt Lake City of the PCL.