Historical database issues go here!

[coachbtown32]

I have been trying to get someone to look at the import/export function in the game because not all players are being exported into the 3 files, batting, fielding, pitching. I have posted in the bug section, sent an email to support without any response and posted in the regular community forum. Nobody has bothered to answer about if this is a bug and why all the players are not being exported.

I have learned how to edit the stats (only doing pitchers and pitching statistics currently) and import them back into game. However, while editing, I have noticed that whoever is in charge of programming the stats for each player, is NOT inputting all the stats for each player. I wanted to inform the person in charge that the HA, 1B, 2B, 3B are being left at zero and only the HR totals are being inputted in the pitching stats. Are these stats not important to the game play and is that why they are being left out? I am talking about EVERY SINGLE PITCHER, these stats are missing.

Thank you.

[Stragama]

When I start a new 1980 historical season, the Stamina Ratings all turn to 1. This occurs when I turn off the selection to automatically adjust league total modifiers after each season for accuracy under "Historical" within the League Settings. It also happened when I didn't change to de-select that option, but instead selected to change that the ratings were based on neutral stats based on remaining years of career on another league I tried to start. I posted a video of this occurring. Please fix this as I don't want to play according to historical limitations, I want to see how well players can do without these limitations and change history. Here's the YouTube video I made showing this is happening:

https://youtu.be/vvD2nr1MP_c

https://youtu.be/vvD2nr1MP_c

[LansdowneSt]

His name was Jess Brooks (Jess Edward Brooks, to be specific). Not "Jesse Brooks". 1937 KC Monarch.

https://www.seamheads.com/NegroLgs/p...rID=brook01jes

https://www.baseball-reference.com/p...rookje02.shtml

https://www.tacomasportsmuseum.com/o...essBrooks.html

https://wertacoma.com/black-baseball-history-in-r-city/

[Garlon]

Coachbtown32: the game does not use pitcher 1B/2B/3B allowed. For pitchers the game uses K, BB, HR and BF to create their stuff, control, and movement ratings.

[LansdowneSt]

John Martin (St. Louis Cardinals pitcher) has his stats mixed with another John Martin from the late 70's that never made the majors.

Importing martin016joh in 1977 yields a player with the Majors/bRef code of martijo05 with a mix of both players stats.

Importing martin012joh in 1977 yields a player with the Majors ID code of martijo05 (but a blank bRef code) with a mix of both players stats.

Trying to import using the major league code martijo05 (in 1980 as that's when John made the bigs) yields the martin012joh player... which is the wrong one per baseball-reference.

[LansdowneSt]

I imported George Batten (battege01, 1912) but for some reason the facegen saved as "batten001geo" - which is correct in baseball-reference and seemingly in OOTP wouldn't load the facegen. Upon further investigation, I found that the OOTP Historical Minors ID has an extra space after "batten001geo" so batten001geo.fg is seen as a non-match. The database needs to see how (and fix) the extra space is loading after "batten001geo" for his profile.

[LansdowneSt]

Seth Beer appeared in the draft class of my Random Debut historic game but lacked his facegen. When I pulled up the editor, the wrong Historical Minors ID was there - in its place was his bRef ID. See pic. Needs the correct ID put in (beer--000set)

[actionjackson]

Originally Posted by LansdowneSt

Seth Beer appeared in the draft class of my Random Debut historic game but lacked his facegen. When I pulled up the editor, the wrong Historical Minors ID was there - in its place was his bRef ID. See pic. Needs the correct ID put in (beer--000set)

Howdy sir. Long time, no post. I'm working my Master.csv file over, and I'm going to post it in a link, along with the DB that goes with it, with my Spritze DBs, as soon as I get the last of the Fed Leaguers' stats in there. It began as a project to resurrect Fed Leaguers (they only have OF defensive stats) from fencepost status. No batting, pitching, or IF + C defensive stats, so they're kind of useless, but they're still in the Master, so they will arrive in your game, with mostly no stats.

The stats of Fed Leaguers used to be in the game (I've seen them in OOTP16, so I'm not just talking out of my butt), but they were removed (aside from OF defensive stats), so I decided to bring them back for this DB (The Action DB? Sounds kinda catchy). Thank goodness the OF defensive stats were kept in, because they're a nightmare to get right for 1914, and 1915.

Then, I noticed the Minor League ID issue, which affects all players who debuted in 2021 (like your friend, Mr. Beer), as well as some other dudes. Then, I noticed that 2020, and 2021 debut pitchers had no pitches, which means that they will come into the game with two randomly assigned pitches, and remain relievers in perpetuity, because starters need three pitches. The pitching repertoires for 2020 and 2021 debut pitchers are done, and I have to go over the IDs (particularly the MiLB ones) to see if any are missing.

I think I've mentioned these issues before, but I haven't seen a fix for them yet, so I'll track 'em down for ya (and others that don't mind having Fed Leaguers in their games). I think it makes sense to take Fed Leaguers out for those that play straight historical, because they won't have a league to play in (at least I don't think so - It'd be cool if they could come into the AL and NL, so that the FL could stay out of things), but for RDers like us, or at least me, I sure wouldn't mind seeing them in there, which is why I started this madness, quite a while back, now. RD is basically a sub-niche of a sub-niche, so it's down the list, so we're not exactly on the front burner of issues. If you could compile a list, or a spreadsheet or Word document for me, that'd really help, to track down the more recalcitrant buggers. That goes for others that are interested, as well.

I remember the Will/Willie Harris entaglement, from before. There was also a Jerome/Jeff Williams cross-pollination in the past, that may still be there. There are others that I'm not remembering right now. Just checked, and the Williams cross-pollination still existed. Not no mo' in my DB.

The main things I'll focus on for my DB's Master file are:

1) Its original purpose: Giving Fed Leaguers some numbers, so they can compete in my leagues.

2) Pitching repertoires. This is a bit of a mess. Any pitcher that came into MLB after OOTPX (2008 season) was done pretty willy-nilly. The ones that really need help with it, of course, are the more recent ones, that haven't been given any pitches at all. Garlon says this is supposed to be done in order of frequency of each pitch, but in some cases, it appears to be an assessment of the quality of the pitch. I'll use the Spritze DB for older ones, and fangraphs for newer ones.

2) Disentangling ID numbers in the Master file, so we can cut down on/eliminate the number of guys with crossover stats.

3) Getting all the correct Minor League IDs possible, and putting them in their proper column, so we can get the best out of all the work the Historical FaceGen crew (including yourself, of course) has put in.

4) Proper birthdates, because they affect when a player debuts, which is particularly important in a random debut league.

5) I'm on the fence about height and weight, because I know it affects the appearance of your FaceGens.

6) Debut date is very important, for the same reason birthdates are. You want players entering the game when they should, so you can get the most out of them.

7) Uniformity of names. Jr.? Sr.? No more second name initials. Whatever a player's name is on BB-Ref, it'll be that with mine. For example, there is a Jose Miguel Fernandez on BB-Ref, so he'll get that in game. It takes away a lot of the Sr.'s and Jr.'s. I believe there are 27 Jr.'s, and 3 Sr.'s in BB-Ref, and they seem to base it on, how the player was referred to during his playing days. So, Lourdes Gurriel Jr., and Jackie Bradley Jr., get the designation, but Rankin Johnson Jr., and Eddie Collins Jr., do not. Gonna use BB-Ref for this, and pretty much everything. There's danger in using just one source, but there's also consistency, and since the DB builders moved towards BB-Ref, and away from Lahman, it makes sense to use BB-Ref.

Things that I absolutely, positively, could not give one iota of a crap about:

Birthplaces, Death Dates, Deathplaces, Notes about a player's name, a player's given name, i.e. "David Allan" for David Aardsma, nicknames (don't use them, never have, never will), final game (this feature hasn't been used in eons, even though it's used for the "have players retire when they retired IRL" feature - it hasn't been kept up, and I don't give enough of a rat's behind to get it right when I don't use it), college, all of the positional experience, range, error, arm, dp, etc, etc, etc., ethnicity, and arm slot.

Also, ticky-tac stuff with stats. The accuracy of the stats in OOTP is pretty damn good, and I have no intention of chasing down every passed ball, stolen base, sacrifice bunt, etc. Do the stats reflect the abilities of the players that compiled them? I would say that's a resounding yes. Are they 100% correct? No, and they never will be. I believe the experience, range, error, arm, etc ratings, are covered these days in the fielding stats files, and in more recent years, those ratings don't appear to have been done at all. I think the OOTP bigwigs want a player's RL stats to be the determining factor of his ratings, which makes sense.

Only players who played in MLB will be in here. I use the Spritze DB to bring in Negro Leaguers, foreign league players, and some old-time PCLers, and career minor leaguers, but this DB will not focus on those. The link to the Spritze stuff is in my signature, if you want to use it.

If you guys see/notice/have issues in the areas I'm interested in, compile lists for me, upload them in the thread that I'm going to be starting in a bit, either in the Historical Simulations section, or the Mods section. Which section do people think would be best? I'm thinking Mods under the subheading of DBs. Don't just leave them in here one at a time. Round them up for me, so I can get to exterminating the nonsense quicker. It'll be done on my time, and hopefully I'll have frequent updates, after squishings have taken place. No promises, though. I deal with mental health issues, so I have been known to disappear for long periods of time. Just ask Lansdowne! I don't show up in the regular season much, either, but maybe I'll be more inclined to, in short bursts, if I can get this off the ground. Think of this more as a group effort, with you helping me gather up inconsistencies, and me getting them taken care of.

I use Dr.Doom's Database Converter to get this stuff done. It is an unbelievable tool, that I highly recommend if you're a nerd like me, and you like crawling around in spreadsheets, as others like crawling around under the hoods of cars. It enables me to continue to play my game in OOTP21, while buying each new version, and putting the new stats, and biographical info, into the appropriate OOTP21 files, as each version comes out. It's kind of self sustaining really. Markus won't be doing this forever, but as long as he is, I'll be supporting him. If/when he moves on, I'll be able to continue to update my stats and bio info, even if there are no new versions.

This is meant to be an adjunct project to the Historical DB, not a replacement for it. It's not meant to poop all over the hard work of Garlon, and the others that have taken on this monumental task, before him. I'll put it up, once I've got all the Fed Leaguers' stats in, to my satisfaction. The Master file will be a slow burn, as I'm itching to get going on my 35 year random debut game again. I'll knock off whatever I can, as I play the game, and (hopefully) you guys inform me of what needs looking at.

Looks like I've put together my OOTP version of "War and Peace" for a post. Congratulations if you made it this far, and thanks for reading.

Lansdowne, I'm gonna post Seth Beer's page with his FaceGen, Alek Manoah's pitch repertoire (you'll only see two if you import him into your game, but he has four IRL, and therefore in mine), and the proper disentanglement of Will and Willie Harris, and Jerome, and Jeff Williams, in posts to come. It'll give you an idea of how the DB is coming along. I guess I could also post Hal Chase, and Mordecai Brown, complete with their Fed League numbers, to illustrate how that's coming along, too. This post is long enough, though, so let's just leave it here.

[actionjackson]

@Garlon:

Two questions/observations, about discrepencies I've noticed when viewing the fielding.csv vs in game numbers:

1) Players who played less than one inning at a position (i.e. 0.1 innings or 1 InnOuts, or 0.2 innings, or 2 InnOuts), in a given year, will be given credit for 8.1 innings (if 0.1 innings), and 8.2 innings (if 0.2 innings) respectively. The figures are right in the fielding.csv files, but somehow, the game cannot accept fielding stints of less than 1.0 IP. Don't understand why it's doing it, but it happens for anyone who played for one or two outs at a position, in a given season.

2) I may have mentioned this before upthread, but a catcher's CS number is not shown in game. It's just zero. His SB/CS numbers are right there in the fielding.csv file, but nowhere to be found in game. The question is, is the game getting this info, but not displaying it, or is it not getting it at all?

Thanks in advance.

[actionjackson]

1st of two pic posts for you Lansdowne:

1) Seth Beer's Editor page, and, of course, his FaceGen

2) Alek Manoah's Profile page, with his 4-pitch mix, and, of course, his FaceGen

3) Hal Chase's Real Batting Stats page, with his stats with the 1914 Chicago White Sox of the American League, and the 1914 Buffalo Buffeds, and the 1915 Buffalo Blues, of the Federal League, included, and, of course, his FaceGen

4) Mordecai Brown's Real Pitching Stats page, with his 1914 pitching stats, first for the St. Louis Terriers, and then for the Brookly Tip-Tops, and his 1915 pitching stats for the Chicago Whales included, and of course, his FaceGen

[actionjackson]

2nd of (maybe three, actually - gotta show Editor pages, with ID changes) two pic posts for you Mr. Lansdowne:

1) Willie Harris' Real Life Batting Stats page, following his Conjoined Twin Separation Surgery from Will Harris. He has no pitching stats, and his career runs from 2001 through 2012. Check out dat FaceGen, too!

2) Willie Harris' Editor page with his three different IDs, as they should be.

3) Will Harris' Real Life Pitching Stats page, after the surgery, and he has the one plate appearance that he had as a hitter IRL, and his career runs from 2012 through 2021. And, of course, the FaceGen.

4) Will Harris' Editor page with his three different IDs, as they should be.

[actionjackson]

Originally Posted by LansdowneSt

John Martin (St. Louis Cardinals pitcher) has his stats mixed with another John Martin from the late 70's that never made the majors.

Importing martin016joh in 1977 yields a player with the Majors/bRef code of martijo05 with a mix of both players stats.

Importing martin012joh in 1977 yields a player with the Majors ID code of martijo05 (but a blank bRef code) with a mix of both players stats.

Trying to import using the major league code martijo05 (in 1980 as that's when John made the bigs) yields the martin012joh player... which is the wrong one per baseball-reference.

Oof. This one's gonna be tough. Gonna have to go into the MiLB Master.csv file to poke around. Have I mentioned how much I hate the MiLB Master.csv file? I wonder how many more of these there are. They're way harder to detect, as the MiLB Master file is hugemungous, and you just never know who's gonna leap out at you. I'll see what I can do about that one. Definitely not something I can proactively eliminate, and I think there are like 200,000 lines of data in that minor league Master file. Takes forever to load. Got him. Will upload pic in the post after the conjoined Williams brothers (Jerome and Jeff) saga pics.

[actionjackson]

Originally Posted by LansdowneSt

Need a check on a Historical Minors ID for a facegen. Mike Hampton of the Braves, Astros, Rockies is shown on the OOTP screen in the game. The minors ID in the game though is tied to a 1994-97 minor league Mike Hampton in bRef who never made it past A ball. See bRef overlayed against OOTP23. It's hampto001mic vs. hampto002mic

What's happening here, both with the Mike Hamptons, and the John Martins, is that hamptmi01 shows up for both of them in the MiLB Master. There are probably a lot more of these, too. Crap. I was worried about this. Anyway, Hampton, and Martin squished in my upcoming DB. Pics of sorted out stats after the Williams brothers disentanglement post.

[LansdowneSt]

Welcome back, actionjackson! Just last week I peeked to see when you had last been on! That is quite a project but following in the noble tradition of supplemental database work that's come before!

After the World Series, I'm going to upload the latest of my facegen work (I keep mine at mediafire as per my signature block). It's about 11% of players that have played, so I'm slowly getting to all the players and providing updates. There are tons in there that I just don't have the time to post blurbs and screenshots of in the fg threads. I'll even add a few obscure Blue Jays to the mix for this upcoming upload - just for you!!

I'll DM you this weekend to catch-up. I'm still marveling at you taking this on. You should see if Lukas is hiring!

[actionjackson]

I don't know if you've noticed the Jerome/Jeff Williams conundrum before, but the surgery was successful:

1) Jerome Williams' (willije01) RL Pitching Stats page

2) Jerome Williams' Editor page

3) Jeff Williams' (willije02) RL Pitching Stats page

4) Jeff Williams' Editor page

[actionjackson]

Originally Posted by LansdowneSt

Welcome back, actionjackson! Just last week I peeked to see when you had last been on! That is quite a project but following in the noble tradition of supplemental database work that's come before!

After the World Series, I'm going to upload the latest of my facegen work (I keep mine at mediafire as per my signature block). It's about 11% of players that have played, so I'm slowly getting to all the players and providing updates. There are tons in there that I just don't have the time to post blurbs and screenshots of in the fg threads. I'll even add a few obscure Blue Jays to the mix for this upcoming upload - just for you!!

I'll DM you this weekend to catch-up. I'm still marveling at you taking this on. You should see if Lukas is hiring!

Originally, it was just for me, because I felt the Fed League guys deserved a shot, and then I found DrDoom's app, and found I could do this stuff for myself pretty quickly. The Jerome/Jeff Williams, and Willie/Will Harris issues go back 5 or 6 versions or so. Like I said, the Master will be messy to start, which will make it not seem much better, but once you (and hopefully others) have compiled lists for me with IDs, and stuff, it's relatively simple to improve it. I'm only focusing on the areas I outlined, though, because they're the really important ones. Probably way too much for me to handle, but with the help of others, and their lists...

Just hoping I can remember how to upload it to my Google Drive. I figured it out for the Spritze DBs though, so it shouldn't be long after the fielding stats for the Fed Leaguers are done. Four teams (Kansas City, Newark, Pittsburgh, and St. Louis) from 1915 to go, and only the infield, and catching defensive stats. Everything else is in. Should be about a week or so, so get your list ready.

Here are Mike Hampton, and John Martin's RL Pitching Stats pages, and Editor pages, after corrections. Like I said, these ones from the MiLB Database are really tough. Not tough to find, once somebody alerts you to them, and provides the Minor League IDs of both the legit guy, and the impostor, but tough to stamp out proactively. The stats for both guys look damn good, if I do say so myself. That's a result of whoever put the original database together, but the disentanglement part, is really important, too. You would know about what they looked like when they were tangled up, so tell me how they differ.

[actionjackson]

John Callahan (player ID: callaji01), and Jim Callahan (player ID: callaji02), have the same Lahman40 IDs (callaji01), and therefore their stats will be jumbled together.

[actionjackson]

Originally Posted by actionjackson

John Callahan (player ID: callaji01), and Jim Callahan (player ID: callaji02), have the same Lahman40 IDs (callaji01), and therefore their stats will be jumbled together.

Still require untangling in the Batting, Fielding, FieldingOF, and Pitching.csv files, due to wrong ID numbers being assigned, due to Master file Lahman40 IDs being identical.

[LansdowneSt]

Here's another for when we start the data clean-up on the database, Aaron Thompson. There is an American MLB'er and an Australian career MiLBForeign player but the Australian has the American's tenure with the Pirates tied to him in error.

[actionjackson]

Originally Posted by LansdowneSt

Here's another for when we start the data clean-up on the database, Aaron Thompson. There is an American MLB'er and an Australian career MiLBForeign player but the Australian has the American's tenure with the Pirates tied to him in error.

The MLB IDs (Lahman + BBRefMLB) have already been scrubbed from the MiLB Master of the DB in my sig, for MiLBers who never played in the show. Fair warning: That DB has all the Fed Leaguers back in it.

This problem is what usually happens when you get these minor league guys wanting to latch on to a big leaguer, for a free ride to the show. They get themselves a fake MLB ID, in an effort to get past the gatekeepers. Not on my watch. I'll have a look, and see if I've managed to crush them all. I know for a fact that I've already done the same thing for Hampton, and Martin above. Checking for duplicates in those two columns now.