Starting an ambitious facegen organization/update project.

[silvam14]

I’ve been tinkering with historical facegens off and on for a while. I’m using fancyskunk’s set as a base.

I’ve been trying to fix the erroneous filenames in the set to match with the historical players so that as many as possible show up in the game.

What I’ve done is start a historical league in 2020 with complete history enabled. I can then list all players including retired players which should give me pretty much every MLB player.

I should mention I’m only concerned with MLB players, not negro leaguers, minor leaguers or any other foreign leagues. I’m trying to organize and target only mlb historical and current players.

To that end, I’ve cleared out the fg_files folder in my game and I’m painstakingly going down the list of players and adding them back one at a time. I’m prioritizing the historical minors if first and for the players who do not have one In the game, I’m using the lahman ID. Any players with the first_last format will be converted to one of the two above mentioned formats

As I’m going through, any zombie or poor quality facegens will be cleaned up as much as possible with the modeler program where I just take the complexion and move it to typical from “monster” setting.

I’ve also seen dozens and dozens of older players with no pictures I’m assuming using the same generic facegen. These will be removed as I feel it would be better to just assign random fictional pictures to these players rather than have a league with everyone looking the same.

What I’d like to ideally create is a folder with only historical mlb facegens and no duplicates. Currently my facgen folder has 49000 files and. Makes moving or backing up unbelievably slow. If I can create an mlb only and then add in the negro leagues after and then keep a separate folder of everything else (I don’t think I have the patience to go through the minors and foreign leagues nor would I want to)

Should be an interesting project which I hope os worth it and improves the facegens.

I will also be making a suggestion for the game to handle multiple facegen folders to better organize these different groups of files.

Wish me luck!


Sent from my iPhone using Tapatalk

[LansdowneSt]

Thanks for trying to do this. I think we've been on threads together before talking about the challenges caused by the dead weight of the old naming conventions - my fg folder is as big as yours. You mention talking to the developers on how to better handle these and I agree that's vital.

I've started Excel exports of the players, tagged how many are missing, how many are poor, how many are fine, how many are great and how many are mine (I keep those - about 3,500 to 4,000 - in a separate folder to copy over reloads of projects like this).

I assume the pack will have only the Minor League IDs and when none, the Major League IDs to reduce file count?

Lastly, how can others help? I trust you will be the QA/QC to determine if offers of help are taken up and their submitted work make the pack. As one that tries to help, trust me, none of us will be offended if we try and it doesn't make it - I just think a lot of us are of similar mind and would be willing to have their few a day contribute to this ambitious goal.

[silvam14]

Originally Posted by LansdowneSt

Thanks for trying to do this. I think we've been on threads together before talking about the challenges caused by the dead weight of the old naming conventions - my fg folder is as big as yours. You mention talking to the developers on how to better handle these and I agree that's vital.

I've started Excel exports of the players, tagged how many are missing, how many are poor, how many are fine, how many are great and how many are mine (I keep those - about 3,500 to 4,000 - in a separate folder to copy over reloads of projects like this).

I assume the pack will have only the Minor League IDs and when none, the Major League IDs to reduce file count?

Lastly, how can others help? I trust you will be the QA/QC to determine if offers of help are taken up and their submitted work make the pack. As one that tries to help, trust me, none of us will be offended if we try and it doesn't make it - I just think a lot of us are of similar mind and would be willing to have their few a day contribute to this ambitious goal.

Thanks for the offer man! I'm not sure how having multiple people working on this at this point would work. I look at my first run through these as more of a weeding out process. What I will need help on is trying to figure out which ones in the folder with the First_Last naming convention can be deleted as dupes or need to be converted to the other formats I pulled 7,000 named format files from the pack and there are roughy 6,700 left to be sifted through. Not ideal work by any means, but that is something that cane be done in paralell to what I'm doing I guess

[LansdowneSt]

That is one arduous first step. Any sense on the ratio of F_L renames and F_L deletes? It's tempting to just delete all the F_L name ones. At least, when you open the F_L file, if it is of poor quality, you can skip the cross-check and just delete it because either the Minor League coded one is the same and will get flagged on its own merits for redoing or it is different and will be reviewed independently.

I see your point though - it is hard to job that out as the work is concentrated on the clean-up of a single to-be master baseline file. If you can think of a way that assistance wouldn't be more work (version control, etc.) let me know here or DM me. It's a massive undertaking - and you haven't even gotten to the making of missing and fixing of the poorer files yet!

[silvam14]

Originally Posted by LansdowneSt

That is one arduous first step. Any sense on the ratio of F_L renames and F_L deletes? It's tempting to just delete all the F_L name ones. At least, when you open the F_L file, if it is of poor quality, you can skip the cross-check and just delete it because either the Minor League coded one is the same and will get flagged on its own merits for redoing or it is different and will be reviewed independently.

I see your point though - it is hard to job that out as the work is concentrated on the clean-up of a single to-be master baseline file. If you can think of a way that assistance wouldn't be more work (version control, etc.) let me know here or DM me. It's a massive undertaking - and you haven't even gotten to the making of missing and fixing of the poorer files yet!

Its hard to say. I put all of the F_L files aside and made sure that if the game was using those, I coped them back in and renamed them to the correct format. I started going down the list of F_L names that I know can be deleted since I already know all MLB players in the game have a fg file or not. Such a long process. basically anyone I recognize as an MLB player, I delete.

I put that aside for now though

This is essentially my process.

1. moved all Files to different directory (called "backup")
2. started a new historical game in 2020 with full history
3. Go to MLB -> Transactions -> PLAYERS -> MLB PLAYERS LIST -> Check "Include retired players" Uncheck internatioal complex"
4 sort by name
5 start from the top and work my way down
6 one player at a time, drag the facgen file from the backup folder into the game folder and reload the pic.
7 If player pick is fine, move to next one
8 if player pic is zombie-looking, open it in FG modeler and move the color slide in the demographics tab from right to left to "Typical" or close to there, and save
9 If player pic is the generic pic used for most players without one, delete the fg file

Thats pretty much it. I am attaching the player pic which is duplicated probably hundreds of times in lieu of the players with no pics.

I can certainly upload the structure with the files I have if you feel you want to take a stab from say the bottom up, if you feel you want to help. That will keep us from duplicating work

let me know

[LansdowneSt]

Yup, I know that player... https://forums.ootpdevelopments.com/...&postcount=506 I was going through all the pics on a 1903 game I started and found a dozen of those and noted all the names that had him. Let me replicate your step 3 & 4 and export to Excel and get a sense of the task. Once you get done with the weeding out, I assume the process shifts to the missing and poor (even if colorized) ones and doing them to satisfaction.

[silvam14]

Just completed the "A"s

I have 598 fgs in the directory

There are 966 files left in Backup that could be dupes, minors, or others

[Sweed]

Originally Posted by silvam14

I’ve been tinkering with historical facegens off and on for a while. I’m using fancyskunk’s set as a base.

I’ve been trying to fix the erroneous filenames in the set to match with the historical players so that as many as possible show up in the game.

What I’ve done is start a historical league in 2020 with complete history enabled. I can then list all players including retired players which should give me pretty much every MLB player.

I should mention I’m only concerned with MLB players, not negro leaguers, minor leaguers or any other foreign leagues. I’m trying to organize and target only mlb historical and current players.

To that end, I’ve cleared out the fg_files folder in my game and I’m painstakingly going down the list of players and adding them back one at a time. I’m prioritizing the historical minors if first and for the players who do not have one In the game, I’m using the lahman ID. Any players with the first_last format will be converted to one of the two above mentioned formats

As I’m going through, any zombie or poor quality facegens will be cleaned up as much as possible with the modeler program where I just take the complexion and move it to typical from “monster” setting.

I’ve also seen dozens and dozens of older players with no pictures I’m assuming using the same generic facegen. These will be removed as I feel it would be better to just assign random fictional pictures to these players rather than have a league with everyone looking the same.

What I’d like to ideally create is a folder with only historical mlb facegens and no duplicates. Currently my facgen folder has 49000 files and. Makes moving or backing up unbelievably slow. If I can create an mlb only and then add in the negro leagues after and then keep a separate folder of everything else (I don’t think I have the patience to go through the minors and foreign leagues nor would I want to)

Should be an interesting project which I hope os worth it and improves the facegens.

I will also be making a suggestion for the game to handle multiple facegen folders to better organize these different groups of files.

Wish me luck!


Sent from my iPhone using Tapatalk

Good luck

Seriously this is a huge job and you are a trooper for taking it on.

I would love to see OOTP go to multiple folders for face gens too. As I look through the complete face gen topic here they are adding minor leaguers that never made it to cover historical games for the "what if" players. This is all fine but for many of us it will end up adding tons of files we'll never use. Then top that off with foreign leagues being added it is even more face gens.
These guys are doing a great job of making some quality gens but it's something I don't need. I think having multiple folder support would also make their job easier to keep track of too. Win-win.

Having folders for each type of league could really trim the fat. If I just want MLB and Negro League face gens, cool. It won't affect my game one bit if I don't have "Joe Baseball" that "toped out" playing in AAA in 1969 or foreign league players that never made it to The Show.

I wish you well with the face gen project and with getting multiple folders into the game. I'll certainly jump into any thread in the suggestion forum to support this once they get the thread moved to the v22 forum.

[silvam14]

Originally Posted by Sweed

Good luck

Seriously this is a huge job and you are a trooper for taking it on.

I would love to see OOTP go to multiple folders for face gens too. As I look through the complete face gen topic here they are adding minor leaguers that never made it to cover historical games for the "what if" players. This is all fine but for many of us it will end up adding tons of files we'll never use. Then top that off with foreign leagues being added it is even more face gens.
These guys are doing a great job of making some quality gens but it's something I don't need. I think having multiple folder support would also make their job easier to keep track of too. Win-win.

Having folders for each type of league could really trim the fat. If I just want MLB and Negro League face gens, cool. It won't affect my game one bit if I don't have "Joe Baseball" that "toped out" playing in AAA in 1969 or foreign league players that never made it to The Show.

I wish you well with the face gen project and with getting multiple folders into the game. I'll certainly jump into any thread in the suggestion forum to support this once they get the thread moved to the v22 forum.

Thank you. This will take a bit to get under control, but I think it’s worth it.


Sent from my iPhone using Tapatalk

[SlimKibbles]

silvam14, I'd be interested in helping out. In the same boat as you about it all. I've tinkered with facegens quite a bit over the years too. I've started this year cleaning up 2021 and building as I go focusing on owners, coaches, and staff. I have coach versions of facegens who were also players. For example, guys like Clint Hurdle, Doug Drabek, and Delino DeShields have a young player fg and a grizzled coach fg. It's a lot of work though while working 40-50 hours a week in an 8-5 job. Typically mess with the fg's in my downtime.

Anyway let me know what I can do to help. I can share everything I have so far.

[luckymann]

Another legendary undertaking MS. No skills here re the graphics but am very detail-oriented, so if you need data checking / file management help etc hit me up I'd love to be involved and do my little bit.

G

[silvam14]

Originally Posted by luckymann

Another legendary undertaking MS. No skills here re the graphics but am very detail-oriented, so if you need data checking / file management help etc hit me up I'd love to be involved and do my little bit.

G

Appreciate the offer. I'm grinding through these players when I can. So far I'm through the Ds. Its slow going, but progress is being made. Now, once I'm done going through everyone the first time, We're probably going to need to get rid of the dupes in the remaining players folder. Its hard to find them all with the way the naming conventions were done in this set. When the historical minors IDs were generated with the set I'm using, it looks like some program was used where it took the first 3 letters of the players name and put them at the end. Works for a lot of player, but it doesn't for tons of others. Players named Mike had mik added when their legal name is Michael so it should have been mic. same for Tony and Anthony, Dick and Richard, Al and Allen, Allan, and so forth.

Does anyone have a spreadsheet of every player's historical minors/lahman ID? I suppose one could just go through the remaining players and search the spreadsheet, if the name doesn't exist in the spreadsheet, delete the file. That would be a help.

[luckymann]

Originally Posted by silvam14

Appreciate the offer. I'm grinding through these players when I can. So far I'm through the Ds. Its slow going, but progress is being made. Now, once I'm done going through everyone the first time, We're probably going to need to get rid of the dupes in the remaining players folder. Its hard to find them all with the way the naming conventions were done in this set. When the historical minors IDs were generated with the set I'm using, it looks like some program was used where it took the first 3 letters of the players name and put them at the end. Works for a lot of player, but it doesn't for tons of others. Players named Mike had mik added when their legal name is Michael so it should have been mic. same for Tony and Anthony, Dick and Richard, Al and Allen, Allan, and so forth.

Does anyone have a spreadsheet of every player's historical minors/lahman ID? I suppose one could just go through the remaining players and search the spreadsheet, if the name doesn't exist in the spreadsheet, delete the file. That would be a help.

I think all of them are listed in the database csv aren't they?

[silvam14]

Originally Posted by SlimKibbles

silvam14, I'd be interested in helping out. In the same boat as you about it all. I've tinkered with facegens quite a bit over the years too. I've started this year cleaning up 2021 and building as I go focusing on owners, coaches, and staff. I have coach versions of facegens who were also players. For example, guys like Clint Hurdle, Doug Drabek, and Delino DeShields have a young player fg and a grizzled coach fg. It's a lot of work though while working 40-50 hours a week in an 8-5 job. Typically mess with the fg's in my downtime.

Anyway let me know what I can do to help. I can share everything I have so far.

Thanks for the offer. I haven't looked at 2021 facegens so when I finish, I would probably take any updates you made to add to the set. My goal is to minimize the amount of files in the set and to separate the files into groups so it can give users an option what they want to add to the game. so if they just care about MLB players throughout history, they can start with that, if they want to add minors or other leagues, that can be a different folder to download, maybe coaches, owners and staff could also be a different folder. I'd be interested to look at the work youve done on the coaches and staff once I'm happy with the MLB players

[silvam14]

Originally Posted by luckymann

I think all of them are listed in the database csv aren't they?

I can guess we can assume that, but I haven't looked into what is where, I just start a game and go through the players there. Are all the minor leaguers in the DB as well?

[LansdowneSt]

I tried converting the database to excel a few days ago but it was too big to fit as it has so much data tied to each player. The .csv file also would break into columns and fields that didn't align. I assume Lukas at OOTP or someone there could export it properly but one would probably have to ask him direct and have some columns dropped to make it manageable and useful for the task at hand.

[silvam14]

Just an update. I’m working through the M’a right now. A little more than half way there. Doing my best to improve the zombie looking photos.

Again, I am rebuilding my fg_files directory by starting empty and going major leaguer by major leaguer and dragging their file over to the fg_files folder and using fg modeler to fix where necessary. This should guarantee one file per player with a facegen. Now, as I mentioned, there is one particular facegen that gets used multiple times. I’m removing all of those.

I do get the feeling there are other files like that, but I’m not worrying about that right now.

So when done with this phase, there should be somewhere in the 19k files in the folder.


Sent from my iPhone using Tapatalk

[silvam14]

Update.

I went through all MLB Historical and current players (No minor leaguers) and tried the best I could to make sure the player pics were legit although I know I missed some, and also updated the zombie facgens so hopefully there should be very few to none left. It was an arduous process going player by player (over 19k players) and checking each one, and I hope it was worth it.

I'm uploading the zip here, check it out if you have time.

I'm still going through the negro league seasons trying to pull those players from the master set and I will eventually add them to the historical set.

My goal is to pick apart the master set until there is nothing left but grissel and fat. I'll upload the complete master set soon if anyone would like to try and segregate the various other leagues (like KBO, NPBL, and others I think have player facegens here)

https://www.mediafire.com/file/jevbx..._Hist.zip/file

[LansdowneSt]

Impressive work! Just getting rid of the old file name conventions would have been an arduous task.

I'm cleaning up my pack too. Knowing you were doing this, I started by trying to get a handle on the universe of faces needed. To that end, I went through and exported every batter and pitcher in bRef to a spreadsheet and am eliminating the duplicates (pitchers with PAs and Batters that pitched) so, for my part, I'll soon have a clean Excel sheet for each player. Then I can put columns in noting if 1) there's a correctly named file for the player, 2) the quality of the file in my eyes and 3) if I did it myself - because I keep those in a separate pack so I don't overwrite them by accident.

That 19K sounds like a great starting point - it's about half the size of my own due to the duplicate file issue. The next step for everyone is the QA/QC of the files, which is the work FancySkunk was carrying on. He's been off-line for a month so I hope he is okay.

Lastly, again, just a huge thanks for taking this on

[pstrickert]

Your work is much appreciated, silvam14. Thank you!