OOTP Database Converter

[actionjackson]

I'm using this for both default and Spritze, and it worked well on the one guy I tested it on. Poor Dan Marion only played in the Federal League, and was given absolutely no career stats. Guys like him have been left to rot in the past. No longer. Fantastic!

[actionjackson]

Got to use this today to work over defensive issues with Spritze players. Came out pretty damn sweet. I've just noticed that they're importing kind of bonkers on the defense, so I'm working the two or so that I bring into every draft, and it's coming out pretty well. Starting to get faster at it, but it is quite laborious.

[jparker2112]

This is great....but im a moron when it comes to things like this. Say i want to have a custom lg start in 1900 with a bunch of HS and NCAA teams and 16 MLB teams. Can i adjust the birthdates of the master.csv file to have every draft class go to HS as 13 y/o olds? If yes...can i then watch them progress to ncaa/mlb and have careers, while a new draft class comes from the master.csv into HS year after year? That make any sense?

[actionjackson]

Originally Posted by jparker2112

This is great....but im a moron when it comes to things like this. Say i want to have a custom lg start in 1900 with a bunch of HS and NCAA teams and 16 MLB teams. Can i adjust the birthdates of the master.csv file to have every draft class go to HS as 13 y/o olds? If yes...can i then watch them progress to ncaa/mlb and have careers, while a new draft class comes from the master.csv into HS year after year? That make any sense?

Well above my pay grade sir. I have no clue of how to make that happen. I do play Random Debut, but I'm extremely vanilla otherwise.

[Seven_]

So I attempted to convert the old Sprtize Database, so I could use it with OOTP 22, and I got an error message saying that I was "missing files historical_minor_database.odb, historical_lineups.odp and historical_transactions.odp. Any tips on what to do/what I am doing wrong?

[actionjackson]

Originally Posted by Seven_

So I attempted to convert the old Sprtize Database, so I could use it with OOTP 22, and I got an error message saying that I was "missing files historical_minor_database.odb, historical_lineups.odp and historical_transactions.odp. Any tips on what to do/what I am doing wrong?

Spritze didn't include those files in the SpritzeHSforOOTP19 database. You should be using a three folder system when you use the ODBC program. Label one spritze_stats, another spritze_stats_csv, and the third spritze_stats_modified. Set your spritze_stats folder up with the four original, unedited .odb files. As you've correctly noted, HSfor19 only comes with the historical_database.odb file, but don't worry, help is on the way.

Copy/paste the three .odb files that you're talking about from the SpritzeHSforOOTP18 folder into your spritze_stats folder, because the stats for Spritze stopped after 2015 (the stats that were used for OOTP17), so you won't be missing anything that can be found elsewhere. You can get the SpritzeHSforOOTP18 for the low, low price of nothing, through the links in my signature. There's one for 18, and one for 19 there. Once you've done that, you can follow DrDoom's directions, and convert those files from your sprize_stats folder into .csv files in your spritze_stats_csv folder, and edit to your heart's content. Then convert back to the .odb files in your spritze_stats_modified folder.

Before you can make the conversion from the .csv files back to the .odb files, you'll need to delete 9 .csv files from your spritze_stats_modified folder (EOS Rosters, Master, MiLB Leagues, MiLB Master, MiLB Teams, OD Rosters, SeriesPost, Teams, and UniNumbers). You don't need to delete the MasterList.csv file that Spritze put into HSfor19, because DrD's tool doesn't recognize it, so it acts as if it isn't there. Once the conversion is done, you'll see that the .csv files that you just deleted, have been replaced in the spritze_stats_modified folder. You'll need to do this deletion every time you convert from the .csv files over to the .odb files. PITA, but being able to edit stuff makes it worth it.

With regards to never overwriting the stuff in the original stats folder that comes with the game, I have a lazy, and foolproof suggestion. Extract the full SpritzeHSforOOTP18 and SpritzeHSforOOTP19 folders from their .zip file into your stats folder. Thus, those folders will be separated from the default folder, but still within it, and you won't overwrite anything. Same thing with the two stats_modified folders (I mess around with both the default one and the Spritze one, depending on what I need, so I have two of them). Copy/Paste your stats_modified folder into your OOTP stats folder. That way, nothing gets overwritten, which is very important. Same thing for copying your spritze_stats_modified folder into the SpritzeHSforOOTP19 folder that you've just created within the original in game stats folder.

Once you do this, you must remember to change your Database Path in game to the folder that contains the files that you've just edited. Very important. Now, you won't accidentally overwrite any original files, any patch you download won't overwrite your edited files, and you'll be able to use your edited files in the game. Win/Win/Win.

It works really well with most of the guys in Spritze. There are problems when the import historical player tool doesn't recognize the player ID code though. There are some bizarre player IDs in there, and no matter what you do, a player's stats won't transfer into the game. I've had both the MLB type (first five letters of last name, followed by first two letters of first name, followed by two numerals), and the MiLB type (first six letters of last name, using hyphens to fill in the gaps if a player's surname is less than six letters, followed by three numerals, followed by first three letters of first name) player IDs work for me, but there are some real alphabet soup player IDs in there that won't transfer the players stats into the game.

The player will show up, but he'll be statistically naked, and will absolutely suck, with no position to play, and a complete noodle bat. Delete the impostor, and move on, if you get one of those suckers. There are 33,014 players in the database, so I doubt you'll run out. I probably haven't explained all of this too well, so if you have any questions, fire away.

[Seven_]

Originally Posted by actionjackson

Before you can make the conversion from the .csv files back to the .odb files, you'll need to delete 9 .csv files from your spritze_stats_modified folder (EOS Rosters, Master, MiLB Leagues, MiLB Master, MiLB Teams, OD Rosters, SeriesPost, Teams, and UniNumbers). You don't need to delete the MasterList.csv file that Spritze put into HSfor19, because DrD's tool doesn't recognize it, so it acts as if it isn't there. Once the conversion is done, you'll see that the .csv files that you just deleted, have been replaced in the spritze_stats_modified folder. You'll need to do this deletion every time you convert from the .csv files over to the .odb files. PITA, but being able to edit stuff makes it worth it.

With regards to never overwriting the stuff in the original stats folder that comes with the game, I have a lazy, and foolproof suggestion. Extract the full SpritzeHSforOOTP18 and SpritzeHSforOOTP19 folders from their .zip file into your stats folder. Thus, those folders will be separated from the default folder, but still within it, and you won't overwrite anything. Same thing with the two stats_modified folders (I mess around with both the default one and the Spritze one, depending on what I need, so I have two of them). Copy/Paste your stats_modified folder into your OOTP stats folder. That way, nothing gets overwritten, which is very important. Same thing for copying your spritze_stats_modified folder into the SpritzeHSforOOTP19 folder that you've just created within the original in game stats folder.

Once you do this, you must remember to change your Database Path in game to the folder that contains the files that you've just edited. Very important. Now, you won't accidentally overwrite any original files, any patch you download won't overwrite your edited files, and you'll be able to use your edited files in the game. Win/Win/Win.

Thanks so much for the help. I've followed the stats but I've encountered another problem. In the conversion of the files, I'm missing some of the 9 CSV's that you have listed. I addtionally also have 3 CSV's that are named _unknown20, _unknownMinor13 and _unkownMinor22.



Do you think it would be easier, and if you didn't mind of course, just sending me the files/folders that you already have set up for your copy off OOTP 22, via email? Or is there something that I'm doing wrong when it comes to the conversion. We can discuss this over PM if that works better for you. Thank you so much for the help again.


- Seven

[actionjackson]

Originally Posted by Seven_

Thanks so much for the help. I've followed the stats but I've encountered another problem. In the conversion of the files, I'm missing some of the 9 CSV's that you have listed. I addtionally also have 3 CSV's that are named _unknown20, _unknownMinor13 and _unkownMinor22.

Do you think it would be easier, and if you didn't mind of course, just sending me the files/folders that you already have set up for your copy off OOTP 22, via email? Or is there something that I'm doing wrong when it comes to the conversion. We can discuss this over PM if that works better for you. Thank you so much for the help again.

- Seven

Hmmm...Did you get this Spritze from my links, or was it somewhere else? I'm not seeing the additional three in mine, and I also have the nine. Which of the nine .csv files are you missing when you go to convert to .odb files?

My suggestion would be to grab both 18 and 19 from my links. Extract 18 and 19 to your OOTP21 or OOTP22 stats folder. Oooh...Just thought of something. Are you using the OOTP 21 Database Converter or the OOTP 22 Database Converter with your OOTP22 game? You must use the OOTP 22 Database Converter with OOTP22. DrD's been very insistent on that throughout this thread. Because I'm using OOTP21, I'm using the OOTP 21 Database Converter, but you will definitely need the OOTP 22 Database Converter. Apparently, they don't play nice, unless they're with their specific games. So:

1) See which Database Converter you are using, and make sure it aligns with the game version you are playing, and:

2) If that does not work, do a fresh download/extract of Spritze 18 and 19, using my links.

I'm also remembering now that initially when I extracted the .csv files from the original four Spritze .odb files, I wound up with only 23 .csv files, instead of the normal 33. I went and checked with the default db, and copied over the missing .csv files, and that brought the number to 33, and since then, it's worked a charm.

The reason I set up the Google Drive downloads is that the Spritze DB is too large to send by email, so that's out. You don't need me to send you anything. Fill in any missing .csv files with the appropriate .csv file from the default stats_csv folder that you're gonna convert your stats folder to.

So, what you should do is have two different sets of three folders in your C:\temp folder. The default set: An (hopefully) unadulterated copy of the stats folder that ships with the game in C:\temp, as DrD suggested you set up. Use the converter for OOTP 22 to convert those files to .csv files, which go in the second folder: stats_csv, and then to convert back to the .odb files, sending those to the third folder: stats_modified. There is also a stats.odb file in the default stats folder. Probably need that one too. And there's a draft_list.csv file in there as well. Those may or may not get converted from the stats_csv folder. I don't think they do, so if you want them, copy/paste them into your stats_modified folder.

Now, do the same thing for Spritze, using an unadulterated copy of Spritze 19. If you need a new one, you know where to find it. Your three folders would be: spritze_stats, spritze_stats_csv, and spritze_stats_modified. You would convert the fresh contents of the spritze_stats folder into .csv form, and that goes in the spritze_stats_csv folder. Copy over any .csv files that you see in the stats_csv folder, that you do not see in the spritze_stats_csv folder. The total number of folders should now be 33.

I just checked with a backup Spritze 19. It will convert 23 .csv files over to your spritze_stats_csv folder. You're going to need the other 10 from the default stats_csv folder, to make it work. Thankfully, by the process of elimination, I can name them all for you. They are: AllstarFull.csv, AwardsManagers.csv, AwardsPlayers.csv, BattingPost.csv, FieldingPost.csv, HallOfFame.csv, Managers.csv, PitchingPost.csv, RecordsSingleGame.csv, and TeamFranchises.csv. Even in alphabetical order!

Copy those ten files from the stats_csv folder, that houses the .odb to .csv converted data from the default stats folder over to .csv files, and paste each file into your spritze_stats_csv folder. You should now have 33 .csv files in your spritze_stats_csv folder.

Just figured something else out. You're going to need both Spritze 18 and 19. Spritze 19 only comes with the historical_database.odb file. You will need to copy the historical_lineups.odb, the historical_minor_database.odb, and the historical_transactions.odb files from 18 into 19. That may be the bork up that's creating those extra three "unknown" .csv files that you're seeing. Probably, you should do a fresh download/extract of 18 and 19 at this point. Extract the 18 and 19 folders into your OOTP Baseball 22 > stats folder, so you don't overwrite anything, and they are separate from the stats folder, but within the stats folder.

Also, when you've made your conversions back to .odb files in the stats_modified or spritze_stats_modified folders, you're going to want to copy/paste them. The stats_modified folder should be pasted to your OOTP Baseball 22 > stats folder, and the spritze_stats_modified folder should be pasted to your stats > SpritzeHSforOOTP19 folder. Always do this to make sure that:

1) You never overwrite the original files, and

2) Your edits don't become victims of the latest patch updates.

You will also have to reset your in-game database path (where your new amateur draftees come from), from OOTP Baseball 22 > stats to OOTP Baseball 22 > stats > stats_modified, or OOTP Baseball 22 > stats > SpritzeHSforOOTP19 > spritze_stats_modified, depending on whether or not you're using Spritze as your main database, or the default as your main database.

Well, that should confuse the heck out of you. As for PMs. We can do that too, but doing it this way also has the potential to help others who are trying to figure this stuff out, so I'll leave that up to you. If it does confuse you, ask questions, and I'll try to get to them when I can. Cheers.

[actionjackson]

Hey DrDoom. Just a suggestion here. You might want to put this in the Database Tools section of OOTP Mods. I think more people might see it there, and it's an incredibly useful tool to have for Historical players. In fact I haven't seen too many mods that are on this level. It's a real game changer. I think I stumbled across it while doing a google search for something else. The first few times back, I had to use a link that I'd put out there, in another thread, for others, in order to get back to it myself. Might even want to get it stickied in there. Again, just a suggestion from a huge fan of this tool, who has no clue how you did this, but thinks it's one of the best mods ever made, and that's saying a lot. Cheers!

[chucksabr]

I have no idea what this database converter app is or what it is intended to do, and I can't really find any explanations either in this thread or anywhere else. But I do know that when I try to install it, I get this:



Before I go through the rigamarole of trying to get Norton to accept this setup file, can anyone please tell me, or point me to a link, as to what this app is supposed to do?

[DrDoom]

Sorry I've been AWOL everyone, been really busy the past month or so.

[DrDoom]

Originally Posted by jparker2112

This is great....but im a moron when it comes to things like this. Say i want to have a custom lg start in 1900 with a bunch of HS and NCAA teams and 16 MLB teams. Can i adjust the birthdates of the master.csv file to have every draft class go to HS as 13 y/o olds? If yes...can i then watch them progress to ncaa/mlb and have careers, while a new draft class comes from the master.csv into HS year after year? That make any sense?

I haven't tested the program on anything of this magnitude. In theory it should work though.

[DrDoom]

Originally Posted by Seven_

Thanks so much for the help. I've followed the stats but I've encountered another problem. In the conversion of the files, I'm missing some of the 9 CSV's that you have listed. I additionally also have 3 CSV's that are named _unknown20, _unknownMinor13 and _unkownMinor22.

You're likely using a database for another version of OOTP. Unfortunately, the database's internal structure varies from version to version so, for instance, OOTP 21 Database Converter will only correctly disassemble and rebuild odb files made for OOTP 21. Internally, the odb files are arrays of the lahman based csv files that make them up stored in a computer friendly binary format. When you see files named _unknown20.csv or unknownMinor13.csv that means the Database Converter found information at the 20th index of the historical_database.odb or the 13th index of the historical_minor_database.odb that shouldn't be there for that particular version of OOTP.

I created these tools in my very limited amount of spare time so there is definitely room for improvement. In my next version, I'll likely try and make it so that the converter can determine what the data should be based on the data in the columns which should make it work universally across versions.

[DrDoom]

Originally Posted by actionjackson

HO. LEE. ****!!!

This is an absolutely ingenious piece of software. Ever since the historical database went on .odb lockdown, I've been looking for a way to fix things that irk me, and now tah-dah!!! Wow!

Thanks for the praise. Also, thanks for providing a great deal of the technical support.

[DrDoom]

Originally Posted by chucksabr

I have no idea what this database converter app is or what it is intended to do, and I can't really find any explanations either in this thread or anywhere else. But I do know that when I try to install it, I get this:

Attachment 842430

Before I go through the rigamarole of trying to get Norton to accept this setup file, can anyone please tell me, or point me to a link, as to what this app is supposed to do?

This is because Norton doesn't recognize me as the "publisher" or the program itself.

[DrDoom]

Some notes on the Database Converters for clarity:

The OOTP 21 and OOTP 22 Database Converter Tools will only correctly disassemble and rebuild odb files made for those respective versions of the game. This is because the data within the odb files are stored slightly differently from version to version. For example, here is how the data is indexed within the historical_database.odb and historical_minor_database.odb files for both OOTP 22 and OOTP 21:

OOTP 22
historical_database -> ( 1: Master.csv, 2: Batting.csv, 3: Batting-Normalized.csv,
4: Pitching.csv, 5: Pitching-Normalized.csv, 6: Fielding.csv,
7: FieldingOF.csv, 8: AllstarFull.csv, 9: AwardsPlayers.csv,
10: HallOfFame.csv, 11: Teams.csv, 12: TeamFranchises.csv,
13: SeriesPost.csv, 14: UniNumbers.csv, 15: Managers.csv,
16: AwardsManagers.csv, 17: BattingPost.csv, 18: PitchingPost.csv,
19: FieldingPost.csv, 20: empty, 21: RecordsSingleGame.csv, 22: BattingSplits.csv,
23: ODRosters.csv, 24: EOSRosters.csv, 25: empty, 26: empty)

historical_minor_database -> ( 1: MiLBMaster.csv, 2: MiLBBatting.csv, 3: empty,
4: MiLBPitching.csv, 5: empty, 6: MiLBFielding.csv,
7: empty, 8: empty, 9: empty, 10: empty, 11: MiLBTeams.csv,
12: empty, 13: empty, 14: empty, 15: empty, 16: empty,
17: empty, 18: empty, 19: empty, 20: MiLBLeagues.csv,
21: empty, 22: empty, 23: empty, 24: empty, 25: empty, 26: empty)

OOTP 21
historical_database -> ( 1: Master.csv, 2: Batting.csv, 3: Batting-Normalized.csv,
4: Pitching.csv, 5: Pitching-Normalized.csv, 6: Fielding.csv,
7: Fielding-Normalized.csv, 8: FieldingOF.csv, 9: FieldingOF-Normalized.csv,
10: AllstarFull.csv, 11: AwardsPlayers.csv, 12: HallOfFame.csv,
13: Teams.csv, 14: TeamFranchises.csv, 15: SeriesPost.csv,
16: UniNumbers.csv, 17: Managers.csv, 18: AwardsManagers.csv, 19: BattingPost.csv,
20: PitchingPost.csv, 21: FieldingPost.csv, 22: empty, 23: RecordsSingleGame.csv,
24: BattingSplits.csv, 25: ODRosters.csv, 26: EOSRosters.csv)

historical_minor_database -> ( 1: MiLBMaster.csv, 2: MiLBBatting.csv, 3: empty,
4: MiLBPitching.csv, 5: empty, 6: MiLBFielding.csv,
7: empty, 8: empty, 9: empty, 10: empty, 11: empty, 12: empty,
13: MiLBTeams.csv, 14: empty, 15: empty, 16: empty, 17: empty,
18: empty, 19: empty, 20: empty, 21: empty, 22: MiLBLeagues.csv,
23: empty, 24: empty, 25: empty, 26: empty)

As you can see, they're similar but not exactly the same. The difference here is that the "Normalized" fielding files were removed in OOTP 22 (Likely because they weren't being used and, possibly, were replaced by the ratings columns within the Fielding.csv files) which changed the indexed location of everything beyond them in the database. There may or may not be differences in databases from other versions of OOTP but I haven't taken the time to dissect them to confirm.

This is important because, currently, the locations are hard coded. This means that whatever data is at the first index of the historical_database.odb will always be exported as "Master.csv" and whatever data is at the second index will always be exported as "Batting.csv" etc... This works both ways as, when rebuilding an odb, "Master.csv" will always be placed into the first index and "Batting.csv" always the second, etc...

For example, if you were to disassemble an OOTP 21 set of odb files using the OOTP 22 Database converter, the Fielding.csv file would actually contain normalized fielding data because that is what lives at the 7th index of an OOTP 21 historical_database.odb file. Therefore, every single file after would contain the wrong data as well.

I can fix this by simply verifying the column headings and have the program name files based on those rather than their location in the database (actually, it will likely be the next thing I address). I just haven't taken the time to do that yet.

In the meantime, if you correct the filenames before rebuilding the databases, you should be able to use data from other versions just fine. You can verify whether or not the data is correct by comparing it to the data within the default odb files. Hopefully, this clears up some issues some of you may be having with the tools.

[DrDoom]

Originally Posted by actionjackson

Hey DrDoom. Just a suggestion here. You might want to put this in the Database Tools section of OOTP Mods.

Is it possible for one of the Forum Moderators to simply move this thread there?

[chucksabr]

Originally Posted by DrDoom

This is because Norton doesn't recognize me as the "publisher" or the program itself.

I suppose I can take a hack at it.


What is the purpose of the converter?

[DrDoom]

Originally Posted by chucksabr

I suppose I can take a hack at it.


What is the purpose of the converter?

It converts the odb files in OOTP stats folders to editable csv files. You can edit the data in the csv files (i.e. historic player stats, team info, league structures, etc...) and convert it back to odb files to use in OOTP. Just remember, don't overwrite the files in the default "stats" directory. See the guide for more details.

[chucksabr]

Originally Posted by DrDoom

It converts the odb files in OOTP stats folders to editable csv files. You can edit the data in the csv files (i.e. historic player stats, team info, league structures, etc...) and convert it back to odb files to use in OOTP. Just remember, don't overwrite the files in the default "stats" directory. See the guide for more details.

Ah, I think I see. OK, great, thanks.