ODB to CSV/CSV to ODB Converter

[DrDoom]

I've just managed to successfully create a program that can convert the historical*.odb files to CSV and another that converts CSV files back into odb format. I've tested the programs, making minor changes to the database, and they work beautifully so far. Nevertheless, I should probably do some more rigorous testing before releasing it to the public (message me if you'd like to help in testing, preferably if you already have a custom version of the lahman database you'd like to implement and you're comfortable with command line tools).

Edit: I've recently merged these tools into a single program with a simple gui. You can find it here: OOTP 21 Database Converter

[DrDoom]

I'm posting the files here for anyone to try. Please note that these tools are currently beta and may not always work. However, if you do run into problems, let me know and I will try to fix them.

OOTP Database Tools (0.81b)

OOTP Database Tools (.NET Core OSX)(0.82b)

[bulldog55]

This is so exciting, thanks so much! I'm going to download this and test it extensively - this could be huge for my online league.

[DrDoom]

Originally Posted by bulldog55

This is so exciting, thanks so much! I'm going to download this and test it extensively - this could be huge for my online league.

The documentation is a bit crude at the moment so let me know if you have any issues.

[HitnRun]

This sounds very interesting. I will be playing around with this for sure. Thank you for your efforts sir!

[DrDoom]

Uploaded a bug fix (v.76b) where some tables were being indexed incorrectly when converting back into an odb file.

[DrDoom]

Link updated to v.81b. When converting from CSV back to ODB, all of the necessary files will be in the output folder. Just copy the contents of the entire folder into your alternate stats folder and you're good to go.

Special thanks to bulldog55 for extensively beta testing this for me. I wouldn't be anywhere near where I am with the program if it wasn't for his efforts.

[Mifr44]

If someone wanted to average specific seasons for a player (or many players) in the CSV format, rather than rely on Career Totals or whatever seasons OOTP 21 uses for Peak Seasons to Average, is this the mechanism to get those seasons into ODB format that is usable by the game?

I was considering an attempt at manipulating the CSV format, but not if I am unable to get OOTP 21 to read the files.

[DrDoom]

Originally Posted by Mifr44

If someone wanted to average specific seasons for a player (or many players) in the CSV format, rather than rely on Career Totals or whatever seasons OOTP 21 uses for Peak Seasons to Average, is this the mechanism to get those seasons into ODB format that is usable by the game?

I was considering an attempt at manipulating the CSV format, but not if I am unable to get OOTP 21 to read the files.

It depends on how you set up your league to use the database. For histroical stats there are Batting.csv, Pitching.csv, and Fielding.csv. Then there are normalized versions of these named Batting-Normalized.csv, Pitching-Normalized.csv, Fielding-Normalized.csv where the stats have been normalized to the modern era. In addition to being Normalized, additional stat lines are added for players that didn't play in certain years or didn't play in the majors at all so that OOTP can better calculate ratings for players over the course of their career or calculate ratings for players that didn't ever play in the majors in real life based on how they might have played. For a better more in-depth explanation, search the forums for the Spritze-Garlon database (OOTP uses an updated version of this for it's normalized stats).

So to answer your question in a round-about way... yes.

[plannine]

It worked!

I now have the Bambam Twins back in the game, George and Herman Ruth, who have been missing for the last few versions of the game.

Now I need recalc and add all the players I use to have in previous versions (150 negro leaguers, 100 players from japan, 50 former PCL players) back to the Master file and dump all the players who's careers were less then a full season.

[jparker2112]

damn...yet another day I get squat for having an apple MacBook....

[DrDoom]

Originally Posted by jparker2112

damn...yet another day I get squat for having an apple MacBook....

I added a .NET Core Self contained build for OSX. I don't currently have a Mac to test it on so I'm not even 100% sure it works. I've added a download link at the top for anyone that wants to give it a shot.

[omniart]

Thank you for this! I'm working on a project, and this is exactly the tool that I need to make everything work smoothly!

[tomnov]

Just glancing thru some of the files generated, I see an error in your Master.csv output file. Anytime a player attended more than 1 college, the 2nd college offsets the rest of that player's data 1 column to the right.

Edit: Maybe this doesn't matter, as the same error exists in the original Master.csv from the game /stats folder.

[katielied]

yeah sorry...not a big fan of terminal but i'm willing to learn to get this database conversion done...

stuck on this part...
2. Copy the historical_database.odb, historical_minor_database.odb, historical_lineups.odb, and historical_transactions.odb files from OOTP's "stats" directory .i.e. "/Temp/HistoricODB". - [DON'T WORK WITH THE DEFAULT FILES DIRECTLY!]

3. Create an output folder .i.e. "C:\Temp\HistoricCSV".

4. From the command line, go to directory where you unzipped the ODBtoCSV folder and run it with the input and output folders. If you used the example directorys you would enter: open ODBtoCSV "/Temp/HistoricODB" "/Temp/HistoricCSV"


#2 i used the finder to copy the database files but don't know where exactly to put the folders...

#3 how do i create a "c:" folder on a mac? thought that was a windows thing

#4 obviously i keep getting a 'file doesn't exist' message in terminal

i don't know if you can clarify things for terminal morons...

if you can..thanks so much..,

been waiting for years to edit the database

thanks

[tomnov]

Originally Posted by katielied

yeah sorry...not a big fan of terminal but i'm willing to learn to get this database conversion done...

stuck on this part...
2. Copy the historical_database.odb, historical_minor_database.odb, historical_lineups.odb, and historical_transactions.odb files from OOTP's "stats" directory .i.e. "/Temp/HistoricODB". - [DON'T WORK WITH THE DEFAULT FILES DIRECTLY!]

3. Create an output folder .i.e. "C:\Temp\HistoricCSV".

4. From the command line, go to directory where you unzipped the ODBtoCSV folder and run it with the input and output folders. If you used the example directorys you would enter: open ODBtoCSV "/Temp/HistoricODB" "/Temp/HistoricCSV"


#2 i used the finder to copy the database files but don't know where exactly to put the folders...

#3 how do i create a "c:" folder on a mac? thought that was a windows thing

#4 obviously i keep getting a 'file doesn't exist' message in terminal

i don't know if you can clarify things for terminal morons...

if you can..thanks so much..,

been waiting for years to edit the database

thanks

#2, if you found the files in your /ootp/stats folder, you can copy them to any folder you create
#3 doesn't have to be c: drive necessarily.
so if you copied the zipped files to a folder named /ODBtoCSV, create a subfolder in that folder named HistoricODB, and paste the .odb files from the ootp/stats folder (that you copied, not moved)
and create another folder in the same place named HistoricCSV.
Then navigate your terminal prompt to the new /ODBtoCSV folder you created (can't tell you exactly how on a mac), and simply enter the command as:
ODBtoCSV HistoricODB HistoricCSV
Your output will be in the HistoricCSV folder.

[katielied]

thank you for helping...

i tried what you said and it looked like it was processing then i got errors...

Desktop/ODBtoCSV/libhostfxr.dylib failed
- Installing .NET Core prerequisites might help resolve this problem.
https://go.microsoft.com/fwlink/?linkid=2063366
logout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
Deleting expired sessions...9 completed.


i also go a message that includes: “libhostfxr.dylib” cannot be opened because the developer cannot be verified

getting there i guess...

appreciate the efforts to provide this for us...

idk why OOTP just doesn't let us go in and customize it...the whole mantra of OOTP is customize everything...yet, to me, the player database should be the first thing users can customize.

[tomnov]

I'm not the OP, nor at all well-versed on using Mac, but did you download the 2nd link, the one for OSX?
According to the description, that has some sort of needed Mac library files, though I don't know if you need to extract them anywhere special on a Mac.
Perhaps the zipfile has instructions to that point, IDK.
Or maybe you could do an internet search for the file in the error msg, and download that. Beyond that, I have no other suggestions. Sorry.
Maybe the OP will see our conversation and be able to more directly help you than I can.
Good luck.

[katielied]

yeah downloaded both and the first one contained .exe files so did everything with the 2nd link.

i can be patient...i gave up on OOTP for yrs cuz i couldn't edit the database...this gives me hope...

[DrDoom]

Originally Posted by katielied

thank you for helping...

i tried what you said and it looked like it was processing then i got errors...

Desktop/ODBtoCSV/libhostfxr.dylib failed
- Installing .NET Core prerequisites might help resolve this problem.
https://go.microsoft.com/fwlink/?linkid=2063366
logout
Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
Deleting expired sessions...9 completed.


i also go a message that includes: “libhostfxr.dylib” cannot be opened because the developer cannot be verified

getting there i guess...

appreciate the efforts to provide this for us...

idk why OOTP just doesn't let us go in and customize it...the whole mantra of OOTP is customize everything...yet, to me, the player database should be the first thing users can customize.

I'll look into it this weekend. Sorry about the late response, I've been slammed at work. A GUI is on my radar but work stuff comes first so I can't exactly say when I'll get around to it. Thank you for giving it a try though - I currently don't have access to a mac to test it on myself.