Missing players in csv

Tony M · 06-06-2007, 12:38 PM

If I look at my league database info, it says there are 9711 players in it, and if you export it to CSV that is what you get, 9711 players.

There are however 4264 players in the retired.dat table and 12280 in players.dat.

I suppose I could go and get the list of player id's in players.dat and compare them to the csv dump to find out who's missing, but there must be a reason as to why they aren't being dumped.

And I can see all 12280 in my code and the records appear to be complete so these players must exist somewhere... though I'll probably get told that I don't know what I'm talking about.

Zeyes · 06-06-2007, 01:17 PM

Are hidden international players included in the csv dump this year? I recall they weren't in v2006. Pretty big difference in the player count though, so I'm probably on the wrong track here...

Nutlaw · 06-06-2007, 07:27 PM

I'm not sure. Redsoxford, do you have hidden players activated?

Out of curiousity, how many coaches are listed in your database? Could there be 2569 of them?

Zeyes · 06-06-2007, 07:48 PM

Another thought...do you have "delete retired players who never reached the majors" activated? Maybe the excess data in players.dat belongs to such guys. (Which of course would be a bug if they're correctly omitted from retired.dat but stick around in the active file...)

Tony M · 06-07-2007, 04:26 AM

I'm just investigating these players.

I don't have ghost players turned on, nor do I have delete those who never reach majors. A cursory look through the names makes them out to be non-US but I'll just output the list with their nations and see how that splits out.

Tony M · 06-07-2007, 04:40 AM

dola,

I've just split out the list of players in players.dat and not in the csv and looked at their nationality.

I did this in a fresh league that I simmed through for 5 years. There are 2303 players not listed in the csv that are in the database.

And they come from 210 different nations.

There are a large number from the obvious powerhouses - Dominican Republic, Puerto Rico, Venezuela, United States and Japan and it seems to be based on baseball level in that country.

So somewhere like Afghanistan has only one player listed, a Hashim bin Hamdan, a 1st baseman.

I'm just going to set off a scout to scout Afghanistan and see who he finds...

Tony M · 06-07-2007, 06:57 AM

triola,

he didn't find anything in a year scouting in Afghanistan, but I sent another scout to search the Dominican Republic and sure enough he found one of these hidden players.

So, it's not a bug then.

06-06-2007, 12:38 PM	#1
Tony M Global Moderator Join Date: Feb 2006 Location: Here Posts: 6,156	Missing players in csv If I look at my league database info, it says there are 9711 players in it, and if you export it to CSV that is what you get, 9711 players. There are however 4264 players in the retired.dat table and 12280 in players.dat. I suppose I could go and get the list of player id's in players.dat and compare them to the csv dump to find out who's missing, but there must be a reason as to why they aren't being dumped. And I can see all 12280 in my code and the records appear to be complete so these players must exist somewhere... though I'll probably get told that I don't know what I'm talking about.

06-06-2007, 01:17 PM	#2
Zeyes All Star Reserve Join Date: Jun 2006 Posts: 818	Are hidden international players included in the csv dump this year? I recall they weren't in v2006. Pretty big difference in the player count though, so I'm probably on the wrong track here...

06-06-2007, 07:27 PM	#3
Nutlaw Hall Of Famer Join Date: Apr 2003 Posts: 9,538	I'm not sure. Redsoxford, do you have hidden players activated? Out of curiousity, how many coaches are listed in your database? Could there be 2569 of them?

06-06-2007, 07:48 PM	#4
Zeyes All Star Reserve Join Date: Jun 2006 Posts: 818	Another thought...do you have "delete retired players who never reached the majors" activated? Maybe the excess data in players.dat belongs to such guys. (Which of course would be a bug if they're correctly omitted from retired.dat but stick around in the active file...)

06-07-2007, 04:26 AM	#5
Tony M Global Moderator Join Date: Feb 2006 Location: Here Posts: 6,156	I'm just investigating these players. I don't have ghost players turned on, nor do I have delete those who never reach majors. A cursory look through the names makes them out to be non-US but I'll just output the list with their nations and see how that splits out.

06-07-2007, 04:40 AM	#6
Tony M Global Moderator Join Date: Feb 2006 Location: Here Posts: 6,156	dola, I've just split out the list of players in players.dat and not in the csv and looked at their nationality. I did this in a fresh league that I simmed through for 5 years. There are 2303 players not listed in the csv that are in the database. And they come from 210 different nations. There are a large number from the obvious powerhouses - Dominican Republic, Puerto Rico, Venezuela, United States and Japan and it seems to be based on baseball level in that country. So somewhere like Afghanistan has only one player listed, a Hashim bin Hamdan, a 1st baseman. I'm just going to set off a scout to scout Afghanistan and see who he finds...

06-07-2007, 06:57 AM	#7
Tony M Global Moderator Join Date: Feb 2006 Location: Here Posts: 6,156	triola, he didn't find anything in a year scouting in Afghanistan, but I sent another scout to search the Dominican Republic and sure enough he found one of these hidden players. So, it's not a bug then.