WitPTracker AE News

[fcharton]

Since a few turns, the time needed for Tracker to initialize underwent a noticeable change, from less than a minute, to 12-15... (840 seconds for the base load, and about a minute more for the actual program start)

I now have 167 turns in the database, it is big (270MB) but not huge.

During the database load, memory usage is relatively low (about 150MB), as is processor usage (a few percents)
During the program load, both get slightly higher (500MB and 15-30%, on a dual core), but nothing too bad.

What seems to kill the whole thing seem to be the IO, and specifically the reads : Windows records 6 million reads for the base. I suspect the speed could be nicely reduced if some of those could be cached (there probably are a few files/data structure which bear the brunt of the IO). The fact that the change happened suddenly once a certain limit is reached suggests some parameter in Java or the database... (ie over a certain size, everything is done on disk, and gets slow)

In the meantime, is there any way I can speed up the loading, some way to "pack" the existing DB? some change in my java configuration?

Thanks in advance.
Francois

[floydg]

ORIGINAL: Roger Neilson II

Is there any way???????

Of combining Intel and combat reports to give a better picture for a player? This may not be possible in Tracker itself, but has anyone found a way of using stuff from tracker and the combat/ops reports to do this? If I am after the 'behaviour' of a certain Jap Division as an example I may well have info in three separate places and would like to have this in one - in real life there'd be some junior intel guy detailed with keeping this all recorded. I assume its an issue of extracting relevant text strings from the three reports and then combining them into a searchable database format.

Yes, there is a way. And long-term, that is the goal. Now if only work and family would leave me alone for the 40 hours it would take to do... [;)]

[invernomuto]

Can't load the tracker after upgrading to a Win7 64bit notebook. Using latest beta, tried to copy .dll from beta2 directory and installed vcredist_x86.exe.
Here is the error I got:

C:\Users\Davide\Downloads\WITP AE\WitPTracker AE PBEM Ste>java -Xms384m -Xmx512m
-jar "WitPTracker.jar" nomap
Upgrading WitPTracker AE database.
Exception in thread "main" java.lang.UnsatisfiedLinkError: C:\Users\Davide\Downl
oads\WITP AE\WitPTracker AE PBEM Ste\pwsdll.dll: Can't load IA 32-bit .dll on a
AMD 64-bit platform
       at java.lang.ClassLoader$NativeLibrary.load(Native Method)
       at java.lang.ClassLoader.loadLibrary0(Unknown Source)
       at java.lang.ClassLoader.loadLibrary(Unknown Source)
       at java.lang.Runtime.loadLibrary0(Unknown Source)
       at java.lang.System.loadLibrary(Unknown Source)
       at JNIpws.JNIpws.<clinit>(JNIpws.java:20)
       at witptracker.SaveFileReader.<init>(SaveFileReader.java:94)
       at witptracker.DBUpgrade.DoUpgrade(DBUpgrade.java:200)
       at witptracker.Main.main(Main.java:153)

C:\Users\Davide\Downloads\WITP AE\WitPTracker AE PBEM Ste>pause
Premere un tasto per continuare . . .

Any hint?

[n01487477]

ORIGINAL: invernomuto

Can't load the tracker after upgrading to a Win7 64bit notebook. Using latest beta, tried to copy .dll from beta2 directory and installed vcredist_x86.exe.
Here is the error I got:

C:\Users\Davide\Downloads\WITP AE\WitPTracker AE PBEM Ste>java -Xms384m -Xmx512m
-jar "WitPTracker.jar" nomap
Upgrading WitPTracker AE database.
Exception in thread "main" java.lang.UnsatisfiedLinkError: C:\Users\Davide\Downl
oads\WITP AE\WitPTracker AE PBEM Ste\pwsdll.dll: Can't load IA 32-bit .dll on a
AMD 64-bit platform
       at java.lang.ClassLoader$NativeLibrary.load(Native Method)
       at java.lang.ClassLoader.loadLibrary0(Unknown Source)
       at java.lang.ClassLoader.loadLibrary(Unknown Source)
       at java.lang.Runtime.loadLibrary0(Unknown Source)
       at java.lang.System.loadLibrary(Unknown Source)
       at JNIpws.JNIpws.<clinit>(JNIpws.java:20)
       at witptracker.SaveFileReader.<init>(SaveFileReader.java:94)
       at witptracker.DBUpgrade.DoUpgrade(DBUpgrade.java:200)
       at witptracker.Main.main(Main.java:153)

C:\Users\Davide\Downloads\WITP AE\WitPTracker AE PBEM Ste>pause
Premere un tasto per continuare . . .

Any hint?

Yep - reinstall the 32 bit Libraries and make sure you're using 32 bit java.
The C++ lib I have installed are : -


http://sites.google.com/site/witptracker/support

[floydg]

ORIGINAL: n01487477

ORIGINAL: Graymane

Also, a nation filter on the Ships data set.

Not saying it won't happen but primarily as a IJ player I'm curious why you want this?

Easy to add, so I did it.

[floydg]

ORIGINAL: fcharton

Since a few turns, the time needed for Tracker to initialize underwent a noticeable change, from less than a minute, to 12-15... (840 seconds for the base load, and about a minute more for the actual program start)

I now have 167 turns in the database, it is big (270MB) but not huge.

During the database load, memory usage is relatively low (about 150MB), as is processor usage (a few percents)
During the program load, both get slightly higher (500MB and 15-30%, on a dual core), but nothing too bad.

What seems to kill the whole thing seem to be the IO, and specifically the reads : Windows records 6 million reads for the base. I suspect the speed could be nicely reduced if some of those could be cached (there probably are a few files/data structure which bear the brunt of the IO). The fact that the change happened suddenly once a certain limit is reached suggests some parameter in Java or the database... (ie over a certain size, everything is done on disk, and gets slow)

In the meantime, is there any way I can speed up the loading, some way to "pack" the existing DB? some change in my java configuration?

Thanks in advance.
Francois

Sorry, not much you can do here.

I experimented a bit with some optimization with ship information. I did this several releases back and there were no complaints, so maybe it worked. That means I can apply that to some other database tables when I find some time (it's not simple).

[fcharton]

Hi Floyd,

ORIGINAL: floydg
I experimented a bit with some optimization with ship information. I did this several releases back and there were no complaints, so maybe it worked. That means I can apply that to some other database tables when I find some time (it's not simple).

Do you think there is a way you can find out which tables get most of the accesses? I'm saying that because the way it happened (once you pass a certain, not huge, size) suggests a cache size issue. If (by chance) the problem was limited to a file, then get it into memory at startup would result in a huge speedup.

But no rush, Tracker is just too important a tool to pass, I, like many others I believe, am quite happy to wait to get it working.

Francois

[SgtSwanson]

I've tried to run the tracker twice now and keep getting a Java not found it is nor reconizesed as an internal or external program.

[pws1225]

If you haven't done so already, put a copy of java.exe in the tracker folder. You need the 32 bit version found in the C:\Program Files(x86)\Java directory. That fixed it for me.

[SgtSwanson]

These are the msgs I'm getting after putting the Java.exe in the folder




What the folder looks like, it's currently in the game dir.



The first 2 images will flip flop between the regular and no-map modes.

[floydg]

ORIGINAL: SgtSwanson

These are the msgs I'm getting after putting the Java.exe in the folder




What the folder looks like, it's currently in the game dir.



The first 2 images will flip flop between the regular and no-map modes.

The message about the keyword in the witptracker.properties file isn't really the cause of the problems, but send it to me at witptracker@gmail.com and I'll check it.

The other error is because the program didn't clean up the database files. Remove the six trackerdb.* files and then try to run it again.

Floyd

[pws1225]

Six db files? I thought there were only four.

[floydg]

ORIGINAL: pws1225

Six db files? I thought there were only four.

Usually four, but his screenshot showed six, since some were "in progress" files, like the lock file.

[Xargun]

ORIGINAL: fcharton

Since a few turns, the time needed for Tracker to initialize underwent a noticeable change, from less than a minute, to 12-15... (840 seconds for the base load, and about a minute more for the actual program start)

I now have 167 turns in the database, it is big (270MB) but not huge.

During the database load, memory usage is relatively low (about 150MB), as is processor usage (a few percents)
During the program load, both get slightly higher (500MB and 15-30%, on a dual core), but nothing too bad.

What seems to kill the whole thing seem to be the IO, and specifically the reads : Windows records 6 million reads for the base. I suspect the speed could be nicely reduced if some of those could be cached (there probably are a few files/data structure which bear the brunt of the IO). The fact that the change happened suddenly once a certain limit is reached suggests some parameter in Java or the database... (ie over a certain size, everything is done on disk, and gets slow)

In the meantime, is there any way I can speed up the loading, some way to "pack" the existing DB? some change in my java configuration?

Thanks in advance.
Francois

I am having the same problem with Tracker taking 15+ minutes to load. Usually took 90-100 seconds before then all of a sudden the time jumped to 3 minutes, then 4 and now were are up to 12 or more everytime. Not sure if I have some corruption in a data file or what but it really adds time to doing a turn as Japan.

I also notice that I cannot open tracker and then go back into the game - when I alt-tab back out Tracker has closed. Any ideas ?

Xargun

[floydg]

ORIGINAL: Xargun

ORIGINAL: fcharton

Since a few turns, the time needed for Tracker to initialize underwent a noticeable change, from less than a minute, to 12-15... (840 seconds for the base load, and about a minute more for the actual program start)

I now have 167 turns in the database, it is big (270MB) but not huge.

During the database load, memory usage is relatively low (about 150MB), as is processor usage (a few percents)
During the program load, both get slightly higher (500MB and 15-30%, on a dual core), but nothing too bad.

What seems to kill the whole thing seem to be the IO, and specifically the reads : Windows records 6 million reads for the base. I suspect the speed could be nicely reduced if some of those could be cached (there probably are a few files/data structure which bear the brunt of the IO). The fact that the change happened suddenly once a certain limit is reached suggests some parameter in Java or the database... (ie over a certain size, everything is done on disk, and gets slow)

In the meantime, is there any way I can speed up the loading, some way to "pack" the existing DB? some change in my java configuration?

Thanks in advance.
Francois

I am having the same problem with Tracker taking 15+ minutes to load. Usually took 90-100 seconds before then all of a sudden the time jumped to 3 minutes, then 4 and now were are up to 12 or more everytime. Not sure if I have some corruption in a data file or what but it really adds time to doing a turn as Japan.

I also notice that I cannot open tracker and then go back into the game - when I alt-tab back out Tracker has closed. Any ideas ?

Xargun

As more turns are loaded, more memory is needed. I'm guessing that you've reached a threshold where the program has to start paging to disk, significantly slowing things down. Can you try an experiment and reboot your PC and run just WitPTracker (nothing else) and see if the speed increases?

[paulkenny]

I want to load a different game in tracker, my game I was tracking seems to have died out.&nbsp; So I moved all of those saved files from the tracker folder and saved my new turns into tracker (started later in the game so only have 2 turn in-in August 42).
&nbsp;
changed the name of the game in the batch file
&nbsp;
but when I load tracker it still loads the old game, im not sure how it even finds those files
&nbsp;
any suggestions?

[seille]

ORIGINAL: paulkenny

I want to load a different game in tracker, my game I was tracking seems to have died out.  So I moved all of those saved files from the tracker folder and saved my new turns into tracker (started later in the game so only have 2 turn in-in August 42).

changed the name of the game in the batch file

but when I load tracker it still loads the old game, im not sure how it even finds those files

any suggestions?

Did you delete the old database files ?
trackerdb.*** you have to delete.
Or you delete the current tracker folder and start with a fresh installation.

edit: There is a screenshot a few postings above. There you can see the database files i talked about.

[paulkenny]

that would be both the trackerdb AND the trackerdb.backup files plus the other three trackerdb files?

[seille]

Yes, if you want to initialize a new DB you have to delete all files that start with trackerdb.
Thats what i did and it worked.

[paulkenny]

got it working thanks