Ok, I am now doing my first tests with LittleBlitzer and it seems to me to see a "drift" on results going on with games.
IOW against one engine SF started with 56.6 % of winning percentage after 2000 games but then, moved to 55,9% after 5K games and then 54.7 after 7K games.
I have saw this manually sampling partial results after some time, but I would like to see the graph to be built autamatically.
LittleBlitzer saves results on a pgn file in cronological order. So my question is: do you know if exsists a tool that reads a PGN file and plots (or saves in a csv / excel file) the partial score on Y axis and the number of played games on X axsis ?
Thanks
Marco
P.S: Someone knows if LittleBlitzer restarts the engine or forces clearing the hash table (UCI option "Clear Hash") after each game ?
Tool to plot ongoing results
Moderator: Ras
-
- Posts: 112
- Joined: Thu Mar 09, 2006 6:15 am
- Location: Australia
Re: Tool to plot ongoing results
LittleBlitzer definitely restarts each engine after every game. I am actually building that exact graph (ELO/time) into the next version of the tool, but I don't expect it to be ready any time soon due to other commitments 
As for the drift, if it's within the error margin, all I can suggest is that the instruction cache might be getting better hits or some other Windows caching effects? I'm no expert in this.

As for the drift, if it's within the error margin, all I can suggest is that the instruction cache might be getting better hits or some other Windows caching effects? I'm no expert in this.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Tool to plot ongoing results
Depending on the number of draws, the 95% confidence intervals in 2000 games are +/- (1.7-1.9%), thus you still are inside these "normal" margins.mcostalba wrote:Ok, I am now doing my first tests with LittleBlitzer and it seems to me to see a "drift" on results going on with games.
IOW against one engine SF started with 56.6 % of winning percentage after 2000 games but then, moved to 55,9% after 5K games and then 54.7 after 7K games.
Thanks
Marco