Tool to plot ongoing results

Discussion of chess software programming and technical issues.

Moderator: Ras

mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Tool to plot ongoing results

Post by mcostalba »

Ok, I am now doing my first tests with LittleBlitzer and it seems to me to see a "drift" on results going on with games.

IOW against one engine SF started with 56.6 % of winning percentage after 2000 games but then, moved to 55,9% after 5K games and then 54.7 after 7K games.

I have saw this manually sampling partial results after some time, but I would like to see the graph to be built autamatically.

LittleBlitzer saves results on a pgn file in cronological order. So my question is: do you know if exsists a tool that reads a PGN file and plots (or saves in a csv / excel file) the partial score on Y axis and the number of played games on X axsis ?

Thanks
Marco

P.S: Someone knows if LittleBlitzer restarts the engine or forces clearing the hash table (UCI option "Clear Hash") after each game ?
User avatar
nthom
Posts: 112
Joined: Thu Mar 09, 2006 6:15 am
Location: Australia

Re: Tool to plot ongoing results

Post by nthom »

LittleBlitzer definitely restarts each engine after every game. I am actually building that exact graph (ELO/time) into the next version of the tool, but I don't expect it to be ready any time soon due to other commitments :(

As for the drift, if it's within the error margin, all I can suggest is that the instruction cache might be getting better hits or some other Windows caching effects? I'm no expert in this.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Tool to plot ongoing results

Post by Laskos »

mcostalba wrote:Ok, I am now doing my first tests with LittleBlitzer and it seems to me to see a "drift" on results going on with games.

IOW against one engine SF started with 56.6 % of winning percentage after 2000 games but then, moved to 55,9% after 5K games and then 54.7 after 7K games.


Thanks
Marco
Depending on the number of draws, the 95% confidence intervals in 2000 games are +/- (1.7-1.9%), thus you still are inside these "normal" margins.