20 Day, 36400 game, 14 Engine, 200 Round RR started

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

20 Day, 36400 game, 14 Engine, 200 Round RR started

Post by MikeB »

Hash 256
tc 2.5 min base /2.5 sec increment - equivalent to CCRL 40/4

100 positions selected at random from a 2500 opening database, ,each position will be used for two rounds, second round with colors reversed

All shell script based using Hyatt's command line match program..

Code: Select all

set echo
set time = 25000
set inc =    250
echo "$time seconds/ $inc increment"

set eng1  = crafty-25.1.syzygy
set eng2  = texel64.ini
set eng3  = firenzina.ini
set eng4  = hiarcs-14.ini
set eng5  = arasan.ini
set eng6  = hakka322.ini
set eng7  = shredder.ini
set eng8  = senpai.ini
set eng9  = crafty-25.1
set eng10 = protector-v1.9.ini
set eng11 = komodo-9.42.ini
set eng12 = Stockfish-042516.ini
set eng13 = crafty-25.1.SyzygyA
set eng14 = Gull.3.x64.syzygy.ini

set opponents1=( $eng1 $eng2 $eng3 $eng4 $eng5 $eng6 $eng7 $eng8 $eng9 $eng10 $eng11 $eng12 $eng13 $eng14 )
set opponents2=( $eng14 $eng13 $eng12 $eng11 $eng10 $eng9 $eng8 $eng7 $eng6 $eng5 $eng4 $eng3 $eng2 $eng1 )

set players1=( 1 2 3 4 5 6 7 8 9 10 11 12 13 14 )
set players2=( 1 2 3 4 5 6 7 8 9 10 11 12 13 14 )

set number_of_players1 = 14
set number_of_players2 = 14

set file = new2500.epd
@ rounds  = 100
@ positions  = 1
set time_odds = 1
set games_per_position = 2
set positions_per_match = 1

echo "using $rounds positions from EPD file"
@ gamesPlanned = $number_of_players1 * ( $number_of_players2 - 1 ) * $rounds * $games_per_position
echo "gamesPlanned"
@ counterStart = ( $number_of_players2 - 1 ) * $games_per_position * 2
@ counterIncrement = ( $number_of_players2 - 1 ) *  $games_per_position

set logid1 = 101
set logid2 = 50101
rm -f commands
@ games = 0

set counter = 0
set gamesStarted = 0

loop:
@ position = `jot -r 1 1 2500` ## selects position at random for round
	foreach player1 ($players1)
		foreach player2 ($players2)
		if ($opponents1[$player1] == $opponents2[$player2] ) goto skip  #  do not want engines to play themselves
			echo "./match "match$player1.$position" $file $position $games_per_position $positions_per_match $time $inc  $opponents1[$player1] localhost $logid1 $opponents2[$player2] localhost $logid2 $time_odds" >> commands
			@ logid1 = $logid1 + $games_per_position * $positions_per_match
			@ logid2 = $logid2 + $games_per_position * $positions_per_match
			@ games = $games + ( 1 * $games_per_position )
			echo "$games"
		@ gamesStarted = $games - $counter
		if ($gamesStarted < $counterStart ) goto skip_1
			echo "echo " "" >> commands
			echo "echo $games of $gamesPlanned games started..." >> commands
			echo "./geteloRR1" >> commands
			echo "echo " ">>~/Dropbox/Shared\ Folder/elota.txt" >> commands
			echo "echo " ">>~/Dropbox/Shared\ Folder/elotb.txt" >> commands
			echo "echo "$games of $gamesPlanned games started...">>~/Dropbox/Shared\ Folder/elota.txt" >> commands
			echo "echo "$games of $gamesPlanned games started...">>~/Dropbox/Shared\ Folder/elotb.txt" >> commands
			echo "./geteloRR2>>~/Dropbox/Shared\ Folder/elota.txt" >> commands
			echo "./geteloRR3>>~/Dropbox/Shared\ Folder/elotb.txt" >> commands
			echo "cp pgn /Users/michaelbyrne/Dropbox/Shared\ Folder/all.pgn" >> commands
			@ counter = $counter + $counterIncrement
		skip_1:
		skip:
		end
	end  # round is completed with both colors scripted
	#echo "echo " "" >> commands
	#echo "./geteloRR1" >> commands
if ($games < $gamesPlanned) goto loop
Get realtime updates and a continuously updated pgn file below:

current results

pgn file

Initial files will take about 90 minutes from the the time of this post, after that, expect automatic updates about every 15 minutes or so for both files.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Day, 36400 game, 14 Engine, 200 Round RR started

Post by MikeB »

Real good chance that the server will go down. Some nasty thunderstorms are rolling through. I'm not there to bring it backup - so if you stop seeing updates , you know it went down.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Day, 36400 game, 14 Engine, 200 Round RR started

Post by MikeB »

need to shut it down


Code: Select all

final results:

Rank Name                       Elo    +    - games score oppo. draws 
   1 Stockfish 04.25.16        3366   63   63   126   86%  3079   25% 
   2 Komodo 9.42 64-bit        3355   60   60   142   83%  3076   18% 
   3 Gull 3.1 x64              3209   53   53   126   67%  3089   37% 
   4 Texel 1.05 64-bit         3148   48   48   148   58%  3089   30% 
   5 Protector 1.9.0           3130   48   48   150   56%  3094   29% 
   6 Firenzina 2.4.4 xTreme L  3122   47   47   148   55%  3091   36% 
   7 Hakkapeliitta 3.22        3064   47   47   150   45%  3099   35% 
   8 Senpai 1.0                3033   49   49   150   41%  3102   25% 
   9 Deep Shredder 12 x64      3015   49   49   149   39%  3101   30% 
  10 Crafty-25.1.SyzygyA       3007   51   51   126   38%  3101   37% 
  11 Crafty-25.1               3002   49   49   150   37%  3104   30% 
  12 Deep HIARCS 14 WCSC       2999   48   48   149   36%  3103   33% 
  13 Crafty-25.1-syzygy        2995   48   48   148   36%  3101   31% 
  14 Arasan 18.3               2955   50   50   150   31%  3108   27% 
tc 2.5 min base 2.5 sec inc
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Day, 36400 game, 14 Engine, 200 Round RR started

Post by MikeB »

I had some errors in the script code and decided to add some engines. Did a quick test with the new script with tc 1 + .05 sec increment - with the polyglot time fixed, most of the uci engines are doing very well.

4 position RR

Code: Select all

Rank Name                       Elo    +    - games score oppo. draws 
   1 SugaR 2.5, a derivative   3352   58   58   120   82%  3083   22% 
   2 Stockfish 04.25.16        3296   54   54   120   75%  3087   25% 
   3 Hakkapeliitta 3.22        3216   53   53   120   65%  3092   23% 
   4 Texel 1.06a34 64-bit      3207   52   52   120   63%  3093   22% 
   5 Firenzina 2.4.4 xTreme L  3189   51   51   120   61%  3094   27% 
   6 Senpai 1.0                3181   51   51   120   60%  3095   24% 
   7 Komodo 9.42 64-bit        3179   52   52   120   59%  3095   20% 
   8 Protector 1.9.0           3137   51   51   120   55%  3098   26% 
   9 Cheng 4.39                3070   51   51   120   45%  3102   24% 
  10 Gull 3.1 x64              3045   51   51   120   42%  3104   27% 
  11 Crafty-25.1               3044   52   52   120   41%  3104   23% 
  12 Crafty-25.1-syzygy        3030   52   52   120   39%  3105   23% 
  13 Arasan 18.3               3023   53   53   120   39%  3105   23% 
  14 Vajolet2 2.0              3008   54   54   120   37%  3106   18% 
  15 Deep Shredder 12 x64      2982   54   54   120   33%  3108   23% 
  16 Deep HIARCS 14 WCSC       2639   93   93   120    5%  3131    4% 
next up is 3 sec base with .05 sec inc
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 20 Day, 36400 game, 14 Engine, 200 Round RR started

Post by MikeB »

tc 3 sec tc .05 sec

Code: Select all

Rank Name                       Elo    +    - games score oppo. draws 
   1 Stockfish 04.25.16        3342   58   58   120   81%  3084   27% 
   2 SugaR 2.5, a derivative   3329   58   58   120   79%  3085   23% 
   3 Komodo 9.42 64-bit        3281   56   56   120   73%  3088   23% 
   4 Senpai 1.0                3207   54   54   120   63%  3093   21% 
   5 Gull 3.1 x64              3189   53   53   120   61%  3094   23% 
   6 Firenzina 2.4.4 xTreme L  3187   53   53   120   61%  3094   25% 
   7 Protector 1.9.0           3169   53   53   120   59%  3095   23% 
   8 Hakkapeliitta 3.22        3167   54   54   120   59%  3096   18% 
   9 Texel 1.06a34 64-bit      3147   53   53   120   55%  3097   18% 
  10 Cheng 4.39                2997   55   55   120   38%  3107   15% 
  11 Vajolet2 2.0              2983   55   55   120   35%  3108   17% 
  12 Crafty-25.1               2962   55   55   120   32%  3109   20% 
  13 Deep HIARCS 14 WCSC       2947   58   58   120   31%  3110   13% 
  14 Crafty-25.1-syzygy        2924   58   58   120   27%  3112   18% 
  15 Arasan 18.3               2918   58   58   120   27%  3112   17% 
  16 Deep Shredder 12 x64      2852   62   62   120   20%  3117   13% 
nextup tc 24 sec base , .4 sec inc