Discussion of computer chess matches and engine tournaments.
Moderator: Ras
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Tue Oct 25, 2022 7:37 pm
AMD Ryzen 7 5700G
Windows 10 64 bits
GUI: Cutechess 1.20 (mod version available in RWBC site)
Cores: 1 per engine
Ponder: Off
TC: 3'+2"
Hash: 256MB
Round robins with the same position played with white and black pieces.
Position 1: 1. e4 d5
Results Code: Select all
Score (Tie) FS St St St St St Fa St Fa Fa St Fa Fa Fa Fa
----------------------------------------------------------------------------------------------------
1: FSF_14.0.1_NNUEi-avx2 25.0 / 28 310.50 XX 11 10 10 10 11 11 11 11 11 11 11 11 11 11 (+25 -3 =0)
2: Stockfish_MV_130620 22.0 / 28 264.00 00 XX 11 11 10 01 11 01 01 11 11 11 11 11 11 (+22 -6 =0)
3: Stockfish_MV_081018 20.0 / 28 241.50 01 00 XX 10 10 11 10 11 11 10 11 11 10 11 11 (+20 -8 =0)
4: Stockfish_MV_160221 20.0 / 28 228.50 01 00 01 XX 01 10 10 11 01 11 11 11 11 11 11 (+20 -8 =0)
5: Stockfish_MV_260719 19.5 / 28 237.50 01 01 01 10 XX 1= 10 01 11 10 01 11 11 11 11 (+19 -8 =1)
6: Stockfish MV 310720 18.0 / 28 192.00 00 10 00 01 0= XX 10 =1 11 11 10 11 11 11 11 (+17 -9 =2)
7: Fairy Stockfish LB 11.2 14.0 / 28 172.50 00 00 01 01 01 01 XX 11 01 10 11 01 01 10 01 (+14 -14 =0)
8: Stockfish_MV_210418 13.5 / 28 143.50 00 10 00 00 10 =0 00 XX 01 11 11 11 01 01 11 (+13 -14 =1)
9: Fairy Stockfish 8x8 12.02.2021 11.0 / 28 117.50 00 10 00 10 00 00 10 10 XX 00 00 11 11 01 11 (+11 -17 =0)
10: Fairy Stockfish 8x8 11.2 10.0 / 28 113.50 00 00 01 00 01 00 01 00 11 XX 11 00 01 11 00 (+10 -18 =0)
11: Stockfish_MV_020717 10.0 / 28 98.50 00 00 00 00 10 01 00 00 11 00 XX 01 11 10 11 (+10 -18 =0)
12: Fairy SF 8x8 14 HCE 9.0 / 28 74.00 00 00 00 00 00 00 10 00 00 11 10 XX 11 11 10 (+9 -19 =0)
13: Fairy SF LB 14.0.1 HCE 6.0 / 28 69.50 00 00 01 00 00 00 10 10 00 10 00 00 XX 01 01 (+6 -22 =0)
14: Fairy Stockfish LB 12022021 6.0 / 28 60.50 00 00 00 00 00 00 01 10 10 00 01 00 10 XX 10 (+6 -22 =0)
15: Fairy SF LB v14 HCE 6.0 / 28 55.00 00 00 00 00 00 00 10 00 00 11 00 01 10 01 XX (+6 -22 =0)
----------------------------------------------------------------------------------------------------
210 games: +129 -79 =2
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Wed Oct 26, 2022 4:25 pm
Position 2: 1. d4 d5
Results Code: Select all
Score (Tie) FS St Fa St Fa St St Fa St Fa St Fa St Fa Fa
----------------------------------------------------------------------------------------------------
1: FSF_14.0.1_NNUEi-avx2 28.0 / 28 364.00 XX 11 11 11 11 11 11 11 11 11 11 11 11 11 11 (+28 -0 =0)
2: Stockfish_MV_081018 18.5 / 28 226.50 00 XX 11 10 11 01 00 11 == 10 11 01 11 1= 11 (+17 -8 =3)
3: Fairy SF LB v14 HCE 16.0 / 28 189.75 00 00 XX 00 11 11 11 0= 01 01 01 10 11 =1 11 (+15 -11 =2)
4: Stockfish_MV_130620 15.5 / 28 190.25 00 01 11 XX 00 00 1= 01 11 11 10 10 01 10 11 (+15 -12 =1)
5: Fairy Stockfish 8x8 12.02.2021 15.5 / 28 176.75 00 00 00 11 XX 10 10 0= 01 01 11 11 10 11 11 (+15 -12 =1)
6: Stockfish_MV_260719 15.0 / 28 185.00 00 10 00 11 01 XX 01 01 11 01 01 11 00 10 11 (+15 -13 =0)
7: Stockfish_MV_160221 14.5 / 28 180.25 00 11 00 0= 01 10 XX 11 10 01 00 01 11 01 11 (+14 -13 =1)
8: Fairy SF 8x8 14 HCE 14.5 / 28 176.50 00 00 1= 10 1= 10 00 XX 10 1= 01 10 11 11 10 (+13 -12 =3)
9: Stockfish_MV_210418 13.5 / 28 161.25 00 == 10 00 10 00 01 01 XX 11 1= 01 00 11 11 (+12 -13 =3)
10: Fairy Stockfish 8x8 11.2 12.5 / 28 149.75 00 01 10 00 10 10 10 0= 00 XX 11 11 01 00 11 (+12 -15 =1)
11: Stockfish_MV_020717 11.5 / 28 141.75 00 00 10 01 00 10 11 10 0= 00 XX 10 11 10 01 (+11 -16 =1)
12: Fairy Stockfish LB 12022021 10.0 / 28 129.00 00 10 01 01 00 00 10 01 10 00 01 XX 10 10 10 (+10 -18 =0)
13: Stockfish MV 310720 10.0 / 28 125.50 00 00 00 10 01 11 00 00 11 10 00 01 XX 10 10 (+10 -18 =0)
14: Fairy SF LB 14.0.1 HCE 10.0 / 28 123.75 00 0= =0 01 00 01 10 00 00 11 01 01 01 XX 01 (+9 -17 =2)
15: Fairy Stockfish LB 11.2 5.0 / 28 56.00 00 00 00 00 00 00 00 01 00 00 10 01 01 10 XX (+5 -23 =0)
----------------------------------------------------------------------------------------------------
210 games: +122 -79 =9
I forgot to mention that FSF_14.0.1_NNUEi-avx2 is the binary that MTaktikos shared
here . It is Fairy Stockfish 8x8 v14.0.1 with internal NNUE (crazyhouse-8ebf84784ad2.nnue of Belzedar)
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Thu Oct 27, 2022 9:15 pm
Position 3 : 1. e4 e5 2. Nf3 Nc6 3. Bc4 Bc5 4. O-O Nf6 5. d3 O-O
Results Code: Select all
Score (Tie) FS St Fa St St Fa Fa Fa St St St Fa Fa Fa St
----------------------------------------------------------------------------------------------------
1: FSF_14.0.1_NNUEi-avx2 24.0 / 28 317.50 XX 11 11 10 11 01 01 11 11 11 11 10 11 11 11 (+24 -4 =0)
2: Stockfish_MV_260719 16.5 / 28 212.25 00 XX 10 10 11 10 10 01 01 10 01 01 11 11 =1 (+16 -11 =1)
3: Fairy Stockfish 8x8 12.02.2021 15.0 / 28 196.00 00 01 XX 01 01 10 01 01 10 01 11 11 10 01 10 (+15 -13 =0)
4: Stockfish MV 310720 14.5 / 28 200.00 01 01 10 XX 00 1= 10 01 10 01 10 11 10 01 10 (+14 -13 =1)
5: Stockfish_MV_160221 14.5 / 28 189.50 00 00 10 11 XX 10 10 11 10 10 01 01 10 =1 01 (+14 -13 =1)
6: Fairy SF LB v14 HCE 14.0 / 28 191.25 10 01 01 0= 01 XX 01 01 10 01 10 10 10 0= 11 (+13 -13 =2)
7: Fairy Stockfish LB 12022021 14.0 / 28 190.50 10 01 10 01 01 10 XX 00 10 01 10 01 10 01 11 (+14 -14 =0)
8: Fairy Stockfish 8x8 11.2 14.0 / 28 180.00 00 10 10 10 00 10 11 XX 01 10 01 01 01 01 11 (+14 -14 =0)
9: Stockfish_MV_210418 13.0 / 28 173.00 00 10 01 01 01 01 01 10 XX 01 10 10 01 01 10 (+13 -15 =0)
10: Stockfish_MV_081018 13.0 / 28 173.00 00 01 10 10 01 10 10 01 10 XX 10 01 10 01 01 (+13 -15 =0)
11: Stockfish_MV_130620 13.0 / 28 166.50 00 10 00 01 10 01 01 10 01 01 XX 10 01 01 11 (+13 -15 =0)
12: Fairy Stockfish LB 11.2 12.0 / 28 168.50 01 10 00 00 10 01 10 10 01 10 01 XX 01 01 01 (+12 -16 =0)
13: Fairy SF LB 14.0.1 HCE 12.0 / 28 157.50 00 00 01 01 01 01 01 10 10 01 10 10 XX 01 10 (+12 -16 =0)
14: Fairy SF 8x8 14 HCE 12.0 / 28 157.25 00 00 10 10 =0 1= 10 10 10 10 10 10 10 XX 10 (+11 -15 =2)
15: Stockfish_MV_020717 8.5 / 28 114.25 00 =0 01 01 10 00 00 00 01 10 00 10 01 01 XX (+8 -19 =1)
----------------------------------------------------------------------------------------------------
210 games: +181 -25 =4
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Fri Oct 28, 2022 6:15 pm
Position 4 : 1. d4 Nf6
Results Code: Select all
Score (Tie) FS St St St St St St Fa Fa Fa Fa Fa St Fa Fa
----------------------------------------------------------------------------------------------------
1: FSF_14.0.1_NNUEi-avx2 28.0 / 28 364.00 XX 11 11 11 11 11 11 11 11 11 11 11 11 11 11 (+28 -0 =0)
2: Stockfish_MV_260719 19.0 / 28 224.50 00 XX 01 10 10 01 11 10 10 01 11 11 11 11 11 (+19 -9 =0)
3: Stockfish_MV_130620 16.5 / 28 202.25 00 10 XX 01 11 11 =0 10 00 00 11 11 10 11 11 (+16 -11 =1)
4: Stockfish MV 310720 16.0 / 28 194.50 00 01 10 XX 01 10 01 11 11 00 01 01 10 11 11 (+16 -12 =0)
5: Stockfish_MV_081018 16.0 / 28 189.50 00 01 00 10 XX 10 10 10 11 11 01 01 11 01 11 (+16 -12 =0)
6: Stockfish_MV_210418 16.0 / 28 187.50 00 10 00 01 01 XX 01 01 11 11 10 00 11 11 11 (+16 -12 =0)
7: Stockfish_MV_160221 15.5 / 28 181.75 00 00 =1 10 01 10 XX 10 00 01 11 11 11 01 11 (+15 -12 =1)
8: Fairy Stockfish 8x8 12.02.2021 13.5 / 28 172.25 00 01 01 00 01 10 01 XX 10 11 11 01 10 10 0= (+13 -14 =1)
9: Fairy Stockfish 8x8 11.2 12.0 / 28 159.25 00 01 11 00 00 00 11 01 XX 10 1= 11 01 0= 00 (+11 -15 =2)
10: Fairy Stockfish LB 12022021 11.5 / 28 150.75 00 10 11 11 00 00 10 00 01 XX 10 01 00 10 1= (+11 -16 =1)
11: Fairy SF LB 14.0.1 HCE 11.5 / 28 124.50 00 00 00 10 10 01 00 00 0= 01 XX 11 01 11 11 (+11 -16 =1)
12: Fairy SF 8x8 14 HCE 10.0 / 28 120.75 00 00 00 10 10 11 00 10 00 10 00 XX 10 =1 1= (+9 -17 =2)
13: Stockfish_MV_020717 10.0 / 28 117.00 00 00 01 01 00 00 00 01 10 11 10 01 XX 10 01 (+10 -18 =0)
14: Fairy Stockfish LB 11.2 8.0 / 28 96.00 00 00 00 00 10 00 10 01 1= 01 00 =0 01 XX 10 (+7 -19 =2)
15: Fairy SF LB v14 HCE 6.5 / 28 73.00 00 00 00 00 00 00 00 1= 11 0= 00 0= 10 01 XX (+5 -20 =3)
----------------------------------------------------------------------------------------------------
210 games: +127 -76 =7
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Sun Oct 30, 2022 12:21 pm
Position 5 : 1. e4 e6
Results: Code: Select all
Score (Tie) FS St St St St St St St Fa Fa Fa Fa Fa Fa Fa
----------------------------------------------------------------------------------------------------
1: FSF_14.0.1_NNUEi-avx2 24.5 / 28 314.25 XX 11 01 10 10 11 11 11 11 11 11 11 =1 11 11 (+24 -3 =1)
2: Stockfish_MV_081018 21.0 / 28 265.00 00 XX 11 11 10 11 01 01 11 10 11 10 11 11 11 (+21 -7 =0)
3: Stockfish_MV_130620 19.0 / 28 234.50 10 00 XX 10 01 11 10 10 11 10 11 01 11 11 11 (+19 -9 =0)
4: Stockfish_MV_160221 17.0 / 28 216.50 01 00 01 XX 11 10 01 11 01 01 10 10 11 01 11 (+17 -11 =0)
5: Stockfish_MV_260719 16.0 / 28 205.00 01 01 10 00 XX 10 10 01 01 01 11 11 10 01 11 (+16 -12 =0)
6: Stockfish_MV_210418 15.0 / 28 174.50 00 00 00 01 01 XX 10 10 11 11 01 11 01 11 10 (+15 -13 =0)
7: Stockfish_MV_020717 13.0 / 28 171.50 00 10 01 10 01 01 XX 10 00 10 11 01 01 10 10 (+13 -15 =0)
8: Stockfish MV 310720 13.0 / 28 161.50 00 10 01 00 10 01 01 XX 01 01 10 10 10 01 11 (+13 -15 =0)
9: Fairy SF 8x8 14 HCE 13.0 / 28 145.50 00 00 00 10 10 00 11 10 XX 10 10 10 10 11 11 (+13 -15 =0)
10: Fairy Stockfish 8x8 11.2 12.0 / 28 152.50 00 01 01 10 10 00 01 10 01 XX 00 10 01 01 11 (+12 -16 =0)
11: Fairy Stockfish 8x8 12.02.2021 12.0 / 28 136.00 00 00 00 01 00 10 00 01 01 11 XX 11 11 10 01 (+12 -16 =0)
12: Fairy Stockfish LB 12022021 10.0 / 28 132.50 00 01 10 01 00 00 10 01 01 01 00 XX 10 01 01 (+10 -18 =0)
13: Fairy SF LB v14 HCE 9.5 / 28 119.25 =0 00 00 00 01 10 10 01 01 10 00 01 XX 10 01 (+9 -18 =1)
14: Fairy Stockfish LB 11.2 9.0 / 28 108.50 00 00 00 10 10 00 01 10 00 10 01 10 01 XX 10 (+9 -19 =0)
15: Fairy SF LB 14.0.1 HCE 6.0 / 28 68.50 00 00 00 00 00 01 01 00 00 00 10 10 10 01 XX (+6 -22 =0)
----------------------------------------------------------------------------------------------------
210 games: +163 -46 =1
lkaufman
Posts: 6260Joined: Sun Jan 10, 2010 6:15 amLocation: Maryland USAFull name: Larry Kaufman
Post by lkaufman Mon Oct 31, 2022 3:03 am
Some comments: The top engine wins literally every single game with both colors when the first move is 1.d4, which according to that engine gives "only" an eval of around +0.90 (after either of the two replies tested), but in the three lines starting with 1.e4 it does lose several games, presumably all with Black, since the initial eval for those positions averages around +3 pawns, an overwhelming advantage at top engine level. So for any engine rating lists or tournaments for Crazyhouse, it seems that opening books should just exclude 1.e4 as too easily won for White at top level. But note that in this case a rating list for the two tests with 1.d4 would produce an infinite rating for the top engine! That is really amazing.
Komodo rules!
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Mon Oct 31, 2022 4:48 pm
Yes, e4 gives too much advantage to white. I don't think these engines have been tested against humans. I know there were some matches on Lichess with SF levels and some top zh players.
Carlos777
Posts: 1973Joined: Sun Dec 13, 2009 6:09 pm
Post by Carlos777 Mon Oct 31, 2022 7:06 pm
Position 6 : 1. Nf3 Nf6 2. d4 d5
Results Code: Select all
Score (Tie) FS St St St St St St Fa Fa Fa Fa Fa Fa St Fa
----------------------------------------------------------------------------------------------------
1: FSF_14.0.1_NNUEi-avx2 28.0 / 28 364.00 XX 11 11 11 11 11 11 11 11 11 11 11 11 11 11 (+28 -0 =0)
2: Stockfish_MV_130620 20.5 / 28 238.25 00 XX 00 =0 11 11 11 11 11 10 01 11 11 11 11 (+20 -7 =1)
3: Stockfish_MV_081018 18.5 / 28 226.25 00 11 XX 01 1= 00 01 11 11 01 10 11 01 11 11 (+18 -9 =1)
4: Stockfish_MV_260719 15.5 / 28 190.25 00 =1 10 XX 01 01 01 01 00 01 11 10 01 11 11 (+15 -12 =1)
5: Stockfish_MV_210418 15.5 / 28 174.75 00 00 0= 10 XX 00 11 01 11 11 10 10 10 11 11 (+15 -12 =1)
6: Stockfish_MV_160221 15.0 / 28 180.00 00 00 11 10 11 XX 00 10 00 01 10 11 11 01 11 (+15 -13 =0)
7: Stockfish MV 310720 14.0 / 28 164.00 00 00 10 10 00 11 XX 10 00 11 01 11 01 11 01 (+14 -14 =0)
8: Fairy Stockfish 8x8 11.2 13.0 / 28 149.00 00 00 00 10 10 01 01 XX =1 =0 01 11 11 10 01 (+12 -14 =2)
9: Fairy Stockfish LB 11.2 12.5 / 28 153.00 00 00 00 11 00 11 11 =0 XX 01 01 10 01 10 10 (+12 -15 =1)
10: Fairy SF 8x8 14 HCE 12.5 / 28 152.50 00 01 10 10 00 10 00 =1 10 XX 10 00 11 01 11 (+12 -15 =1)
11: Fairy Stockfish LB 12022021 12.0 / 28 154.50 00 10 01 00 01 01 10 10 10 01 XX 10 10 01 01 (+12 -16 =0)
12: Fairy Stockfish 8x8 12.02.2021 10.0 / 28 110.50 00 00 00 01 01 00 00 00 01 11 01 XX 01 10 11 (+10 -18 =0)
13: Fairy SF LB v14 HCE 9.0 / 28 112.00 00 00 10 10 01 00 10 00 10 00 01 10 XX 01 01 (+9 -19 =0)
14: Stockfish_MV_020717 7.0 / 28 84.00 00 00 00 00 00 10 00 01 01 10 10 01 10 XX 00 (+7 -21 =0)
15: Fairy SF LB 14.0.1 HCE 7.0 / 28 74.50 00 00 00 00 00 00 10 10 01 00 10 00 10 11 XX (+7 -21 =0)
----------------------------------------------------------------------------------------------------
210 games: +117 -89 =4