Tournament with Honey, Corchess, Bluefish-XI and Crystal

Discussion of computer chess matches and engine tournaments.

Moderators: Harvey Williamson, bob, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Vinvin
Posts: 4766
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Tournament with Honey, Corchess, Bluefish-XI and Crystal

Post by Vinvin » Sat Jun 06, 2020 11:22 pm

2 more engines in the tournament : stockfish_2020_06_0117 and Eman 5.60

Code: Select all

  # PLAYER                              :  RATING  POINTS  PLAYED   (%)
   1 Stockfish_2020_06_0117_x64_modern  :  3371.4   534.5    1000    53
   2 Honey-XI                           :  3359.7  1398.0    2400    58
   3 Stockfish_2020_04_15_x64_modern    :  3357.5  1294.5    2200    59
   4 Eman 5.40 Default                  :  3356.9   610.0    1200    51
   5 Eman 5.60                          :  3356.7   509.5    1000    51
   6 corchess_V6_x64_modern             :  3356.4  1287.0    2200    59
   7 Eman 5.40 FOD=12                   :  3314.4   633.0    1200    53
   8 Bluefish-XI                        :  3303.8  1204.0    2400    50
   9 matefinder_2020_04_15              :  3303.0   789.0    1600    49
  10 Black-Diamond-XI                   :  3286.6   656.0    1400    47
  11 Crystal-2020-04-08-pop             :  3271.8   623.5    1400    45
  12 Houdini-6-modern                   :  3212.2   496.0    1400    35
  13 Bluefish-FD-XI  (Tac=2,Def=N)      :  3049.7   165.0    1000    17

White advantage = 42.24
Draw rate (equal opponents) = 50.00 %

MMarco
Posts: 132
Joined: Sat Apr 11, 2020 11:09 pm
Full name: Marc-O Moisan-Plante

Re: Tournament with Honey, Corchess, Bluefish-XI and Crystal

Post by MMarco » Sun Jun 07, 2020 6:19 am

Vinvin wrote:
Sat Jun 06, 2020 11:22 pm
2 more engines in the tournament : stockfish_2020_06_0117 and Eman 5.60

Code: Select all

  # PLAYER                              :  RATING  POINTS  PLAYED   (%)
   1 Stockfish_2020_06_0117_x64_modern  :  3371.4   534.5    1000    53
   2 Honey-XI                           :  3359.7  1398.0    2400    58
   3 Stockfish_2020_04_15_x64_modern    :  3357.5  1294.5    2200    59
   4 Eman 5.40 Default                  :  3356.9   610.0    1200    51
   5 Eman 5.60                          :  3356.7   509.5    1000    51
   6 corchess_V6_x64_modern             :  3356.4  1287.0    2200    59
   7 Eman 5.40 FOD=12                   :  3314.4   633.0    1200    53
   8 Bluefish-XI                        :  3303.8  1204.0    2400    50
   9 matefinder_2020_04_15              :  3303.0   789.0    1600    49
  10 Black-Diamond-XI                   :  3286.6   656.0    1400    47
  11 Crystal-2020-04-08-pop             :  3271.8   623.5    1400    45
  12 Houdini-6-modern                   :  3212.2   496.0    1400    35
  13 Bluefish-FD-XI  (Tac=2,Def=N)      :  3049.7   165.0    1000    17

White advantage = 42.24
Draw rate (equal opponents) = 50.00 %
How would do vanilla Stockfish 11? Something like 3350?

Xavier Bouchat
Posts: 1
Joined: Tue Aug 01, 2017 8:15 pm
Location: Belgium
Contact:

Re: Tournament with Honey, Corchess, Bluefish-XI and Crystal

Post by Xavier Bouchat » Sun Jun 07, 2020 8:28 am

I don't know how badly this influenced the final result, but it looks like there is a bug in Stockfish's time management when using multiPV. And Bluefish-XI with Tactical = 2 is a hidden MultiPV 4 ...

The variable bestValue contains the score of the last searched PV and shouldn't be used to decide wheter or not the search has to be stopped (code from Honey-XI / Bluefish-XI, the part defined (Stockfish) is still present in current dev Stockfish):

#if defined (Stockfish) || (Weakfish)
double fallingEval = (332 + 6 * (mainThread->previousScore - bestValue)
+ 6 * (mainThread->iterValue[iterIdx] - bestValue)) / 704.0;
#else
double fallingEval = (354 + 10 * (mainThread->previousScore - bestValue)) / 692.0;
#endif
fallingEval = clamp(fallingEval, 0.5, 1.5);


rootMoves[0].score (the score of the best PV line) should be used in place of bestValue.
Only with MultiPV 1 are the 2 variables always equal. With MultiPV > 1, this is only the case when the last searched PV appears to be the best root move or when there are multiple root moves with the same score. In all the other cases the difference will be slight (for example in closed positions) to huge (for example when taking a piece is the only reasonable move).

MMarco
Posts: 132
Joined: Sat Apr 11, 2020 11:09 pm
Full name: Marc-O Moisan-Plante

Re: Tournament with Honey, Corchess, Bluefish-XI and Crystal

Post by MMarco » Sun Jun 07, 2020 1:13 pm

I ran games with Bluefish tactical=2 at 40/2min repeating, and I can confirm it had a very bad time management, keeping often a second or less for the 10 last moves before the time control with an obvious negative impact on the result. I too found it was almost 300 elo weaker than regular Stockfish which was surprisingly low.

User avatar
MikeB
Posts: 4411
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: Tournament with Honey, Corchess, Bluefish-XI and Crystal

Post by MikeB » Sun Jun 07, 2020 1:48 pm

MMarco wrote:
Sun Jun 07, 2020 1:13 pm
I ran games with Bluefish tactical=2 at 40/2min repeating, and I can confirm it had a very bad time management, keeping often a second or less for the 10 last moves before the time control with an obvious negative impact on the result. I too found it was almost 300 elo weaker than regular Stockfish which was surprisingly low.
That's about right - tactical 2 is for analysis only but it's very bad at time management and plays much weaker. Last night I also noticed it breaks "go mate x"
Image

Vinvin
Posts: 4766
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Tournament with Honey, Corchess, Bluefish-XI and Crystal

Post by Vinvin » Tue Sep 22, 2020 11:30 am

Added stockfish_12 who played against 4 opponents : stockfish_20060117, Eman 5.60, corchess_V6 and Bluefish-XI

Code: Select all

   # PLAYER                             :  RATING  POINTS  PLAYED   (%)
   1 stockfish_12_x64_modern            :  3467.9   543.0     800    68
   2 stockfish_20060117_x64_modern      :  3356.9   601.5    1200    50
   3 Honey-XI                           :  3346.8  1398.0    2400    58
   4 Eman 5.60 64-bit POPCNT            :  3346.4   580.5    1200    48
   5 stockfish_2020_04_15_x64_modern    :  3344.7  1294.5    2200    59
   6 Eman 5.40 Default 64-bit POPCNT    :  3344.1   610.0    1200    51
   7 corchess_V6_x64_modern             :  3342.2  1349.5    2400    56
   8 Eman 5.40 FOD=12 64-bit POPCNT     :  3301.4   633.0    1200    53
   9 Bluefish-XI                        :  3291.6  1260.5    2600    48
  10 matefinder_2020_04_15              :  3290.0   789.0    1600    49
  11 Black-Diamond-XI                   :  3273.6   656.0    1400    47
  12 Crystal-2020-04-08-pop             :  3258.8   623.5    1400    45
  13 Houdini-6-modern                   :  3199.1   496.0    1400    35
  14 Bluefish-FD-XI                     :  3036.6   165.0    1000    17

White advantage = 42.61
Draw rate (equal opponents) = 50.00 %

Post Reply