SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2943
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Post by pohl4711 »

My UHO-Top15 Ratinglist is the world's first engine-ratinglist, using UHO-openings, and the world's first ratinglist offering additional Gamepair-statistics.

Testruns of Quanticade 260519 and Raphael 4.1.1 finished.

https://www.sp-cc.de

Also take a look at the EAS-Ratinglist, the world's first engine-ratinglist not measuring strength of engines but engines's style of play:
https://www.sp-cc.de/eas-ratinglist.htm

As usual, the most spectacular sac-wins of the latest testrun (won by the tested engine) can be replayed directly on my website. The pgn-viewer (by ChessBase) needs Javascript on and Adblockers off:
https://www.sp-cc.de/view-games-with-sacs.htm

(Perhaps you have to clear your browsercache with <strg>+<shift>+<delete> to reload the graphics/diagrams on my website)
Jouni
Posts: 3907
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Post by Jouni »

I wonder why Berserk 14 test? You have already tested Berserk 250606 a512, which is same engine! Is JA compile faster?
Jouni
vencenda
Posts: 25
Joined: Thu Dec 09, 2021 8:18 pm
Full name: Michael Titherick

Re: SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Post by vencenda »

Thank you for your work. I have a question about the way you decide if a new engine enters the top15 list. Do you have it play against every engine already on the list?

The reason I'm asking is that I noticed in the full list that Quanticade 260519 has played "only" 14000 games (I guess it would be 15000 if Stockfish Dev version was included in the full list). I would expect 16000 games, instead of 15000, because there are 16 engines in the top15 list. Does that mean that Quanticade 260519 didn't play with Pawnocchio 1.9 at all? I was always a bit confused about how that works.
User avatar
pohl4711
Posts: 2943
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Post by pohl4711 »

Jouni wrote: Tue May 26, 2026 9:23 pm I wonder why Berserk 14 test? You have already tested Berserk 250606 a512, which is same engine! Is JA compile faster?
I was not aware, that these 2 are identical? But nonetheless, an official release should be tested anyway.
User avatar
pohl4711
Posts: 2943
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Post by pohl4711 »

vencenda wrote: Wed May 27, 2026 12:43 pm Thank you for your work. I have a question about the way you decide if a new engine enters the top15 list. Do you have it play against every engine already on the list?

The reason I'm asking is that I noticed in the full list that Quanticade 260519 has played "only" 14000 games (I guess it would be 15000 if Stockfish Dev version was included in the full list). I would expect 16000 games, instead of 15000, because there are 16 engines in the top15 list. Does that mean that Quanticade 260519 didn't play with Pawnocchio 1.9 at all? I was always a bit confused about how that works.
Yes, a little bit confusing.
Quanticade played not against Pawnocchio. So, after finishing the testrun, Quanticade has played against the exactly same 15 opponents as pawnocchio did. Then I compared the results and Quanticade was better, so Pawnocchio was kicked out..
And, secondly, all games of engines versus any Stockfish-Dev engine are deleted in the full ratinglist, because otherwise, the full ratinglist would contain hundreds of Stockfish Dev engines, and this would distord the list completely...
So, Quanticade played versus 15 opponents of the UHO-Top15 ratinglist (rank 1 (SF dev) to 15 (Tarnished) and after finishing the testrun, the 1000 games played versus Stockfish Dev werde deleted, before storing the remaining 14000 games in the full ratinglist gamebase.
vencenda
Posts: 25
Joined: Thu Dec 09, 2021 8:18 pm
Full name: Michael Titherick

Re: SPCC: Testruns of Quanticade 260519 and Raphael 4.1.1 finished

Post by vencenda »

pohl4711 wrote: Thu May 28, 2026 6:50 am Yes, a little bit confusing.
Quanticade played not against Pawnocchio. So, after finishing the testrun, Quanticade has played against the exactly same 15 opponents as pawnocchio did. Then I compared the results and Quanticade was better, so Pawnocchio was kicked out..
And, secondly, all games of engines versus any Stockfish-Dev engine are deleted in the full ratinglist, because otherwise, the full ratinglist would contain hundreds of Stockfish Dev engines, and this would distord the list completely...
So, Quanticade played versus 15 opponents of the UHO-Top15 ratinglist (rank 1 (SF dev) to 15 (Tarnished) and after finishing the testrun, the 1000 games played versus Stockfish Dev werde deleted, before storing the remaining 14000 games in the full ratinglist gamebase.
Okay, that all makes sense. Thank you for the detailed explanation!