SCCT - Open Source Engine Rating

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

Breaking News!

For more accurate standings,
I plan to repeat Gull 3's games against Top 10 participants

The reasons:
- Gull 3's default hashtable size was higher during up to 400-500 games per player
- Yesterday I noticed also that Gull 3 sometimes is using 6 cores (due to Arena's bug)

I've seen those bugs are only with engines, which have the default MP threads is set 'auto'
And those MP bugs are appearing even when the engine's threads option is set: Threads=1

And for solution: I set 'Threads=1' in the Gull's Command Line Parameters
So I hope the current setting will fix those bugs...
Otherwise I will use Fritz or Shredder GUIs for Gull 3 test

Note also that I don't plan to replay all Gull 3's games, due to:
The standings will be not changed much against the engines, which are 600-800 Elo points weaker...
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

Latest News

Gull 3 test is over, now Gull 3 is approx. 50 Elo behind than Stockfish

After replaying the Gull's games (against the top engines),
The current Gull + Stockfish's Elo difference is almost same as SCCT (3m+2s) MP Rating !!

Note also that after replaying the Gull's games,
The Elo difference is not changed due to Elo error bar margins
Just because, before Gull was played with advantage...

But with equal conditions,
Gull's Elo points are quite correct now !

More Details
* The current rating list has:
- No double games
- No games up to 15 moves
- No games lost on time

In other words,
Now the list is very clean...))!

For Full Standings:
http://www.sedatcanbaz.com/chess/?page_id=522


Have fun,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

New Update

Daydreamer 1.75 x64 is participated, for full standings:
http://www.sedatcanbaz.com/chess/?page_id=522

Note: the current open-source competition is going to be paused...
Due to very soon SCCT Book ChampionShip II will be scheduled !

Greetings,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

Hello there,


This time,
I decided to replay the rest played games by Gull 3 too
Note: before Gull is replayed only against the Top 9 participants

And once more 'd like to mention about the reason:

- Gull 3's default hashtable size was higher during up to 400-500 games per player
- Yesterday I noticed also that Gull 3 sometimes is using 6 cores (due to Arena's bug)


Note also,
Gull's Elo difference between wrong and accurate testing is approx. 70-80 Elo
I mean for before, Gull was rated almost on same level strength as Stockfish

And now, (after the useful recommendations by Anton),
All engines are started to play at full performance under Arena 3 GUI
And of course the current standings are become more accurate...!!))


For Latest Standings:
http://www.sedatcanbaz.com/chess/?page_id=522


Best,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

Last Update:
Delfi 5.1

Note that Delfi 5.1 performed at last place (2625 Elo)
And unfortunately Delfi could not quaify in Top 20

All Versions:
http://www.sedatcanbaz.com/chess/?page_id=711

Top 20:
http://www.sedatcanbaz.com/chess/?page_id=522


Best,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

LAST UPDATE:
Vajolet2 1.45 x64

Well done to Marco Belli, currently Vajolet's rank is 8th place !

TOP 20:
http://www.sedatcanbaz.com/chess/?page_id=522

ALL VERSIONS:
http://www.sedatcanbaz.com/chess/?page_id=711

CONDITIONS:
http://www.sedatcanbaz.com/chess/?page_id=527

GAMES:
http://www.mediafire.com/download/2qju9 ... n_3m2s.rar

NOTE:
This current rating is one of most original rating lists that I have ever seen !


Have a nice weekend,
Sedat
elcabesa
Posts: 858
Joined: Sun May 23, 2010 1:32 pm

Re: SCCT - Open Source Engine Rating

Post by elcabesa »

so finally vajolet doesn't crash anymore!! what a relief
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: SCCT - Open Source Engine Rating

Post by Sedat Canbaz »

elcabesa wrote:so finally vajolet doesn't crash anymore!! what a relief
Indeed...

Congrats...!! finely this latest version seems to be stable on my machines!