SWCR ended ... final results!

[Vinvin]

Ranking after 20 RR (340 games):

Code: Select all

Pla Name                        Sto  Kom  Gul  Fir  Chi  Han  Pro  Sen  Hia  Shr  Tex  Jun  Spa  Qua  Spi  Zap  Gav  Sma  Punkte
 1  Stockfish 26.03.14 SSE42x64 X    11.5 12.0 12.0 15.0 15.0 15.5 17.5 14.5 16.0 17.0 18.0 15.5 16.5 17.5 17.0 18.0 19.0 267.5 / 340
 2  Komodo TCECr x64            8.5  X    12.0 10.5 15.5 14.5 13.5 15.5 17.0 14.5 17.5 15.0 15.0 17.0 16.0 17.5 18.5 15.5 253.5 / 340
 3  GullChess 2.8 Beta BMI2 x64 8.0  8.0  X    12.0 14.5 12.5 14.5 15.0 14.5 14.0 16.0 14.0 16.0 15.5 14.5 14.5 16.5 17.0 237.0 / 340
 4  Fire 3.0 AVX x64            8.0  9.5  8.0  X    14.0 13.0 11.0 14.0 16.5 15.0 14.5 13.0 16.5 15.5 17.0 15.0 16.5 15.0 232.0 / 340
 5  Chiron 2.0 x64              5.0  4.5  5.5  6.0  X    6.5  11.5 11.5 14.0 15.0 15.5 13.0 14.5 14.5 12.5 12.0 15.0 15.5 192.0 / 340
 6  Hannibal 1.4b x64           5.0  5.5  7.5  7.0  13.5 X    11.5 9.0  9.5  11.0 10.5 12.5 13.5 13.5 15.0 14.5 12.5 17.0 188.5 / 340
 7  Protector 1.5.0 JA x64      4.5  6.5  5.5  9.0  8.5  8.5  X    13.0 8.0  9.0  12.0 11.5 12.0 11.0 14.0 13.0 14.5 16.0 176.5 / 340
 8  Senpai 1.0 SSE42 x64        2.5  4.5  5.0  6.0  8.5  11.0 7.0  X    6.0  9.5  9.0  11.5 12.0 15.0 12.5 11.0 13.5 14.0 158.5 / 340
 9  Hiarcs 14 WCSC w32          5.5  3.0  5.5  3.5  6.0  10.5 12.0 14.0 X    10.0 11.0 10.5 11.5 10.5 9.0  12.5 12.0 10.5 157.5 / 340
 10 Shredder 12 x64             4.0  5.5  6.0  5.0  5.0  9.0  11.0 10.5 10.0 X    8.5  11.5 11.0 13.0 10.5 11.5 10.5 15.0 157.5 / 340
 11 Texel 1.03 x64              3.0  2.5  4.0  5.5  4.5  9.5  8.0  11.0 9.0  11.5 X    10.5 10.5 11.5 11.5 11.5 13.0 8.0  145.0 / 340
 12 Junior 13.8.04 Yokohama x64 2.0  5.0  6.0  7.0  7.0  7.5  8.5  8.5  9.5  8.5  9.5  X    7.0  8.5  9.0  12.5 10.5 12.5 139.0 / 340
 13 Spark 1.0 x64               4.5  5.0  4.0  3.5  5.5  6.5  8.0  8.0  8.5  9.0  9.5  13.0 X    9.0  10.0 7.5  13.0 11.0 135.5 / 340
 14 Quazar 0.4 x64              3.5  3.0  4.5  4.5  5.5  6.5  9.0  5.0  9.5  7.0  8.5  11.5 11.0 X    12.5 12.0 9.5  10.0 133.0 / 340
 15 Spike 1.4 Leiden w32        2.5  4.0  5.5  3.0  7.5  5.0  6.0  7.5  11.0 9.5  8.5  11.0 10.0 7.5  X    9.0  9.5  15.5 132.5 / 340
 16 Zappa Mexico II x64         3.0  2.5  5.5  5.0  8.0  5.5  7.0  9.0  7.5  8.5  8.5  7.5  12.5 8.0  11.0 X    8.0  13.0 130.0 / 340
 17 Gaviota 1.0 AVX x64         2.0  1.5  3.5  3.5  5.0  7.5  5.5  6.5  8.0  9.5  7.0  9.5  7.0  10.5 10.5 12.0 X    12.0 121.0 / 340
 18 SmarThink 1.50 SSE3 x64     1.0  4.5  3.0  5.0  4.5  3.0  4.0  6.0  9.5  5.0  12.0 7.5  9.0  10.0 4.5  7.0  8.0  X    103.5 / 340

[elcabesa]

I have just found today this thread.
I hope you'll found interesting vajolet and you'll add to your tournament.

[Vinvin]

Around half of the games played :

Code: Select all

    Name                                    Pts          %
 1  Stockfish 26.03.14 SSE42 x64          336.5 / 425  79.18%
 2  Komodo TCECr x64                      321.5 / 424  75.83%
 3  GullChess 2.8 Beta BMI2 x64           294.5 / 425  69.29%
 4  Fire 3.0 AVX x64                      284.0 / 425  66.82%
 5  Chiron 2.0 x64                        241.0 / 425  56.71%
 6  Hannibal 1.4b x64                     237.0 / 424  55.90%
 7  Protector 1.5.0 JA x64                219.0 / 425  51.53%
 8  Senpai 1.0 SSE42 x64                  203.5 / 424  48.00%
 9  Hiarcs 14 WCSC w32                    200.0 / 424  47.17%
 10 Shredder 12 x64                       194.0 / 424  45.75%
 11 Texel 1.03 x64                        181.0 / 425  42.59%
 12 Junior 13.8.04 Yokohama x64           172.0 / 424  40.57%
 13 Quazar 0.4 x64                        169.5 / 425  39.88%
 14 Spike 1.4 Leiden w32                  168.0 / 425  39.53%
 15 Zappa Mexico II x64                   165.5 / 425  38.94%
 16 Spark 1.0 x64                         162.5 / 424  38.33%
 17 Gaviota 1.0 AVX x64                   142.5 / 425  33.53%
 18 SmarThink 1.50 SSE3 x64               129.0 / 424  30.42%

Some analyze by group :
Stockfish and Komodo (~77%) : the clear top, may be latest version of Komodo on longer time control could join Stockfish ...
Gull and Fire (~68%) : recent, very strong and in progress, a new version of Gull is available now (3.0).
Chiron and Hannibal (~55%) : recent and in progress, a new beta version of Hannibal (1.5) already play for Graham.
Protector (~51.5%) : a new version (1.6.0) is available, it will probably join the Chiron and Hannibal.
Senpai, Hiarcs and Shredder (~ 47%) : the new Senpai at the same level as the 2 good old non-bitboard engines.
Texel (~42.5%): version 1.04 is out now, an engine in full progress too.
Junior, Quazar, Spike, Zappa Mexico II, Spark (~39%)
Gaviota and SmarThink finish the ranking.

Frank, is it possible to update Gull, Protector (and may be Texel and Hannibal) for the 2nd half of the tournament ?

Thanks,
Vincent

[Frank Quisinsky]

Hi Vincent,

only one month and the tournament is ready. After this one 3 newer engines will be add at first. Than the updates of the participant engines ...

1. NirvanaChess 1.6
2. Vajolet
3. ?

= 21 engines
= 1.000 games for each engine

3. GullChess 3.0
4. Protector 1.6.0
5. Texel if available
6. Hannibal if available
7. newer Stockfish Version ...

I belive it Need 3-4 months if I am up to date. I try with FCT1 a new Rating list too ... in this case it is better to wait of the final results with the still running engine versions.

That is my idea ...
If I changed during the still running tourney, it need to many time. I updated my site with the results after 50% of the tourney soon.

Thanks for your interest.
Hope it's OK for you.

Best
Frank

[Frank Quisinsky]

Hi Marco,

your engine should be around the level Smarthink have with around 2.700 Elo if Shredder is playing with 2.800 Elo.

Important for myself is, that the engines runs without any technical problems. I have different problems with Minko Chess (mate distance), Booot (lost too many games after the opening book moves) or DiscoCheck (mate distance). The reason this engines will not tested in FCT1.

I think most of the programmers are playing with resign = on and don't see the problems engines have before mate. A good other example is Hannibal with ponder = on. Also problems with lost on time games, means with mate distance before the game ended (not with ponder = off).

Furthermore, I will not add engine with used the most of the code from others. I don't know your engine and downloaded the latest version for minutes. If all is clear after the tournament in around 3-4 weeks, of course I can added your engine too.

Again:
No Houdini (bsased on Robbo), no Critter, no private engines ... I will have a clear list of AVAILABE engines with different playing styles and a list of engines runs without any problems. Sjeng and Naum are not longer avaialbe and can't particpant in my tourney. Visitors of my sites should see a list of available engines without clones.

At the moemnt the 18 engines I added works fine.

But for the moment the Basic tourney with 18 engines should be ready. After this one I can start with new engines and updates of newer versions.

Best
Frank

[Vinvin]

Hi Vincent,

only one month and the tournament is ready. After this one 3 newer engines will be add at first. Than the updates of the participant engines ...

1. NirvanaChess 1.6
2. Vajolet
3. ?

= 21 engines
= 1.000 games for each engine

3. GullChess 3.0
4. Protector 1.6.0
5. Texel if available
6. Hannibal if available
7. newer Stockfish Version ...

I belive it Need 3-4 months if I am up to date. I try with FCT1 a new Rating list too ... in this case it is better to wait of the final results with the still running engine versions.

That is my idea ...
If I changed during the still running tourney, it need to many time. I updated my site with the results after 50% of the tourney soon.

Thanks for your interest.
Hope it's OK for you.

Best
Frank

OK I understand your point. This tournament is already very good !
I read there will be a new Komodo too.
What about Equinox 3 ?

Thanks !

[Frank Quisinsky]

Hi Vincent,

too many eMails from others if I added private engines.

- no private engines
- no clones
- no engines with have technical problems.
- only available engine, no Naum / Sjeng

Unclear are Winboard engines.
Deuterium is too interesting if I see what the programmer do here. Same for ExChess, Crafty, Scorpio. But also WB engines should have around 2.700 Elo before I add it in the tourney.

NirvanaChess is a candidat and perhaps Vajolet.
Deuterium for sure but this engine Need around 30-40 Elo more

Equinox is a private engine and for me is unlcear "Ipp nor not". If Equinox not based on IPP and is for all available ... in this case for sure a candidat. I hope of Jonny. An really great engine, tested in SWCR2 ... but unfortunatley, is private available only!

Best
Frank

In my opinion a good rating list should test available engines only. Should test no clones because we must give this group of engines not a higher publicity. Enough very interesting own developments are available for all. In my main interest with FCT1 is go give this group of clear developments in the future the Publicity on my own site. I have here a lot of ideas to made a rating list or the tourney interesting. But at first I Need the Basic tourney

[Frank Quisinsky]

Hi there,

Table 1: After 459 of 850 games
40 moves in 10 minutes, ponder = off

Table 2: After 850 of 850 games
40 moves in 5 minutes, ponder = on

Table 3: After 221 of 850 games
40 moves in 10 minutes, ponder = off

You can see that 18 different engines can produce after view games an really great rating list. Only bigger different for GullChess with ponder = off (-30 to GullChess with ponder = off). Never see that in other Ratings, so I think that GullChess had a bad start with the first 459 games.

All is very clear because we know from other compares in the past that the different between ponder = on / off is very small. We can see too, that we don't Need so many games for a good rating. More important are clear conditions, different engines and not to many Versions of the same engine in one list.

You can download the first 4.192 games on my page.

Frank's Chess Page:
http://www.amateurschach.de

Code: Select all

FCT1, ponder = off, 40 moves in 10 minutes on i7 4.3GHz
Elo average = 2.845

01. Stockfish 26.03.14 SSE42 x64  : 3059  27 26  459  78.9%  2830  35.3%  - 8
02. Komodo TCECr x64              : 3030  27 26  459  75.8%  2832  35.7%  - 7
03. GullChess 2.8 Beta BMI2 x64   : 2980  24 24  459  69.8%  2835  42.9%  -30
04. Fire 3.0 AVX x64              : 2960  24 24  459  67.1%  2836  43.6%  - 5
05. Chiron 2.0 x64                : 2890  25 24  459  57.2%  2840  41.2%  + 5
06. Hannibal 1.4b x64             : 2882  24 24  459  56.0%  2840  43.6%  +14
07. Protector 1.5.0 JA x64        : 2858  23 23  459  52.3%  2842  45.8%  + 8
08. Senpai 1.0 SSE42 x64          : 2830  24 24  459  48.0%  2844  42.0%  + 2
09. Hiarcs 14 WCSC w32            : 2825  24 24  459  47.3%  2844  44.4%    0
10. Shredder 12 x64               : 2810  24 24  459  45.0%  2845  45.1%  +10
11. Texel 1.03 x64                : 2795  24 24  459  42.8%  2846  41.6%  + 4
12. Junior 13.8.04 Yokohama x64   : 2778  25 25  459  40.3%  2847  40.1%  -10
13. Quazar 0.4 x64                : 2778  25 25  459  40.2%  2847  39.0%  +15
14. Spike 1.4 Leiden w32          : 2772  25 25  459  39.3%  2847  39.4%  - 4
15. Spark 1.0 x64                 : 2765  25 26  459  38.3%  2847  37.0%  +11
16. Zappa Mexico II x64           : 2763  24 24  459  38.0%  2848  42.5%  +13
17. Gaviota 1.0 AVX x64           : 2731  26 26  459  33.7%  2849  34.6%  + 7
18. SmarThink 1.50 SSE3 x64       : 2703  27 27  459  30.0%  2851  33.8%  - 3

Games       : 4131 (finished), move average = 88
White Wins  : 1475 (35.7%)
Black Wins  :  986 (23.9%)
Draws       : 1670 (40.4%)
Unfinished  :    0
White Perf. : 55.9%
Black Perf. : 44.1%
ECO A       :  941 Games (22.8%)
ECO B       :  952 Games (23.0%)
ECO C       :  860 Games (20.8%)
ECO D       :  843 Games (20.4%)
ECO E       :  535 Games (13.0%)

----------------------------------------------------------------------------

SWCR2, ponder = on, 40 moves in 5 minutes on i7 4.3GHz
Elo average = 2.845

Hint:
Different Stockfish versions only but Elo should be around the same.

01. Stockfish 08.02.14 SSE42 x64  : 3067  20 20  850  79.8%  2829  34.4%
02. Komodo TCECr x64              : 3037  21 20  850  76.6%  2831  32.6%
03. GullChess 2.8 Beta BMI2 x64   : 3010  20 19  850  73.6%  2832  35.9%
04. Fire 3.0 AVX x64              : 2965  19 19  850  67.9%  2835  37.1%
05. Chiron 2.0 x64                : 2901  18 18  850  58.8%  2839  40.7%
06. Hannibal 1.4b x64             : 2868  18 18  850  53.9%  2841  42.0%
07. Protector 1.5.0 JA x64        : 2850  18 18  850  51.2%  2842  42.7%
08. Senpai 1.0 SSE42 x64          : 2828  18 18  850  47.8%  2843  39.5%
09. Hiarcs 14 WCSC w32            : 2825  19 19  850  47.4%  2843  37.4%
10. Shredder 12 x64               : 2800  18 18  850  43.6%  2845  40.7%
11. Texel 1.03 x64                : 2791  18 18  850  42.3%  2845  40.4%
12. Junior 13.8.04 Yokohama x64   : 2788  19 19  850  41.8%  2845  34.1%
13. Spike 1.4 Leiden w32          : 2776  18 18  850  40.1%  2846  39.2%
14. Quazar 0.4 x64                : 2763  19 19  850  38.1%  2847  36.9%
15. Spark 1.0 x64                 : 2754  18 18  850  36.9%  2847  39.6%
16. Zappa Mexico II x64           : 2750  18 18  850  36.2%  2848  40.9%
17. Gaviota 1.0 AVX x64           : 2730  19 19  850  33.5%  2849  35.1%
18. SmarThink 1.50 SSE3 x64       : 2706  19 19  850  30.4%  2850  35.3%

Games       : 7650 (finished), move average = 88
White Wins  : 2715 (35.5%)
Black Wins  : 2026 (26.5%)
Draws       : 2909 (38.0%)
Unfinished  :    0
White Perf. : 54.5%
Black Perf. : 45.5%
ECO A       : 1653 Games (21.6%)
ECO B       : 1985 Games (25.9%)
ECO C       : 1382 Games (18.1%)
ECO D       : 1582 Games (20.7%)
ECO E       : 1010 Games (13.2%)

-----------------------------------------------------------------------------

01. Stockfish 26.03.14 SSE42 x64  : 3047  38 36  221  77.6%  2831  38.5%  -20
02. Komodo TCECr x64              : 3014  38 37  221  74.0%  2833  38.5%  -23
03. GullChess 2.8 Beta BMI2 x64   : 2981  37 36  221  69.9%  2835  40.3%  -29
04. Fire 3.0 AVX x64              : 2971  35 34  221  68.6%  2835  43.9%  + 7
05. Chiron 2.0 x64                : 2885  35 35  221  56.3%  2841  42.1%  -16
06. Hannibal 1.4b x64             : 2882  35 34  221  55.9%  2841  43.9%  +14
07. Protector 1.5.0 JA x64        : 2861  33 33  221  52.7%  2842  47.5%  +11
08. Shredder 12 x64               : 2831  34 34  221  48.2%  2844  45.7%  +31
09. Senpai 1.0 SSE42 x64          : 2816  36 36  221  45.9%  2845  39.4%  -12
10. Hiarcs 14 WCSC w32            : 2815  35 35  221  45.7%  2845  43.4%  -10
11. Junior 13.8.04 Yokohama x64   : 2786  37 37  221  41.4%  2846  36.7%  - 2
12. Texel 1.03 x64                : 2781  36 36  221  40.7%  2847  38.9%  -10
13. Spike 1.4 Leiden w32          : 2777  37 37  221  40.0%  2847  36.7%  + 1
13. Spark 1.0 x64                 : 2777  36 36  221  40.0%  2847  38.5%  +23
15. Zappa Mexico II x64           : 2761  34 34  221  37.8%  2848  44.8%  +11
15. Quazar 0.4 x64                : 2761  36 36  221  37.8%  2848  39.4%  - 2
17. Gaviota 1.0 AVX x64           : 2750  37 37  221  36.2%  2848  38.0%  +20
18. SmarThink 1.50 SSE3 x64       : 2713  39 39  221  31.2%  2851  32.6%  + 7

[elcabesa]

up to now I haven't seen crash from vajolet2.
regarding code originality I'll leave to you to decide the fate of vajolet.

I can assure that I have written everything with my hands and that a lot of swat and effort have been spent to write it. I can also assure that Vajolet is GPL code and that I had looked and copied lots of idea from other GPL licensed engines.

as previously salid I hope you'll find it interesting

[Frank Quisinsky]

Hi Marco,

in this case engine 20 I have ...
Nirvanachess = engine 19.
I Need 21 for my list.

My tourney is still running up to end of May. NirvanaChess and your engine are the first updates I have to add.

Thanks for your message!

Best
Frank