Kayra Tests

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

mehmet123
Posts: 692
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Kayra Tests

Post by mehmet123 »

Kayra vs Stockfish:

Program Elo + - Games Score Av.Op. Draws

1 Kayra 1.6 bmi2 : 2402 8 7 500 50.5 % 2398 93.8 %
2 Stockfish 170922 x64 bmi2 : 2398 7 8 500 49.5 % 2402 93.8 %

Individual statistics:

1 Kayra 1.6 bmi2 : 2402 500 (+ 18,=469,- 13), 50.5 %

Stockfish 170922 x64 bmi2 : 500 (+ 18,=469,- 13), 50.5 %

2 Stockfish 170922 x64 bmi2 : 2398 500 (+ 13,=469,- 18), 49.5 %

Kayra 1.6 bmi2 : 500 (+ 13,=469,- 18), 49.5 %


Game Conditions: Cutechess Gui, 1 Core , Core-i7 9750h ( 6 cores/ 12 threads), Concurrency: 6, 5 min + 1 sec TC, SuperGM 4 moves Opening Book, 512 Mb Hash, Ponder Off
http://www.mediafire.com/file/qlmzcd1ipqf3ixn/c16.pgn


Kayra 1.6:
forum3/viewtopic.php?f=2&t=79566&start=20
mehmet123
Posts: 692
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Kayra Tests

Post by mehmet123 »

Kayra  vs  Stockish:

   Program                          Elo    +   -   Games   Score   Av.Op.  Draws  

 1 Kayra 1.6 bmi2                 : 2405   35  35   180    51.4 %   2395   51.7 %

 2 Stockfish 170922 x64 bmi2      : 2395  35  35   180    48.6 %   2405   51.7 %


 Individual statistics:
 
1 Kayra 1.6 bmi2            : 2405  180 (+ 46,= 93,- 41), 51.4 %  

Stockfish 170922 x64 bmi2     : 180 (+ 46,= 93,- 41), 51.4 %

 
2 Stockfish 170922 x64 bmi2 : 2395  180 (+ 41,= 93,- 46), 48.6 %  

Kayra 1.6 bmi2                : 180 (+ 41,= 93,- 46), 48.6 %


Game Conditions: Cutechess Gui, 1 Core , Core-i7 9750h (6 cores/ 12 threads), Concurrency:6, 5 min + 1  sec TC, UHO 2022 6mvs +120 +129k Opening Book,  512 Mb Hash, Ponder Off
https://www.mediafire.com/file/6ro7gfhn ... 7.pgn/file



These tests should be considered as fun tests. Because number of games are too low and at this test ı used an unbalanced opening book. At these game conditions (180 games, unbalanced opening book) if there is no significant difference in elo, any Stockfish derivative chess engine can beat each other.
The author of this book is Stefan Pohl. He has been using this opening book with min 3000 games in his tests , so error bar is low in his tests.
mehmet123
Posts: 692
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Kayra Tests

Post by mehmet123 »

Kayra vs Stockfish: (Fischer Random Match)

Program Elo + - Games Score Av.Op. Draws

1 Kayra 1.6 bmi2 : 2403 3 3 20000 50.9 % 2397 62.9 %

2 Stockfish 170922 x64 bmi2 : 2397 3 3 20000 49.1 % 2403 62.9 %


Individual statistics:

1 Kayra 1.6 bmi2 : 2403 20000 (+3882,=12580,-3538), 50.9 %

Stockfish 170922 x64 bmi2 : 20000 (+3882,=12580,-3538), 50.9 %


2 Stockfish 170922 x64 bmi2 : 2397 20000 (+3538,=12580,-3882), 49.1 %

Kayra 1.6 bmi2 : 20000 (+3538,=12580,-3882), 49.1 %


Game Conditions: Cutechess Gui, 1 Core , Core-i7 9750h (6 cores/ 12 threads), 100 kn/ s per move , Chess960 Book 3 Moves Opening Book, 64 Mb Hash, Ponder Off
https://www.mediafire.com/file/lpuz2clv ... 21.7z/file


The result is out of error bars ( + 6 elo, +/- 2.9 ). We see these (nodes / move) matches a lot especially at Lc0 tests but I don't prefer much these matches.
mehmet123
Posts: 692
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Kayra Tests

Post by mehmet123 »

Woblis Rating List:

Rank Name Elo + - games score oppo. draws
1 Kayra 1.5 avx2 3503 12 12 2200 71% 3372 57%
2 Kayra 1.6 avx2 3495 11 11 2500 62% 3422 73%
3 Kayra 1.4 avx2 3490 12 12 1900 64% 3406 70%
4 CorChess 3 171022 3488 16 15 1300 74% 3344 52%
5 Swordfish 15.3a-avx2 3485 21 21 500 51% 3481 90%
6 StockfishMZ 220622 3485 13 12 1500 52% 3477 94%
7 Flaming Titz 230822 AVX2 3484 12 12 1600 52% 3476 87%
8 StockfishMZ 230522 avx2 3482 47 47 100 54% 3465 91%
9 CorChess 3 230422 3481 12 12 1900 63% 3406 73%
10 Blue Marlin 15.3a-avx2 3477 13 13 1500 50% 3476 92%
11 BrainLearn 16 3477 10 10 2500 52% 3470 95%
12 ProteusSF RBE 008a 3475 11 11 2400 61% 3389 76%
13 EMAN 7.93 64-bit AVX2 3475 11 12 1800 51% 3471 97%
14 Stockfish 130322 3474 23 23 400 50% 3474 98%
15 Kayra 1.3 avx2 3474 23 23 400 50% 3474 99%
16 BrainLearn 17 3473 9 9 3300 57% 3433 83%
17 Swordfish 15.1-avx2 3471 11 11 1800 50% 3469 99%
18 EMAN 8.10 64-bit AVX2 3470 9 8 3700 59% 3418 80%
19 Blue Marlin 15.1-avx2 3469 21 21 500 50% 3469 98%
20 Raubfisch X48d2_nn_sl-avx2 3468 9 9 3300 60% 3413 79%
21 EMAN 7.80 64-bit AVX2 3467 14 13 1500 65% 3381 69%
22 Fat Titz 110122 64 AVX2 NUMA 3466 12 12 1800 62% 3397 75%
23 Kayra 1.1 avx2 3465 24 24 400 52% 3456 93%
24 ShashChess 24 3465 13 13 1500 49% 3468 86%
25 Fisherov v0.98c NNUE popcnt 3464 19 19 600 49% 3467 97%
.
.
Amd Ryzen 7 3700X 3600 MHz 32 GB Ram, 4 Cores, 4 min + 2 sec TC , Ponder: Off, Hash 1024MB , Salvo Opening Suite (8moves), KLO-150, KLO-250, TBS: Nalimov, Gaviota, Robbobases, Syzygy
https://www.mediafire.com/folder/6b585g ... /Documents


Kayra 1.6, Kayra 1.5 and Kayra 1.4 chess engines are at the top of the rating list.
mehmet123
Posts: 692
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Kayra Tests

Post by mehmet123 »

Kayra vs Stockish:

Program Elo + - Games Score Av.Op. Draws

1 Kayra 1.7 bmi2 : 2402 6 5 330 50.5 % 2398 97.9 %
2 Stockfish 071122 x64 bmi2 : 2398 5 6 330 49.5 % 2402 97.9 %


Individual statistics:

1 Kayra 1.7 bmi2 : 2402 330 (+ 5,=323,- 2), 50.5 %

Stockfish 071122 x64 bmi2 : 330 (+ 5,=323,- 2), 50.5 %

2 Stockfish 071122 x64 bmi2 : 2398 330 (+ 2,=323,- 5), 49.5 %

Kayra 1.7 bmi2 : 330 (+ 2,=323,- 5), 49.5 %


Game Conditions: Cutechess Gui, 1 Core , Core-i7 9750h (6 cores/ 12 threads), Concurrency:6, 5 min + 1 sec TC, SuperGM 4mvs 500 Opening Book, 512 Mb Hash, Ponder Off
https://www.mediafire.com/file/6oxinu2t ... 2.pgn/file
User avatar
AlexChess
Posts: 1562
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Kayra Tests

Post by AlexChess »

Hi Mehmet!

Kayra 1.7 has been released?

Kind regards, Alex
Chess engines and dedicated chess computers fan since 1981 :D macOS Sequoia 16GB-512GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum
mehmet123
Posts: 692
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: Kayra Tests

Post by mehmet123 »

AlexChess wrote: Wed Nov 09, 2022 6:50 pm Hi Mehmet!
Kayra 1.7 has been released?
Kind regards, Alex
forum3/viewtopic.php?f=2&t=79566&start=20
User avatar
AlexChess
Posts: 1562
Joined: Sat Feb 06, 2021 8:06 am
Full name: Alex Morales

Re: Kayra Tests

Post by AlexChess »

mehmet123 wrote: Wed Nov 09, 2022 7:43 pm
AlexChess wrote: Wed Nov 09, 2022 6:50 pm Hi Mehmet!
Kayra 1.7 has been released?
Kind regards, Alex
forum3/viewtopic.php?f=2&t=79566&start=20
Thank you! Found and already replaced Kayra 1.6 on my gauntlet :)
Chess engines and dedicated chess computers fan since 1981 :D macOS Sequoia 16GB-512GB, Windows 11 & Ubuntu ARM64.
ProteusSF Dev Forum
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Kayra Tests

Post by Eduard »

I see no reason to change the timeman. Unfortunately, my timing got worse with the new setting.

Ryzen 3900X, 20 threads. Slow Mover 85, Move Overhead 250, Minimum Thinking Time 100. Server game on PlayChess 5+0:

Image

My engine had 3 minutes left on move 196 (opponent only 7.7s)!

And here is a picture with old settings, current live from server:

Image

My engine (black) was briefly out of the book on move 13, calculating the next move. The engine took 45s!

I can't say anything about Ponder OFF games and offline, but for online Blitz 5+0 (the most played time control) and Ponder ON games the old setting is better. I won't change that.
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Kayra Tests

Post by Eduard »

Woblis Rating List:

Rank Name Elo + - games score oppo. draws
1 Kayra 1.5 avx2 3503 12 12 2200 71% 3372 57%
2 Kayra 1.6 avx2 3495 11 11 2500 62% 3422 73%
3 Kayra 1.4 avx2 3490 12 12 1900 64% 3406 70%
4 CorChess 3 171022 3488 16 15 1300 74% 3344 52%
5 Swordfish 15.3a-avx2 3485 21 21 500 51% 3481 90%

When I see this, I have to wonder why no one plays Kayra on PlayChess today. Most people use Stockfish dev. :roll:
And these are people who play day and night and know every engine! Another aspect: Engines that can learn, are more popular than other Stockfish clones. I understand that. If you play day and night and many thousands of games, you have a large learning file. Many of the players even use this file as a book. It's difficult to win against such players.