FCP Tourney-KI started January 02nd, 2022

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

kranium
Posts: 2130
Joined: Thu May 29, 2008 10:43 am

Re: FCP Tourney-KI started January 02nd, 2022

Post by kranium »

connor_mcmonigle wrote: Fri Jun 17, 2022 1:06 am
kranium wrote: Fri Jun 17, 2022 12:53 am
Rebel wrote: Fri Jun 17, 2022 12:49 am Your nn.bin is a perfect match with SF12 nn-82215d0fd0df.nnue

Just type UCI.
If that's the case, I don't understand the 92% instead of 100%

nn.bin was the nnue from an earlier version (Fire 8 NN.1 I think), have you tried raptor.bin from 8.NN.3?
The network is actually an exact match which I didn't realize when I first ran this correlation test. Fire is currently using SF 12's network (raptor.bin == SF 12 network). Those correlations coefficients were computed using low depth search results. Presumably the slight difference originates from the search not being quite identical.

I used this network for Fire: https://github.com/FireFather/fire-NN/b ... raptor.bin
both beserk and stockfish 12 scored 100% when compared to themselves:

corr(berserk, berserk) = 1.0
corr(stockfish_12, stockfish_12) = 0.9999999999999997

corr(fire, stockfish_12) = 0.9273272205303431
8% is significant
There's something amiss, it's clear (according to your own numbers) that raptor.bin and the SF 12 release NNUE are different NNUEs, not that it really matters

I'll retire from this conversation now, it seems to be going nowhere and with no point, except to pollute Franks Tour topic, and to pressure and confuse him.
connor_mcmonigle
Posts: 544
Joined: Sun Sep 06, 2020 4:40 am
Full name: Connor McMonigle

Re: FCP Tourney-KI started January 02nd, 2022

Post by connor_mcmonigle »

kranium wrote: Fri Jun 17, 2022 1:18 am
connor_mcmonigle wrote: Fri Jun 17, 2022 1:06 am
kranium wrote: Fri Jun 17, 2022 12:53 am
Rebel wrote: Fri Jun 17, 2022 12:49 am Your nn.bin is a perfect match with SF12 nn-82215d0fd0df.nnue

Just type UCI.
If that's the case, I don't understand the 92% instead of 100%

nn.bin was the nnue from an earlier version (Fire 8 NN.1 I think), have you tried raptor.bin from 8.NN.3?
The network is actually an exact match which I didn't realize when I first ran this correlation test. Fire is currently using SF 12's network (raptor.bin == SF 12 network). Those correlations coefficients were computed using low depth search results. Presumably the slight difference originates from the search not being quite identical.

I used this network for Fire: https://github.com/FireFather/fire-NN/b ... raptor.bin
both beserk and stockfish 12 scored 100% when compared to themselves:

corr(berserk, berserk) = 1.0
corr(stockfish_12, stockfish_12) = 0.9999999999999997

corr(fire, stockfish_12) = 0.9273272205303431
8% is significant
There's something amiss, it's clear (according to your own numbers) that raptor.bin and the SF 12 release NNUE are different NNUEs, not that it really matters

I'll retire from this conversation now, it seems to be going nowhere and with no point, except to pollute Franks Tour topic, and to pressure and confuse him.
Fire's search differs from SF12 slightly which explains why the correlation coefficient is not 1 despite its using the same network. I'm not sure what exactly you're failing to understand. The search function obviously has some impact on the reported evaluations which perfectly explains the observed results.
connor_mcmonigle
Posts: 544
Joined: Sun Sep 06, 2020 4:40 am
Full name: Connor McMonigle

Re: FCP Tourney-KI started January 02nd, 2022

Post by connor_mcmonigle »

Modern Times wrote: Fri Jun 17, 2022 1:13 am
Rebel wrote: Fri Jun 17, 2022 12:49 am Your nn.bin is a perfect match with SF12 nn-82215d0fd0df.nnue

Just type UCI.
I'm not aware of the full history, so correct me if I'm wrong. The net was developed by Sergio and submitted to the Stockfish project for consideration, and was rejected. It is not exclusive to Stockfish, is not Stockfish property and was not "copied" by Norman. It was some 12+ months later simply picked up "off the shelf" by Norman for use in Fire. Is that all correct ? Is there something illegal or immoral about that ? Just because some authors think that the only acceptable approach is for network to be created from scratch by engine authors does not mean that they should try and impose those views on others.
The network used in Fire is actually the exact same network as used in SF 12. Otherwise, I think you're correct, though it's also important to note that SV didn't develop this network in a vacuum. It was trained using Stockfish data originating from Stockfish's search and evaluation as well as training tools which were all the product of many Stockfish contributors' development efforts.
kranium
Posts: 2130
Joined: Thu May 29, 2008 10:43 am

Re: FCP Tourney-KI started January 02nd, 2022

Post by kranium »

connor_mcmonigle wrote: Fri Jun 17, 2022 1:32 am Fire's search differs from SF12 slightly which explains why the correlation coefficient is not 1 despite its using the same network. I'm not sure what exactly you're failing to understand. The search function obviously has some impact on the reported evaluations which perfectly explains the observed results.
"Fire's search differs from SF12 slightly"
Nope
http://users.telenet.be/chesslogik/images/matrix.jpg
40-43%, as if the 2 engines are completely unrelated (even when using a very similar or identical NNUE).

But go ahead 'spin' it any way you want...
Frank Quisinsky
Posts: 7214
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney-KI started January 02nd, 2022

Post by Frank Quisinsky »

Hi there,

in the meantime ...
50% from run-6 is over ...

Code: Select all

FCP Tourney-KI
run-6 after round 15 out of 30

         Name                       Games     Won     Draw     Lose       Pts         S-B         %

01. Stockfish 020622 NN dev       :   600  :  350+  :  250=  :    0-  :   475.0  : 136482.00  :  79.17%
02. Dragon 3 NN (Komodo)          :   600  :  339+  :  261=  :    0-  :   469.5  : 134961.00  :  78.25%
03. Fire 8 MC.3 NN                :   600  :  253+  :  340=  :    7-  :   423.0  : 120169.00  :  70.50%
04. Koivisto 8.9 NN               :   600  :  256+  :  328=  :   16-  :   420.0  : 118048.25  :  70.00%
05. SlowChess Blitz 2.9 NN        :   600  :  251+  :  331=  :   18-  :   416.5  : 117518.00  :  69.42%
06. Berserk 9 NN dev3             :   600  :  243+  :  340=  :   17-  :   413.0  : 116521.50  :  68.83%
07. Revenge 2.0 NN                :   600  :  228+  :  347=  :   25-  :   401.5  : 112529.00  :  66.92%
08. rofChade 3.0 NN               :   600  :  228+  :  336=  :   36-  :   396.0  : 111238.50  :  66.00%
09. RubiChess 20220223 NN         :   600  :  214+  :  349=  :   37-  :   388.5  : 108207.00  :  64.75%
10. Seer 2.5.0 NN                 :   600  :  205+  :  346=  :   49-  :   378.0  : 105124.50  :  63.00%
11. Arasan 23.3 NN                :   600  :  159+  :  389=  :   52-  :   353.5  :  98878.25  :  58.92%
12. Minic 3.22 NN                 :   600  :  159+  :  378=  :   63-  :   348.0  :  96911.00  :  58.00%
13. Igel 3.1.0 NN                 :   600  :  132+  :  411=  :   57-  :   337.5  :  95258.25  :  56.25%
14. Halogen 10.23 NN dev          :   600  :  144+  :  360=  :   96-  :   324.0  :  88901.25  :  54.00%
15. Ethereal 13.07                :   600  :  127+  :  384=  :   89-  :   319.0  :  88268.00  :  53.17%
16. Nemorino 6.09 NN dev          :   600  :  131+  :  364=  :  105-  :   313.0  :  86356.50  :  52.17%
17. Clover 3.1 NN                 :   600  :  126+  :  373=  :  101-  :   312.5  :  85897.50  :  52.08%
18. Lc0 0.28.2 752187 CPU         :   600  :  122+  :  379=  :   99-  :   311.5  :  87547.00  :  51.92%
19. Wasp 5.54 NN dev              :   600  :  125+  :  363=  :  112-  :   306.5  :  84767.75  :  51.08%
20. Booot 7.0 NN dev              :   600  :  113+  :  385=  :  102-  :   305.5  :  84384.25  :  50.92%
21. Tucano 10.00 NN               :   600  :  103+  :  386=  :  111-  :   296.0  :  81337.50  :  49.33%
22. Rebel 15x2 NN                 :   600  :  107+  :  368=  :  125-  :   291.0  :  80138.25  :  48.50%
23. Uralochka 3.36c NN            :   600  :  102+  :  369=  :  129-  :   286.5  :  79393.50  :  47.75%
24. Fritz 18 NN (Ginkgo)          :   600  :  100+  :  354=  :  146-  :   277.0  :  75410.00  :  46.17%
25. Velvet 3.3.0 NN               :   600  :   84+  :  339=  :  177-  :   253.5  :  68834.00  :  42.25%
26. Zahak 10.0 NN                 :   600  :   79+  :  341=  :  180-  :   249.5  :  67591.25  :  41.58%
27. Xiphos 0.6                    :   600  :   78+  :  335=  :  187-  :   245.5  :  67078.25  :  40.92%
28. Weiss 2.0                     :   600  :   71+  :  333=  :  196-  :   237.5  :  65582.75  :  39.58%
29. Combusken 2.0.0               :   600  :   68+  :  338=  :  194-  :   237.0  :  65054.50  :  39.50%
30. Schooner 2.2 XB               :   600  :   56+  :  342=  :  202-  :   227.0  :  61814.75  :  37.83%
31. Defenchess 2.3 dev            :   600  :   45+  :  352=  :  203-  :   221.0  :  61256.50  :  36.83%
32. Laser 1.7                     :   600  :   57+  :  320=  :  223-  :   217.0  :  58852.00  :  36.17%
33. Hiarcs 15.1                   :   600  :   52+  :  328=  :  220-  :   216.0  :  59309.75  :  36.00%
34. Shredder 13                   :   600  :   60+  :  312=  :  228-  :   216.0  :  58487.50  :  36.00%
35. Bit-Genie 9.19 dev            :   600  :   68+  :  294=  :  238-  :   215.0  :  58717.75  :  35.83%
36. Stash 33.0                    :   600  :   52+  :  318=  :  230-  :   211.0  :  57968.25  :  35.17%
37. DanaSah 9.0 NN                :   600  :   41+  :  336=  :  223-  :   209.0  :  58248.75  :  34.83%
38. Fizbo 2.0                     :   600  :   61+  :  295=  :  244-  :   208.5  :  57156.50  :  34.75%
39. Marvin 5.2.0 NN               :   600  :   49+  :  311=  :  240-  :   204.5  :  55402.00  :  34.08%
40. Chiron 5                      :   600  :   50+  :  295=  :  255-  :   197.5  :  52699.25  :  32.92%
41. Expositor 2WN29 NN            :   600  :   28+  :  288=  :  284-  :   172.0  :  48252.00  :  28.67%
No big surprises in round 15 out of 30!

Code: Select all

FCP Tourney-KI (run-6)
Results round 15 out of 30

                             1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
01. Dragon 3 NN (Komodo)     * ½ ½ 1 ½ ½ 1 ½ 1 1 1 1 ½ 1 ½ ½ 1 ½ 1 1 1 1 1 1 ½ ½ 1 1 ½ 1 1 1 1 1 ½ ½ 1 ½ ½ ½ 1  31.5/40
02. Stockfish 020622 NN dev  ½ * ½ 1 1 1 ½ ½ ½ 1 ½ 1 ½ 1 ½ 1 ½ 1 1 ½ 1 1 1 ½ ½ ½ ½ 1 ½ 1 1 ½ 1 ½ 1 1 1 1 ½ 1 ½  30.5/40
03. Fire 8 MC.3 NN           ½ ½ * ½ ½ ½ ½ ½ 1 1 ½ ½ ½ ½ ½ 1 1 ½ 1 1 1 ½ 1 ½ ½ ½ 1 ½ 1 1 1 1 1 ½ 1 1 1 1 1 1 ½  30.0/40
04. Koivisto 8.9 NN          0 0 ½ * ½ ½ 1 ½ ½ ½ ½ 1 ½ ½ 1 1 ½ 1 1 ½ 1 1 ½ ½ ½ 1 1 1 1 ½ 1 1 ½ 1 ½ 1 ½ 1 1 1 1  29.0/40
05. SlowChess Blitz 2.9 NN   ½ 0 ½ ½ * ½ ½ ½ 1 ½ ½ 1 ½ ½ 1 ½ 1 ½ ½ 1 1 1 ½ ½ ½ ½ 1 1 ½ 1 ½ ½ 1 ½ 1 1 1 ½ ½ 0 1  26.5/40  508.75
06. Revenge 2.0 NN           ½ 0 ½ ½ ½ * ½ ½ ½ ½ ½ 1 ½ ½ ½ ½ ½ ½ 1 ½ 1 1 ½ 1 ½ 1 1 ½ 1 ½ ½ 1 1 ½ 1 1 ½ 1 1 ½ ½  26.5/40  497.00
07. rofChade 3.0 NN          0 ½ ½ 0 ½ ½ * ½ 1 ½ ½ ½ ½ ½ ½ ½ 1 1 ½ ½ 1 ½ 1 1 ½ 1 ½ ½ 1 ½ 1 ½ ½ 1 1 ½ 1 1 1 1 ½  26.5/40  492.00
08. Berserk 9 NN dev3        ½ ½ ½ ½ ½ ½ ½ * ½ ½ ½ 1 ½ 1 1 1 ½ 1 1 ½ ½ 1 1 ½ ½ ½ ½ ½ 1 ½ ½ ½ ½ 1 ½ 1 ½ ½ 1 ½ ½  26.0/40
09. RubiChess 20220223 NN    0 ½ 0 ½ 0 ½ 0 ½ * ½ 1 ½ ½ 1 ½ ½ 1 1 ½ 1 ½ ½ ½ 1 ½ 1 ½ 1 0 ½ 1 ½ ½ 1 1 1 ½ 1 1 1 1  25.5/40  466.25
10. Seer 2.5.0 NN            0 0 0 ½ ½ ½ ½ ½ ½ * ½ ½ 1 ½ ½ ½ ½ 1 ½ ½ ½ ½ ½ 1 ½ 1 1 1 1 ½ 1 1 ½ 1 1 1 ½ ½ ½ 1 1  25.5/40  462.75
11. Arasan 23.3 NN           0 ½ ½ ½ ½ ½ ½ ½ 0 ½ * ½ ½ ½ 1 ½ ½ ½ ½ ½ 0 ½ 1 ½ 1 ½ ½ ½ 1 1 1 ½ ½ 1 ½ ½ 1 1 1 1 1  24.5/40
12. Nemorino 6.09 NN dev     0 0 ½ 0 0 0 ½ 0 ½ ½ ½ * ½ ½ 1 0 0 ½ ½ ½ 1 1 1 1 1 1 ½ ½ ½ 1 ½ 1 1 1 1 1 1 ½ 1 ½ ½  23.5/40
13. Igel 3.1.0 NN            ½ ½ ½ ½ ½ ½ ½ ½ ½ 0 ½ ½ * ½ ½ ½ ½ 1 0 1 ½ ½ 1 ½ 1 ½ 1 0 1 ½ 0 ½ ½ 1 ½ ½ ½ 1 1 1 ½  23.0/40
14. Minic 3.22 NN            0 0 ½ ½ ½ ½ ½ 0 0 ½ ½ ½ ½ * ½ 1 ½ ½ ½ ½ 1 ½ ½ ½ ½ 1 1 1 0 1 ½ 1 ½ ½ ½ 1 ½ ½ 1 ½ 1  22.5/40
15. Halogen 10.23 NN dev     ½ ½ ½ 0 0 ½ ½ 0 ½ ½ 0 0 ½ ½ * ½ ½ ½ 1 ½ ½ ½ ½ ½ 1 1 1 ½ ½ 1 ½ ½ ½ 0 1 1 ½ 1 ½ 1 1  22.0/40  402.50
16. Clover 3.1 NN            ½ 0 0 0 ½ ½ ½ 0 ½ ½ ½ 1 ½ 0 ½ * ½ ½ 0 ½ 1 ½ ½ ½ ½ 1 ½ 1 ½ 1 ½ 1 1 ½ ½ ½ 1 ½ 1 1 ½  22.0/40  398.25
17. Ethereal 13.07           0 ½ 0 ½ 0 ½ 0 ½ 0 ½ ½ 1 ½ ½ ½ ½ * ½ ½ 0 1 ½ ½ ½ ½ ½ ½ ½ 1 ½ 1 ½ 1 1 1 1 ½ 1 ½ 1 ½  22.0/40  396.00
18. Booot 7.0 NN dev         ½ 0 ½ 0 ½ ½ 0 0 0 0 ½ ½ 0 ½ ½ ½ ½ * ½ 1 ½ ½ ½ 0 1 1 1 1 ½ ½ ½ 1 1 ½ 1 1 ½ 1 1 ½ 1  22.0/40  387.25
19. Tucano 10.00 NN          0 0 0 0 ½ 0 ½ 0 ½ ½ ½ ½ 1 ½ 0 1 ½ ½ * ½ ½ 1 ½ ½ ½ ½ 1 1 ½ ½ ½ ½ ½ ½ 1 ½ 1 ½ 1 ½ 1  21.0/40
20. Lc0 0.28.2 752187 CPU    0 ½ 0 ½ 0 ½ ½ ½ 0 ½ ½ ½ 0 ½ ½ ½ 1 0 ½ * 0 ½ ½ ½ 0 ½ 1 1 1 1 1 1 ½ ½ 1 ½ ½ ½ 1 ½ ½  20.5/40
21. Fritz 18 NN (Ginkgo)     0 0 0 0 0 0 0 ½ ½ ½ 1 0 ½ 0 ½ 0 0 ½ ½ 1 * ½ ½ 1 1 ½ ½ ½ ½ 1 1 1 ½ 1 ½ 1 ½ ½ ½ ½ 1  19.5/40
22. Rebel 15x2 NN            0 0 ½ 0 0 0 ½ 0 ½ ½ ½ 0 ½ ½ ½ ½ ½ ½ 0 ½ ½ * ½ ½ 1 1 1 ½ 0 ½ ½ ½ ½ 1 ½ ½ 1 1 ½ ½ 1  19.0/40
23. Wasp 5.54 NN dev         0 0 0 ½ ½ ½ 0 0 ½ ½ 0 0 0 ½ ½ ½ ½ ½ ½ ½ ½ ½ * 1 0 0 1 ½ ½ 1 1 ½ 1 ½ 0 1 1 1 ½ ½ ½  18.5/40
24. Uralochka 3.36c NN       0 ½ ½ ½ ½ 0 0 ½ 0 0 ½ 0 ½ ½ ½ ½ ½ 1 ½ ½ 0 ½ 0 * 1 ½ 0 ½ ½ ½ 1 0 1 ½ 1 ½ 0 ½ 1 ½ ½  17.5/40
25. Stash 33.0               ½ ½ ½ ½ ½ ½ ½ ½ ½ ½ 0 0 0 ½ 0 ½ ½ 0 ½ 1 0 0 1 0 * ½ ½ ½ ½ ½ 0 ½ ½ 0 ½ ½ ½ 1 ½ ½ ½  16.5/40  327.50
26. Marvin 5.2.0 NN          ½ ½ ½ 0 ½ 0 0 ½ 0 0 ½ 0 ½ 0 0 0 ½ 0 ½ ½ ½ 0 1 ½ ½ * 0 ½ ½ ½ 1 ½ ½ ½ 0 ½ 1 ½ 1 1 1  16.5/40  296.25
27. Schooner 2.2 XB          0 ½ 0 0 0 0 ½ ½ ½ 0 ½ ½ 0 0 0 ½ ½ 0 0 0 ½ 0 0 1 ½ 1 * ½ 1 ½ 0 1 ½ ½ 1 ½ 1 ½ 1 1 ½  16.5/40  283.25
28. Weiss 2.0                0 0 ½ 0 0 ½ ½ ½ 0 0 ½ ½ 1 0 ½ 0 ½ 0 0 0 ½ ½ ½ ½ ½ ½ ½ * ½ ½ ½ ½ ½ 1 ½ 0 ½ ½ ½ 1 1  16.0/40
29. Combusken 2.0.0          ½ ½ 0 0 ½ 0 0 0 1 0 0 ½ 0 1 ½ ½ 0 ½ ½ 0 ½ 1 ½ ½ ½ ½ 0 ½ * ½ 1 ½ 0 ½ ½ ½ ½ ½ ½ ½ 0  15.5/40  295.50
30. Xiphos 0.6               0 0 0 ½ 0 ½ ½ ½ ½ ½ 0 0 ½ 0 0 0 ½ ½ ½ 0 0 ½ 0 ½ ½ ½ ½ ½ ½ * ½ ½ 1 ½ ½ 0 1 ½ ½ 1 1  15.5/40  275.25
31. Fizbo 2.0                0 0 0 0 ½ ½ 0 ½ 0 0 0 ½ 1 ½ ½ ½ 0 ½ ½ 0 0 ½ 0 0 1 0 1 ½ 0 ½ * ½ 1 ½ ½ ½ 1 ½ ½ 1 ½  15.5/40  273.25
32. Hiarcs 15.1              0 ½ 0 0 ½ 0 ½ ½ ½ 0 ½ 0 ½ 0 ½ 0 ½ 0 ½ 0 0 ½ ½ 1 ½ ½ 0 ½ ½ ½ ½ * ½ 1 0 ½ ½ ½ ½ ½ 1  15.0/40
33. Bit-Genie 9.19 dev       0 0 0 ½ 0 0 ½ ½ ½ ½ ½ 0 ½ ½ ½ 0 0 0 ½ ½ ½ ½ 0 0 ½ ½ ½ ½ 1 0 0 ½ * 1 ½ 0 ½ ½ 0 1 ½  14.0/40  260.00
34. Laser 1.7                0 ½ ½ 0 ½ ½ 0 0 0 0 0 0 0 ½ 1 ½ 0 ½ ½ ½ 0 0 ½ ½ 1 ½ ½ 0 ½ ½ ½ 0 0 * ½ ½ ½ ½ ½ ½ 1  14.0/40  258.00
35. Zahak 10.0 NN            ½ 0 0 ½ 0 0 0 ½ 0 0 ½ 0 ½ ½ 0 ½ 0 0 0 0 ½ ½ 1 0 ½ 1 0 ½ ½ ½ ½ 1 ½ ½ * ½ ½ ½ ½ ½ ½  14.0/40  250.00
36. Velvet 3.3.0 NN          ½ 0 0 0 0 0 ½ 0 0 0 ½ 0 ½ 0 0 ½ 0 0 ½ ½ 0 ½ 0 ½ ½ ½ ½ 1 ½ 1 ½ ½ 1 ½ ½ * ½ 0 0 ½ 1  13.5/40
37. Defenchess 2.3 dev       0 0 0 ½ 0 ½ 0 ½ ½ ½ 0 0 ½ ½ ½ 0 ½ ½ 0 ½ ½ 0 0 1 ½ 0 0 ½ ½ 0 0 ½ ½ ½ ½ ½ * 1 ½ 0 ½  13.0/40  244.00
38. Chiron 5                 ½ 0 0 0 ½ 0 0 ½ 0 ½ 0 ½ 0 ½ 0 ½ 0 0 ½ ½ ½ 0 0 ½ 0 ½ ½ ½ ½ ½ ½ ½ ½ ½ ½ 1 0 * ½ 1 0  13.0/40  236.00
39. Shredder 13              ½ ½ 0 0 ½ 0 0 0 0 ½ 0 0 0 0 ½ 0 ½ 0 0 0 ½ ½ ½ 0 ½ 0 0 ½ ½ ½ ½ ½ 1 ½ ½ 1 ½ ½ * ½ ½  12.5/40
40. DanaSah 9.0 NN           ½ 0 0 0 1 ½ 0 ½ 0 0 0 ½ 0 ½ 0 0 0 ½ ½ ½ ½ ½ ½ ½ ½ 0 0 0 ½ 0 0 ½ 0 ½ ½ ½ 1 0 ½ * ½  12.0/40  230.00
41. Expositor 2WN29 NN       0 ½ ½ 0 0 ½ ½ ½ 0 0 0 ½ ½ 0 0 ½ ½ 0 0 ½ 0 0 ½ ½ ½ 0 ½ 0 1 0 ½ 0 ½ 0 ½ 0 ½ 1 ½ ½ *  12.0/40  228.75
Best
Frank
Frank Quisinsky
Posts: 7214
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney-KI started January 02nd, 2022

Post by Frank Quisinsky »

Code: Select all

FCP Tourney-KI
run-6 after round 18 out of 30


         Name                       Games     Won     Draw     Lose       Pts         S-B         %

01. Stockfish 020622 NN dev       :   720  :  417+  :  303=  :    0-  :   568.5  : 195974.00  :  78.96%
02. Dragon 3 NN (Komodo)          :   720  :  410+  :  310=  :    0-  :   565.0  : 194850.50  :  78.47%
03. Koivisto 8.9 NN               :   720  :  311+  :  390=  :   19-  :   506.0  : 170913.00  :  70.28%
04. Fire 8 MC.3 NN                :   720  :  299+  :  411=  :   10-  :   504.5  : 171969.50  :  70.07%
05. Berserk 9 NN dev3             :   720  :  299+  :  402=  :   19-  :   500.0  : 168993.00  :  69.44%
06. SlowChess Blitz 2.9 NN        :   720  :  290+  :  405=  :   25-  :   492.5  : 166625.50  :  68.40%
07. Revenge 2.0 NN                :   720  :  268+  :  424=  :   28-  :   480.0  : 161910.50  :  66.67%
08. rofChade 3.0 NN               :   720  :  270+  :  411=  :   39-  :   475.5  : 160520.25  :  66.04%
09. RubiChess 20220223 NN         :   720  :  255+  :  419=  :   46-  :   464.5  : 154915.00  :  64.51%
10. Seer 2.5.0 NN                 :   720  :  249+  :  414=  :   57-  :   456.0  : 152309.00  :  63.33%
11. Arasan 23.3 NN                :   720  :  192+  :  464=  :   64-  :   424.0  : 142500.25  :  58.89%
12. Minic 3.22 NN                 :   720  :  183+  :  456=  :   81-  :   411.0  : 137555.50  :  57.08%
13. Igel 3.1.0 NN                 :   720  :  163+  :  487=  :   70-  :   406.5  : 137064.00  :  56.46%
14. Halogen 10.23 NN dev          :   720  :  164+  :  440=  :  116-  :   384.0  : 126533.50  :  53.33%
15. Nemorino 6.09 NN dev          :   720  :  165+  :  431=  :  124-  :   380.5  : 126398.25  :  52.85%
16. Ethereal 13.07                :   720  :  155+  :  451=  :  114-  :   380.5  : 126383.00  :  52.85%
17. Clover 3.1 NN                 :   720  :  150+  :  447=  :  123-  :   373.5  : 123130.50  :  51.88%
18. Lc0 0.28.2 752187 CPU         :   720  :  142+  :  459=  :  119-  :   371.5  : 125535.50  :  51.60%
19. Booot 7.0 NN dev              :   720  :  141+  :  461=  :  118-  :   371.5  : 123540.50  :  51.60%
20. Wasp 5.54 NN dev              :   720  :  148+  :  435=  :  137-  :   365.5  : 121314.75  :  50.76%
21. Tucano 10.00 NN               :   720  :  130+  :  465=  :  125-  :   362.5  : 120062.50  :  50.35%
22. Rebel 15x2 NN                 :   720  :  134+  :  439=  :  147-  :   353.5  : 116671.50  :  49.10%
23. Uralochka 3.36c NN            :   720  :  126+  :  439=  :  155-  :   345.5  : 114815.25  :  47.99%
24. Fritz 18 NN (Ginkgo)          :   720  :  116+  :  427=  :  177-  :   329.5  : 108034.75  :  45.76%
25. Zahak 10.0 NN                 :   720  :  102+  :  410=  :  208-  :   307.0  : 100343.25  :  42.64%
26. Xiphos 0.6                    :   720  :   98+  :  406=  :  216-  :   301.0  :  98826.00  :  41.81%
27. Velvet 3.3.0 NN               :   720  :   99+  :  404=  :  217-  :   301.0  :  98243.75  :  41.81%
28. Combusken 2.0.0               :   720  :   81+  :  400=  :  239-  :   281.0  :  92077.00  :  39.03%
29. Weiss 2.0                     :   720  :   78+  :  401=  :  241-  :   278.5  :  92245.00  :  38.68%
30. Schooner 2.2 XB               :   720  :   69+  :  416=  :  235-  :   277.0  :  90762.25  :  38.47%
31. Defenchess 2.3 dev            :   720  :   56+  :  416=  :  248-  :   264.0  :  87573.50  :  36.67%
32. Laser 1.7                     :   720  :   68+  :  388=  :  264-  :   262.0  :  85167.25  :  36.39%
33. Hiarcs 15.1                   :   720  :   63+  :  390=  :  267-  :   258.0  :  85186.25  :  35.83%
34. Shredder 13                   :   720  :   67+  :  380=  :  273-  :   257.0  :  83699.00  :  35.69%
35. Bit-Genie 9.19 dev            :   720  :   82+  :  349=  :  289-  :   256.5  :  83863.00  :  35.63%
36. Fizbo 2.0                     :   720  :   70+  :  365=  :  285-  :   252.5  :  83409.00  :  35.07%
37. Stash 33.0                    :   720  :   61+  :  383=  :  276-  :   252.5  :  82962.75  :  35.07%
38. DanaSah 9.0 NN                :   720  :   49+  :  399=  :  272-  :   248.5  :  83011.25  :  34.51%
39. Marvin 5.2.0 NN               :   720  :   57+  :  377=  :  286-  :   245.5  :  80327.25  :  34.10%
40. Chiron 5                      :   720  :   63+  :  354=  :  303-  :   240.0  :  76831.75  :  33.33%
41. Expositor 2WN29 NN            :   720  :   35+  :  342=  :  343-  :   206.0  :  69024.25  :  28.61%
And the ratings after round 18 out of 30 from run-6 can be found under:

After: 108.396 80min games!

https://www.amateurschach.de/t-ki/common/ki-ratings.jpg
https://www.amateurschach.de/t-ki/ratin ... atings.txt

Best
Frank
Frank Quisinsky
Posts: 7214
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney-KI started January 02nd, 2022

Post by Frank Quisinsky »

Hi there,

I got here to many hate mails in the last days.
Should be clear that I have other hobbies as such things.

Please note:
Different parts of my website will be clear / cancel around Jul. 10th, 2022.
Speaking from my engine selection, link selection, FCP Tourney's selection.

FCP Tourney-KI stopped after run-6 in around 6-7 days.
A bit sooner as I like to do at first.

My next FEOBOS project will be not official available!

Of course, information around Wasp you can find on ...
www.amateurschach.de

As reaction to the "TalkChess-Police Academy".
From year to year a bit more "Kindergarten".

Furthermore, if the admins like I can give my password back.
But this one is not very important.

Best
Frank

Again the hint:
If people like to have the final results from my FCP Tourney, please download the files
around Jul. 01st, - 10th, 2022. At the moment round 23 out of 30 is still running.
Frank Quisinsky
Posts: 7214
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney-KI started January 02nd, 2022

Post by Frank Quisinsky »

Code: Select all

FCP Tourney-KI
run-6 after round 23 out of 30


         Name                       Games     Won     Draw     Lose       Pts         S-B         %

01. Stockfish 020622 NN dev       :   920  :  538+  :  382=  :    0-  :   729.0  : 321764.25  :  79.24%
02. Dragon 3 NN (Komodo)          :   920  :  528+  :  391=  :    1-  :   723.5  : 318445.50  :  78.64%
03. Koivisto 8.9 NN               :   920  :  403+  :  492=  :   25-  :   649.0  : 280028.25  :  70.54%
04. Fire 8 MC.3 NN                :   920  :  389+  :  518=  :   13-  :   648.0  : 282275.50  :  70.43%
05. Berserk 9 NN dev3             :   920  :  390+  :  504=  :   26-  :   642.0  : 276723.50  :  69.78%
06. SlowChess Blitz 2.9 NN        :   920  :  375+  :  513=  :   32-  :   631.5  : 272897.50  :  68.64%
07. rofChade 3.0 NN               :   920  :  348+  :  523=  :   49-  :   609.5  : 262240.75  :  66.25%
08. Revenge 2.0 NN                :   920  :  335+  :  545=  :   40-  :   607.5  : 261594.25  :  66.03%
09. RubiChess 20220223 NN         :   920  :  329+  :  536=  :   55-  :   597.0  : 254473.50  :  64.89%
10. Seer 2.5.0 NN                 :   920  :  316+  :  533=  :   71-  :   582.5  : 249095.00  :  63.32%
11. Arasan 23.3 NN                :   920  :  245+  :  590=  :   85-  :   540.0  : 231649.25  :  58.70%
12. Minic 3.22 NN                 :   920  :  235+  :  574=  :  111-  :   522.0  : 222911.75  :  56.74%
13. Igel 3.1.0 NN                 :   920  :  208+  :  619=  :   93-  :   517.5  : 222751.75  :  56.25%
14. Ethereal 13.07                :   920  :  210+  :  567=  :  143-  :   493.5  : 209105.75  :  53.64%
15. Nemorino 6.09 NN dev          :   920  :  217+  :  544=  :  159-  :   489.0  : 207219.25  :  53.15%
16. Halogen 10.23 NN dev          :   920  :  201+  :  567=  :  152-  :   484.5  : 204351.50  :  52.66%
17. Clover 3.1 NN                 :   920  :  197+  :  564=  :  159-  :   479.0  : 200984.00  :  52.07%
18. Lc0 0.28.2 752187 CPU         :   920  :  183+  :  580=  :  157-  :   473.0  : 203341.00  :  51.41%
19. Booot 7.0 NN dev              :   920  :  174+  :  597=  :  149-  :   472.5  : 201132.75  :  51.36%
20. Tucano 10.00 NN               :   920  :  168+  :  588=  :  164-  :   462.0  : 195904.50  :  50.22%
21. Wasp 5.54 NN dev              :   920  :  185+  :  553=  :  182-  :   461.5  : 195579.25  :  50.16%
22. Rebel 15x2 NN                 :   920  :  172+  :  561=  :  187-  :   452.5  : 191319.75  :  49.18%
23. Uralochka 3.36c NN            :   920  :  166+  :  537=  :  217-  :   434.5  : 183864.25  :  47.23%
24. Fritz 18 NN (Ginkgo)          :   920  :  148+  :  547=  :  225-  :   421.5  : 177087.75  :  45.82%
25. Zahak 10.0 NN                 :   920  :  136+  :  520=  :  264-  :   396.0  : 164981.25  :  43.04%
26. Xiphos 0.6                    :   920  :  119+  :  526=  :  275-  :   382.0  : 160131.25  :  41.52%
27. Velvet 3.3.0 NN               :   920  :  128+  :  504=  :  288-  :   380.0  : 158849.50  :  41.30%
28. Combusken 2.0.0               :   920  :   97+  :  524=  :  299-  :   359.0  : 151775.75  :  39.02%
29. Weiss 2.0                     :   920  :  101+  :  513=  :  306-  :   357.5  : 150574.50  :  38.86%
30. Defenchess 2.3 dev            :   920  :   86+  :  509=  :  325-  :   340.5  : 143435.75  :  37.01%
31. Schooner 2.2 XB               :   920  :   76+  :  529=  :  315-  :   340.5  : 143176.25  :  37.01%
32. Bit-Genie 9.19 dev            :   920  :  113+  :  444=  :  363-  :   335.0  : 139646.75  :  36.41%
33. Shredder 13                   :   920  :   91+  :  487=  :  342-  :   334.5  : 139016.75  :  36.36%
34. Laser 1.7                     :   920  :   83+  :  497=  :  340-  :   331.5  : 137852.75  :  36.03%
35. Stash 33.0                    :   920  :   82+  :  489=  :  349-  :   326.5  : 136931.75  :  35.49%
36. Hiarcs 15.1                   :   920  :   75+  :  498=  :  347-  :   324.0  : 137409.00  :  35.22%
37. DanaSah 9.0 NN                :   920  :   64+  :  513=  :  343-  :   320.5  : 136729.50  :  34.84%
38. Fizbo 2.0                     :   920  :   95+  :  449=  :  376-  :   319.5  : 133403.00  :  34.73%
39. Marvin 5.2.0 NN               :   920  :   76+  :  480=  :  364-  :   316.0  : 132018.50  :  34.35%
40. Chiron 5                      :   920  :   86+  :  446=  :  388-  :   309.0  : 126753.75  :  33.59%
41. Expositor 2WN29 NN            :   920  :   47+  :  437=  :  436-  :   265.5  : 113281.00  :  28.86%
Shortly, after 920 out of 1200 per engine, or round 23 out of 30.
Next Update from my ratinglist after 1000 out of 1200 games, or round 25 out of 30 ... tomorrow available.

Hint:
I will try to write a Wasp-News about the still running PiPhisto project.
A fantastic project for engine lovers ... a complete new Mephisto module for UCI engines.
The programmer is working now around 3-4 years on that project and the results are just great.
Yesterday I gave him different older Arena ideas (not inside Arena) from my long list, more as 15 years old.

Later on weekend I will give some information for TalkChess people with pics from a new webclient tool, UCI system "Oscar" and so one. Explosive material for all the trouble-makers and the big group of hobby-lawyers.

:-)

Junge, Junge, Junge ...

Best
Frank
Frank Quisinsky
Posts: 7214
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney-KI started January 02nd, 2022

Post by Frank Quisinsky »

Code: Select all

FCP Tourney-KI
run-6 after round 24 out of 30


         Name                       Games     Won     Draw     Lose       Pts         S-B         %

01. Stockfish 020622 NN dev       :   960  :  562+  :  398=  :    0-  :   761.0  : 350456.75  :  79.27%
02. Dragon 3 NN (Komodo)          :   960  :  550+  :  409=  :    1-  :   754.5  : 346279.50  :  78.59%
03. Koivisto 8.9 NN               :   960  :  422+  :  513=  :   25-  :   678.5  : 305864.25  :  70.68%
04. Fire 8 MC.3 NN                :   960  :  406+  :  539=  :   15-  :   675.5  : 306724.25  :  70.36%
05. Berserk 9 NN dev3             :   960  :  406+  :  526=  :   28-  :   669.0  : 300664.00  :  69.69%
06. SlowChess Blitz 2.9 NN        :   960  :  391+  :  536=  :   33-  :   659.0  : 297358.00  :  68.65%
07. rofChade 3.0 NN               :   960  :  363+  :  547=  :   50-  :   636.5  : 285901.00  :  66.30%
08. Revenge 2.0 NN                :   960  :  347+  :  572=  :   41-  :   633.0  : 284509.75  :  65.94%
09. RubiChess 20220223 NN         :   960  :  340+  :  564=  :   56-  :   622.0  : 276754.75  :  64.79%
10. Seer 2.5.0 NN                 :   960  :  330+  :  556=  :   74-  :   608.0  : 271459.00  :  63.33%
11. Arasan 23.3 NN                :   960  :  260+  :  613=  :   87-  :   566.5  : 253598.75  :  59.01%
12. Minic 3.22 NN                 :   960  :  247+  :  597=  :  116-  :   545.5  : 243003.00  :  56.82%
13. Igel 3.1.0 NN                 :   960  :  219+  :  640=  :  101-  :   539.0  : 241518.00  :  56.15%
14. Ethereal 13.07                :   960  :  219+  :  589=  :  152-  :   513.5  : 226787.75  :  53.49%
15. Nemorino 6.09 NN dev          :   960  :  226+  :  570=  :  164-  :   511.0  : 225916.50  :  53.23%
16. Halogen 10.23 NN dev          :   960  :  209+  :  591=  :  160-  :   504.5  : 222345.00  :  52.55%
17. Clover 3.1 NN                 :   960  :  202+  :  591=  :  167-  :   497.5  : 217841.50  :  51.82%
18. Lc0 0.28.2 752187 CPU         :   960  :  188+  :  610=  :  162-  :   493.0  : 221652.25  :  51.35%
19. Booot 7.0 NN dev              :   960  :  182+  :  620=  :  158-  :   492.0  : 218872.25  :  51.25%
20. Tucano 10.00 NN               :   960  :  180+  :  612=  :  168-  :   486.0  : 215482.75  :  50.63%
21. Wasp 5.54 NN dev              :   960  :  192+  :  577=  :  191-  :   480.5  : 212265.25  :  50.05%
22. Rebel 15x2 NN                 :   960  :  176+  :  587=  :  197-  :   469.5  : 207575.00  :  48.91%
23. Uralochka 3.36c NN            :   960  :  174+  :  557=  :  229-  :   452.5  : 199788.25  :  47.14%
24. Fritz 18 NN (Ginkgo)          :   960  :  153+  :  577=  :  230-  :   441.5  : 193832.00  :  45.99%
25. Zahak 10.0 NN                 :   960  :  142+  :  541=  :  277-  :   412.5  : 179029.25  :  42.97%
26. Xiphos 0.6                    :   960  :  125+  :  550=  :  285-  :   400.0  : 175030.50  :  41.67%
27. Velvet 3.3.0 NN               :   960  :  135+  :  526=  :  299-  :   398.0  : 173695.75  :  41.46%
28. Weiss 2.0                     :   960  :  105+  :  541=  :  314-  :   375.5  : 165364.75  :  39.11%
29. Combusken 2.0.0               :   960  :  100+  :  549=  :  311-  :   374.5  : 165313.00  :  39.01%
30. Schooner 2.2 XB               :   960  :   80+  :  551=  :  329-  :   355.5  : 155978.25  :  37.03%
31. Defenchess 2.3 dev            :   960  :   89+  :  532=  :  339-  :   355.0  : 155983.50  :  36.98%
32. Bit-Genie 9.19 dev            :   960  :  116+  :  470=  :  374-  :   351.0  : 152886.00  :  36.56%
33. Shredder 13                   :   960  :   95+  :  504=  :  361-  :   347.0  : 150042.25  :  36.15%
34. Laser 1.7                     :   960  :   86+  :  514=  :  360-  :   343.0  : 148818.25  :  35.73%
35. Stash 33.0                    :   960  :   86+  :  510=  :  364-  :   341.0  : 148939.50  :  35.52%
36. Hiarcs 15.1                   :   960  :   79+  :  523=  :  358-  :   340.5  : 150607.25  :  35.47%
37. DanaSah 9.0 NN                :   960  :   67+  :  534=  :  359-  :   334.0  : 148236.00  :  34.79%
38. Fizbo 2.0                     :   960  :   97+  :  470=  :  393-  :   332.0  : 145059.00  :  34.58%
39. Marvin 5.2.0 NN               :   960  :   81+  :  498=  :  381-  :   330.0  : 143523.75  :  34.38%
40. Chiron 5                      :   960  :   89+  :  467=  :  404-  :   322.5  : 137982.50  :  33.59%
41. Expositor 2WN29 NN            :   960  :   47+  :  463=  :  450-  :   278.5  : 124510.00  :  29.01%
A lot of interesting constellation ...
rofChade is fighting for place 7
Berserk for place 4
Wasp for place 20

And Expositor for 29% as final result.
Engine is great ... a new engine ... sure ... will go step by step higher!
Stash is also very interesting, from version to version stronger.
It seems the programmer of Stash used itself a perfect rating system to see that.
Slow got an aggressiveness booster in version 2.90 (nice work).
Stockfish 020622 need 0.6% more for place 1 on my list, not right ... Stockfish is on place one ... but a version from 31.12.2021!!
Stockfish 02.06.2022 is fighting ...
Minic on 12 now ... that is indeed very strong and a great work.

All runs normally here ...
The last six rounds are still running ...

Go Critter go ...

Best
Frank
Last edited by Frank Quisinsky on Fri Jun 24, 2022 5:38 pm, edited 1 time in total.
Frank Quisinsky
Posts: 7214
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney-KI started January 02nd, 2022

Post by Frank Quisinsky »

Ah, sorry ... Critter is running on other systems here.
Lost my overview a bit.

Go engines go ... better, no mistake!