Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.
Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
Fire 9.2 testing?
Moderator: Ras
-
- Posts: 2885
- Joined: Mon Feb 11, 2008 3:53 pm
- Location: Denmark
- Full name: Damir Desevac
Re: Fire 9.2 testing?
You must set file to Fire.bin manually in your engine params.Fire nnue file is not embedded. You must manually set the file up..
-
- Posts: 402
- Joined: Thu Nov 22, 2012 12:20 am
- Location: New Hampshire
Re: Fire 9.2 testing?
Hmm, ok. I read this on the github latest releases page. Thanks for your help
fire-9.2
This is the 15th release of fire-zero...
it includes embedded halfkp_256x2-32-32 nnue net 11122023-145935.bin
~3490 Elo
fire-9.2
This is the 15th release of fire-zero...
it includes embedded halfkp_256x2-32-32 nnue net 11122023-145935.bin
~3490 Elo
-
- Posts: 2129
- Joined: Thu May 29, 2008 10:43 am
Re: Fire 9.2 testing?
11122023-145935.bin is embedded in all 3 binaries.
There's no need to point to an external NNUE,
it can't even really be done...
there is no UCI option for specifying the NNUE used.
Last edited by kranium on Wed Dec 20, 2023 8:37 pm, edited 1 time in total.
-
- Posts: 2129
- Joined: Thu May 29, 2008 10:43 am
Re: Fire 9.2 testing?
Yes John, it's significantly weaker than version 8 NN releases (80-100 Elo)JohnW wrote: ↑Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.
Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
8 NN uses an extremely strong SF NNUE created by Sergio Vieri
https://www.chessprogramming.org/Sergio_Vieri
-
- Posts: 989
- Joined: Sat May 13, 2006 1:08 am
Re: Fire 9.2 testing?
40/4: https://cegt.forumieren.com/t2036-testing-fire-9-2nn +35 to v9.0JohnW wrote: ↑Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.
Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
5'+3"Ponder: https://cegt.forumieren.com/t2050-testi ... sions-list
+40 to v9.0
-
- Posts: 2129
- Joined: Thu May 29, 2008 10:43 am
Re: Fire 9.2 testing?
Very friendly of you..Wolfgang wrote: ↑Wed Dec 20, 2023 11:35 pm40/4: https://cegt.forumieren.com/t2036-testing-fire-9-2nn +35 to v9.0JohnW wrote: ↑Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.
Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
5'+3"Ponder: https://cegt.forumieren.com/t2050-testi ... sions-list
+40 to v9.0
thanks much Wolfgang
-
- Posts: 44645
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Fire 9.2 testing?
gbanksnz at gmail.com
-
- Posts: 44645
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Fire 9.2 testing?
gbanksnz at gmail.com
-
- Posts: 7053
- Joined: Wed Nov 18, 2009 7:16 pm
- Location: Gutweiler, Germany
- Full name: Frank Quisinsky
Re: Fire 9.2 testing?
90-minutes-games on 4.0 GHz AMD 5950 with 5-pieces.
More can be found in FCP-Tourney-2024 Thread (games and other things around the tourney).
More can be found in FCP-Tourney-2024 Thread (games and other things around the tourney).
Code: Select all
FCP-Tourney-2024 after round 14
11.480 games
# Player : Elo Games Score% won draw lost Points Draw% Error OppAvg OppE OppD
1 Stockfish 16 NN : 3490.53 560 68.2 205 354 1 382.0 63.2 16.05 3347.58 13.79 40.0
2 Dragon 3.3 NN (Komodo) : 3486.82 560 67.8 199 361 0 379.5 64.5 15.98 3347.67 13.79 40.0
3 Berserk 12 NN : 3468.62 560 65.5 181 372 7 367.0 66.4 15.05 3348.13 13.81 40.0
4 RubiChess 20230918 NN : 3441.18 560 62.1 141 413 6 347.5 73.8 14.32 3348.81 13.83 40.0
5 CSTal 2.00 NN : 3436.35 560 61.4 139 410 11 344.0 73.2 14.04 3348.93 13.84 40.0
6 Caissa 1.14.1 NN : 3434.29 560 61.2 140 405 15 342.5 72.3 13.61 3348.99 13.85 40.0
7 Igel 3.5.0 NN : 3419.99 560 59.3 121 422 17 332.0 75.4 14.03 3349.34 13.84 40.0
8 rofChade 3.1 NN : 3419.31 560 59.2 126 411 23 331.5 73.4 13.63 3349.36 13.85 40.0
9 Clover 6.1 NN : 3416.61 560 58.8 123 413 24 329.5 73.8 13.51 3349.43 13.85 40.0
10 Revenge 3.0 NN : 3415.94 560 58.8 115 428 17 329.0 76.4 13.57 3349.44 13.85 40.0
11 Uralochka 3.40a NN : 3415.27 560 58.7 128 401 31 328.5 71.6 13.40 3349.46 13.85 40.0
12 Obsidian 8.0 NN : 3409.22 560 57.9 117 414 29 324.0 73.9 13.34 3349.61 13.85 40.0
13 Rebel EAS NN : 3407.21 560 57.6 112 421 27 322.5 75.2 13.76 3349.66 13.84 40.0
14 Koivisto 9.2 NN dev (hotfix) : 3401.20 560 56.8 111 414 35 318.0 73.9 13.17 3349.81 13.86 40.0
15 Seer 2.7.0 NN : 3397.87 560 56.3 104 423 33 315.5 75.5 13.26 3349.90 13.86 40.0
16 Alexandria 5.1.0 NN : 3395.88 560 56.1 101 426 33 314.0 76.1 12.74 3349.95 13.87 40.0
17 Viridithas 11.0.0 NN : 3395.88 560 56.1 111 406 43 314.0 72.5 12.94 3349.95 13.86 40.0
18 Arasan 24.0 NN : 3380.00 560 53.9 86 432 42 302.0 77.1 13.38 3350.34 13.85 40.0
19 SlowChess Blitz 2.9 NN : 3380.00 560 53.9 89 426 45 302.0 76.1 12.69 3350.34 13.87 40.0
20 Fire 9.2 NN : 3357.00 560 50.8 74 421 65 284.5 75.2 13.23 3350.92 13.86 40.0
21 Minic 3.39 NN : 3355.69 560 50.6 71 425 64 283.5 75.9 12.87 3350.95 13.86 40.0
22 Fritz 19 NN (Gingko) : 3351.76 560 50.1 74 413 73 280.5 73.8 12.86 3351.05 13.87 40.0
23 Booot 7.2 NN : 3338.64 560 48.3 62 417 81 270.5 74.5 13.22 3351.38 13.86 40.0
24 Carp 3.0.1 NN : 3338.64 560 48.3 54 433 73 270.5 77.3 13.08 3351.38 13.86 40.0
25 Superultra 1.0 NN : 3317.58 560 45.4 55 399 106 254.5 71.3 13.26 3351.90 13.86 40.0
26 Altair 6.0.0 NN : 3313.62 560 44.9 41 421 98 251.5 75.2 13.05 3352.00 13.86 40.0
27 Wasp 6.61 NN dev : 3307.65 560 44.1 47 400 113 247.0 71.4 13.17 3352.15 13.86 40.0
28 Black Marlin 8.0 NN : 3306.99 560 44.0 46 401 113 246.5 71.6 12.87 3352.17 13.87 40.0
29 Stormphrax 3.0.0 NN : 3304.99 560 43.8 51 388 121 245.0 69.3 14.00 3352.22 13.84 40.0
30 Velvet 5.3.0 NN : 3303.66 560 43.6 46 396 118 244.0 70.7 12.79 3352.25 13.87 40.0
31 Akimbo 0.7.0 NN : 3281.53 560 40.6 44 367 149 227.5 65.5 13.94 3352.81 13.84 40.0
32 Texel 1.10 NN : 3272.01 560 39.4 32 377 151 220.5 67.3 13.93 3353.04 13.84 40.0
33 BlackCore 6.0 NN : 3265.84 560 38.6 42 348 170 216.0 62.1 13.96 3353.20 13.84 40.0
34 Devre 4.0 NN : 3261.01 560 37.9 28 369 163 212.5 65.9 14.38 3353.32 13.83 40.0
35 Halogen 11.4 NN : 3253.37 560 37.0 21 372 167 207.0 66.4 14.84 3353.51 13.82 40.0
36 Marvin 6.2.0 NN : 3249.87 560 36.5 23 363 174 204.5 64.8 14.74 3353.60 13.82 40.0
37 Pawn 2.0 NN : 3249.17 560 36.4 22 364 174 204.0 65.0 14.77 3353.61 13.82 40.0
38 Nemorino 6.11 NN dev : 3248.47 560 36.3 24 359 177 203.5 64.1 14.97 3353.63 13.81 40.0
39 Smallbrain 7.0 NN : 3247.06 560 36.2 21 363 176 202.5 64.8 14.42 3353.67 13.83 40.0
40 Chess.cpp 4.0 NN : 3233.56 560 34.5 26 334 200 193.0 59.6 15.27 3354.00 13.80 40.0
41 Willow 3.1 NN : 3223.43 560 33.2 18 336 206 186.0 60.0 15.35 3354.26 13.80 40.0
White advantage = 61.07 +/- 1.61
Draw rate (equal opponents) = 89.71 % +/- 0.60