Fire 9.2 testing?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

JohnW
Posts: 402
Joined: Thu Nov 22, 2012 12:20 am
Location: New Hampshire

Fire 9.2 testing?

Post by JohnW »

Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.


Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
Damir
Posts: 2885
Joined: Mon Feb 11, 2008 3:53 pm
Location: Denmark
Full name: Damir Desevac

Re: Fire 9.2 testing?

Post by Damir »

You must set file to Fire.bin manually in your engine params.Fire nnue file is not embedded. You must manually set the file up..
JohnW
Posts: 402
Joined: Thu Nov 22, 2012 12:20 am
Location: New Hampshire

Re: Fire 9.2 testing?

Post by JohnW »

Hmm, ok. I read this on the github latest releases page. Thanks for your help

fire-9.2
This is the 15th release of fire-zero...
it includes embedded halfkp_256x2-32-32 nnue net 11122023-145935.bin
~3490 Elo
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Fire 9.2 testing?

Post by kranium »

Damir wrote: Wed Dec 20, 2023 7:45 pm You must set file to Fire.bin manually in your engine params.Fire nnue file is not embedded. You must manually set the file up..
11122023-145935.bin is embedded in all 3 binaries.
There's no need to point to an external NNUE,
it can't even really be done...
there is no UCI option for specifying the NNUE used.
Last edited by kranium on Wed Dec 20, 2023 8:37 pm, edited 1 time in total.
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Fire 9.2 testing?

Post by kranium »

JohnW wrote: Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.


Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
Yes John, it's significantly weaker than version 8 NN releases (80-100 Elo)
8 NN uses an extremely strong SF NNUE created by Sergio Vieri
https://www.chessprogramming.org/Sergio_Vieri
Wolfgang
Posts: 989
Joined: Sat May 13, 2006 1:08 am

Re: Fire 9.2 testing?

Post by Wolfgang »

JohnW wrote: Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.


Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
40/4: https://cegt.forumieren.com/t2036-testing-fire-9-2nn +35 to v9.0

5'+3"Ponder: https://cegt.forumieren.com/t2050-testi ... sions-list
+40 to v9.0
Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Fire 9.2 testing?

Post by kranium »

Wolfgang wrote: Wed Dec 20, 2023 11:35 pm
JohnW wrote: Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2? I may be doing something wrong but it seems weaker than expected, almost like the evaluation file isn't embedded.
It even seems weaker than Fire 8.nn.1.


Fire 9.2 (bugfix)
by Norman Schmidt (Belgium)
https://github.com/FireFather/fire/
40/4: https://cegt.forumieren.com/t2036-testing-fire-9-2nn +35 to v9.0

5'+3"Ponder: https://cegt.forumieren.com/t2050-testi ... sions-list
+40 to v9.0
Very friendly of you..
thanks much Wolfgang
User avatar
Graham Banks
Posts: 44645
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Fire 9.2 testing?

Post by Graham Banks »

JohnW wrote: Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2?
Yes. :)
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 44645
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Fire 9.2 testing?

Post by Graham Banks »

JohnW wrote: Wed Dec 20, 2023 7:10 pm Anyone testing Fire 9.2?
Yes. :)
gbanksnz at gmail.com
Frank Quisinsky
Posts: 7053
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Fire 9.2 testing?

Post by Frank Quisinsky »

90-minutes-games on 4.0 GHz AMD 5950 with 5-pieces.
More can be found in FCP-Tourney-2024 Thread (games and other things around the tourney).

Code: Select all

FCP-Tourney-2024 after round 14
11.480 games


   # Player                          :      Elo  Games  Score%  won  draw  lost  Points  Draw%  Error   OppAvg   OppE   OppD
   1 Stockfish 16 NN                 :  3490.53    560    68.2  205   354     1   382.0   63.2  16.05  3347.58  13.79   40.0
   2 Dragon 3.3 NN (Komodo)          :  3486.82    560    67.8  199   361     0   379.5   64.5  15.98  3347.67  13.79   40.0
   3 Berserk 12 NN                   :  3468.62    560    65.5  181   372     7   367.0   66.4  15.05  3348.13  13.81   40.0
   4 RubiChess 20230918 NN           :  3441.18    560    62.1  141   413     6   347.5   73.8  14.32  3348.81  13.83   40.0
   5 CSTal 2.00 NN                   :  3436.35    560    61.4  139   410    11   344.0   73.2  14.04  3348.93  13.84   40.0
   6 Caissa 1.14.1 NN                :  3434.29    560    61.2  140   405    15   342.5   72.3  13.61  3348.99  13.85   40.0
   7 Igel 3.5.0 NN                   :  3419.99    560    59.3  121   422    17   332.0   75.4  14.03  3349.34  13.84   40.0
   8 rofChade 3.1 NN                 :  3419.31    560    59.2  126   411    23   331.5   73.4  13.63  3349.36  13.85   40.0
   9 Clover 6.1 NN                   :  3416.61    560    58.8  123   413    24   329.5   73.8  13.51  3349.43  13.85   40.0
  10 Revenge 3.0 NN                  :  3415.94    560    58.8  115   428    17   329.0   76.4  13.57  3349.44  13.85   40.0
  11 Uralochka 3.40a NN              :  3415.27    560    58.7  128   401    31   328.5   71.6  13.40  3349.46  13.85   40.0
  12 Obsidian 8.0 NN                 :  3409.22    560    57.9  117   414    29   324.0   73.9  13.34  3349.61  13.85   40.0
  13 Rebel EAS NN                    :  3407.21    560    57.6  112   421    27   322.5   75.2  13.76  3349.66  13.84   40.0
  14 Koivisto 9.2 NN dev (hotfix)    :  3401.20    560    56.8  111   414    35   318.0   73.9  13.17  3349.81  13.86   40.0
  15 Seer 2.7.0 NN                   :  3397.87    560    56.3  104   423    33   315.5   75.5  13.26  3349.90  13.86   40.0
  16 Alexandria 5.1.0 NN             :  3395.88    560    56.1  101   426    33   314.0   76.1  12.74  3349.95  13.87   40.0
  17 Viridithas 11.0.0 NN            :  3395.88    560    56.1  111   406    43   314.0   72.5  12.94  3349.95  13.86   40.0
  18 Arasan 24.0 NN                  :  3380.00    560    53.9   86   432    42   302.0   77.1  13.38  3350.34  13.85   40.0
  19 SlowChess Blitz 2.9 NN          :  3380.00    560    53.9   89   426    45   302.0   76.1  12.69  3350.34  13.87   40.0
  20 Fire 9.2 NN                     :  3357.00    560    50.8   74   421    65   284.5   75.2  13.23  3350.92  13.86   40.0
  21 Minic 3.39 NN                   :  3355.69    560    50.6   71   425    64   283.5   75.9  12.87  3350.95  13.86   40.0
  22 Fritz 19 NN (Gingko)            :  3351.76    560    50.1   74   413    73   280.5   73.8  12.86  3351.05  13.87   40.0
  23 Booot 7.2 NN                    :  3338.64    560    48.3   62   417    81   270.5   74.5  13.22  3351.38  13.86   40.0
  24 Carp 3.0.1 NN                   :  3338.64    560    48.3   54   433    73   270.5   77.3  13.08  3351.38  13.86   40.0
  25 Superultra 1.0 NN               :  3317.58    560    45.4   55   399   106   254.5   71.3  13.26  3351.90  13.86   40.0
  26 Altair 6.0.0 NN                 :  3313.62    560    44.9   41   421    98   251.5   75.2  13.05  3352.00  13.86   40.0
  27 Wasp 6.61 NN dev                :  3307.65    560    44.1   47   400   113   247.0   71.4  13.17  3352.15  13.86   40.0
  28 Black Marlin 8.0 NN             :  3306.99    560    44.0   46   401   113   246.5   71.6  12.87  3352.17  13.87   40.0
  29 Stormphrax 3.0.0 NN             :  3304.99    560    43.8   51   388   121   245.0   69.3  14.00  3352.22  13.84   40.0
  30 Velvet 5.3.0 NN                 :  3303.66    560    43.6   46   396   118   244.0   70.7  12.79  3352.25  13.87   40.0
  31 Akimbo 0.7.0 NN                 :  3281.53    560    40.6   44   367   149   227.5   65.5  13.94  3352.81  13.84   40.0
  32 Texel 1.10 NN                   :  3272.01    560    39.4   32   377   151   220.5   67.3  13.93  3353.04  13.84   40.0
  33 BlackCore 6.0 NN                :  3265.84    560    38.6   42   348   170   216.0   62.1  13.96  3353.20  13.84   40.0
  34 Devre 4.0 NN                    :  3261.01    560    37.9   28   369   163   212.5   65.9  14.38  3353.32  13.83   40.0
  35 Halogen 11.4 NN                 :  3253.37    560    37.0   21   372   167   207.0   66.4  14.84  3353.51  13.82   40.0
  36 Marvin 6.2.0 NN                 :  3249.87    560    36.5   23   363   174   204.5   64.8  14.74  3353.60  13.82   40.0
  37 Pawn 2.0 NN                     :  3249.17    560    36.4   22   364   174   204.0   65.0  14.77  3353.61  13.82   40.0
  38 Nemorino 6.11 NN dev            :  3248.47    560    36.3   24   359   177   203.5   64.1  14.97  3353.63  13.81   40.0
  39 Smallbrain 7.0 NN               :  3247.06    560    36.2   21   363   176   202.5   64.8  14.42  3353.67  13.83   40.0
  40 Chess.cpp 4.0 NN                :  3233.56    560    34.5   26   334   200   193.0   59.6  15.27  3354.00  13.80   40.0
  41 Willow 3.1 NN                   :  3223.43    560    33.2   18   336   206   186.0   60.0  15.35  3354.26  13.80   40.0

White advantage = 61.07 +/- 1.61
Draw rate (equal opponents) = 89.71 % +/- 0.60