Trouble with the new Arasan 23.1

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

jdart
Posts: 4408
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Trouble with the new Arasan 23.1

Post by jdart »

RubiChess wrote: Sun Nov 14, 2021 8:35 am Hi Jon.

My tests show that arasan-d9-10-20211029.nnue (23.1) is clearly worse than arasan-d8-9-20210827.nnue (23.0.1).
The speed gain of 23.1 seems to be bigger in the Linux build than in the Windows build so it is eaten up by the bad network in the Windows build but not (completely) in the Linux one.

Regards, Andreas
Yes, in my testing so far the old network + the new code shows some improvement, but not the new network + new code.
User avatar
Werner
Posts: 2995
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: Trouble with the new Arasan 23.1

Post by Werner »

...same here:

Marvin 5.2.0NN x64 1CPU - Arasan 23.0NN x 64 1CPU 30.0 - 70.0 +5/=50/-45 30.00%
Marvin 5.2.0NN x64 1CPU - Arasan 23.1NN x64 1CPU 37.5 - 62.5 +12/=51/-37 37.50%
Werner
User avatar
RubiChess
Posts: 645
Joined: Fri Mar 30, 2018 7:20 am
Full name: Andreas Matthies

Re: Trouble with the new Arasan 23.1

Post by RubiChess »

RubiChess wrote: Sun Nov 14, 2021 8:35 am Hi Jon.

My tests show that arasan-d9-10-20211029.nnue (23.1) is clearly worse than arasan-d8-9-20210827.nnue (23.0.1).
The speed gain of 23.1 seems to be bigger in the Linux build than in the Windows build so it is eaten up by the bad network in the Windows build but not (completely) in the Linux one.

Regards, Andreas
I can confirm what Jon says here forum3/viewtopic.php?f=2&t=76209&start=910#p913626
that the arasan-d9-10-20211029.nnue in the now updated 23.1 windows zip is different from the one that I downloaded 3 weeks ago and that 23.1 with the updated and correct network plays a lot stronger.

Regards.
Guenther
Posts: 4718
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Trouble with the new Arasan 23.1

Post by Guenther »

RubiChess wrote: Thu Dec 02, 2021 6:21 pm
RubiChess wrote: Sun Nov 14, 2021 8:35 am Hi Jon.

My tests show that arasan-d9-10-20211029.nnue (23.1) is clearly worse than arasan-d8-9-20210827.nnue (23.0.1).
The speed gain of 23.1 seems to be bigger in the Linux build than in the Windows build so it is eaten up by the bad network in the Windows build but not (completely) in the Linux one.

Regards, Andreas
I can confirm what Jon says here forum3/viewtopic.php?f=2&t=76209&start=910#p913626
that the arasan-d9-10-20211029.nnue in the now updated 23.1 windows zip is different from the one that I downloaded 3 weeks ago and that 23.1 with the updated and correct network plays a lot stronger.

Regards.
@Jon + Andreas
Thanks for confirming what went wrong with Arasan 23.1!
https://rwbc-chess.de

[Trolls n'existent pas...]