https://github.com/dkappe/leela-chess-w ... t-Networks
Based on my hypothesis on what was the critical element in the success of Antifish, this is 32930 sharpened with CCRL games at a low learning rate and a very few steps. Seems to give around 30 elo extra than the original net. I'll be doing this for a T40 net as well.
32930 Boost network available
Moderators: hgm, Rebel, chrisw
-
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
32930 Boost network available
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 200
- Joined: Fri Oct 12, 2012 12:48 pm
- Location: Seville (SPAIN)
- Full name: Javier Ros
Re: 32930 Boost network available
Very good idea! Thanks for share!
I am testing Lc0 Boost 32930, Lc0_32930 and Lc0_41871, all with 0.21.1, on Rtx2070 against Stockfish dev. i7 4790S 8 cores
I am testing Lc0 Boost 32930, Lc0_32930 and Lc0_41871, all with 0.21.1, on Rtx2070 against Stockfish dev. i7 4790S 8 cores
-
- Posts: 261
- Joined: Sun Nov 13, 2016 10:37 am
Re: 32930 Boost network available
I don't think that this test can talk about anything. Need more games:
5-3 is not 30 Elo. It is unknown.
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%)
1 32930-boost-1000 : 0 30 33.5 60 55.8 77 12 43 5 71.7
2 32930 : -25 49 14.0 30 46.7 78 3 22 5 73.3
3 11258 : -62 50 12.5 30 41.7 --- 2 21 7 70.0
White advantage = 78.53 +/- 24.80
Draw rate (equal opponents) = 82.20 % +/- 7.64
Zevra 2 is my chess engine. Binary, source and description here: https://github.com/sovaz1997/Zevra2
Zevra v2.5 is last version of Zevra: https://github.com/sovaz1997/Zevra2/releases
Zevra v2.5 is last version of Zevra: https://github.com/sovaz1997/Zevra2/releases
-
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: 32930 Boost network available
I applied this to my own 256x20-se net called Maddex and ran 2+2 for 800 games and got +30 elo. Right now I’m running tests for 500 to 4500 step nets. 32930 may need more steps. TBD.
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
-
- Posts: 200
- Joined: Fri Oct 12, 2012 12:48 pm
- Location: Seville (SPAIN)
- Full name: Javier Ros
Re: 32930 Boost network available
Test with Silver suite 50x2 game each match:
Lc0 Boost 32930, Lc0_32930 and Lc0_41871, all with 0.21.1 version, on Rtx2070 against Stockfish dev. i7 4790S at 3.6 MGhz. 8 cores at 5 minutes plus 3 seconds under Fritz gui. First half of the test finished with 150 games played.
Lc0 Boost 32930 scored much better than 32930 and almost as good as 41871.
Lc0_41871SFdev, Blitz 5m+3s-3 2019
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_41871 22.5 - 27.5 +6/=33/-11 45.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1Boost32930 23.0 - 27.0 +6/=34/-10 46.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_32930 26.5 - 23.5 +9/=35/-6 53.00%
Program Elo + - Games Score Av.Op. Draws
1 Lc0 v0.21.1_41871 : 2428 57 55 50 55.0 % 2393 66.0 %
2 Lc0 v0.21.1Boost32930 : 2421 56 54 50 54.0 % 2393 68.0 %
3 Stockfish 090419 64 BMI2 : 2393 31 32 150 48.0 % 2407 68.0 %
4 Lc0 v0.21.1_32930 : 2372 52 54 50 47.0 % 2393 70.0 %
Lc0 Boost 32930, Lc0_32930 and Lc0_41871, all with 0.21.1 version, on Rtx2070 against Stockfish dev. i7 4790S at 3.6 MGhz. 8 cores at 5 minutes plus 3 seconds under Fritz gui. First half of the test finished with 150 games played.
Lc0 Boost 32930 scored much better than 32930 and almost as good as 41871.
Lc0_41871SFdev, Blitz 5m+3s-3 2019
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_41871 22.5 - 27.5 +6/=33/-11 45.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1Boost32930 23.0 - 27.0 +6/=34/-10 46.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_32930 26.5 - 23.5 +9/=35/-6 53.00%
Program Elo + - Games Score Av.Op. Draws
1 Lc0 v0.21.1_41871 : 2428 57 55 50 55.0 % 2393 66.0 %
2 Lc0 v0.21.1Boost32930 : 2421 56 54 50 54.0 % 2393 68.0 %
3 Stockfish 090419 64 BMI2 : 2393 31 32 150 48.0 % 2407 68.0 %
4 Lc0 v0.21.1_32930 : 2372 52 54 50 47.0 % 2393 70.0 %
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: 32930 Boost network available
Would it be possible to distill the latest network to 16x2?
I assume you need an Nvidia GPU for it. (Which I don't have)
I assume you need an Nvidia GPU for it. (Which I don't have)
-
- Posts: 200
- Joined: Fri Oct 12, 2012 12:48 pm
- Location: Seville (SPAIN)
- Full name: Javier Ros
Re: 32930 Boost network available
In the second half of the test, the results wereJavier Ros wrote: ↑Thu Apr 11, 2019 6:33 pm Test with Silver suite 50x2 game each match:
Lc0 Boost 32930, Lc0_32930 and Lc0_41871, all with 0.21.1 version, on Rtx2070 against Stockfish dev. i7 4790S at 3.6 MGhz. 8 cores at 5 minutes plus 3 seconds under Fritz gui. First half of the test finished with 150 games played.
Lc0 Boost 32930 scored much better than 32930 and almost as good as 41871.
Lc0_41871SFdev, Blitz 5m+3s-3 2019
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_41871 22.5 - 27.5 +6/=33/-11 45.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1Boost32930 23.0 - 27.0 +6/=34/-10 46.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_32930 26.5 - 23.5 +9/=35/-6 53.00%
Program Elo + - Games Score Av.Op. Draws
1 Lc0 v0.21.1_41871 : 2428 57 55 50 55.0 % 2393 66.0 %
2 Lc0 v0.21.1Boost32930 : 2421 56 54 50 54.0 % 2393 68.0 %
3 Stockfish 090419 64 BMI2 : 2393 31 32 150 48.0 % 2407 68.0 %
4 Lc0 v0.21.1_32930 : 2372 52 54 50 47.0 % 2393 70.0 %
Lc0_41871SFdev, Blitz 5m+3s 2019
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_41871 24.0 - 26.0 +4/=40/-6 48.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1Boost32930 22.5 - 27.5 +4/=37/-9 45.00%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_32930 25.0 - 25.0 +7/=36/-7 50.00%
so that the total test result is
Lc0_41871SFdev, Blitz 5m+3s-3 2019
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_41871 46.5 - 53.5 +10/=73/-17 46.50%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1Boost32930 45.5 - 54.5 +10/=71/-19 45.50%
Stockfish 090419 64 BMI2 - Lc0 v0.21.1_32930 51.5 - 48.5 +16/=71/-13 51.50%
and Lc0 with 32930 Boost gets the best result!
6 men syzygy tablebases for both.
-
- Posts: 3554
- Joined: Thu Jun 07, 2012 11:02 pm
Re: 32930 Boost network available
Which T40 net do you think you'll choose ?dkappe wrote: ↑Tue Apr 09, 2019 5:02 am https://github.com/dkappe/leela-chess-w ... t-Networks
Based on my hypothesis on what was the critical element in the success of Antifish, this is 32930 sharpened with CCRL games at a low learning rate and a very few steps. Seems to give around 30 elo extra than the original net. I'll be doing this for a T40 net as well.
-
- Posts: 137
- Joined: Sat Dec 04, 2010 5:31 pm
- Location: 223
Re: 32930 Boost network available
The distillation process doesn't work on test 40 and above networks, yet.
Judge without bias, or don't judge at all...
-
- Posts: 1631
- Joined: Tue Aug 21, 2018 7:52 pm
- Full name: Dietrich Kappe
Re: 32930 Boost network available
After some additional testing, the boost net at 7000 steps is about the same head 2 head and vs sf10 at 1+1. The style of play is a bit different, however. Would appreciate feedback. https://github.com/dkappe/leela-chess-w ... t-Networks
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".