Discussion of anything and everything relating to chess playing software and machines.
Moderators: hgm , Dann Corbit , Harvey Williamson
MMarco
Posts: 195 Joined: Sun Apr 12, 2020 1:09 am
Full name: Marc-O Moisan-Plante
Post
by MMarco » Sat Jul 25, 2020 1:27 pm
Rebel wrote: ↑ Sat Jul 25, 2020 11:56 am
MMarco wrote: ↑ Fri Jul 24, 2020 3:41 pm
Can someone with good hardware test this one?
Size=256. By ribbit on discord.
"My first little 256 network.. I tested it on Honey-XI-NN with pretty good result against stockfish-dev and Leela ... (d24 validation used, 6menTB)
ribbit_0.1 -
https://rapidu.net/9571752717/nn.bin "
This ribbit net is the same net as the much discussed 1134.
Nice catch!
Sorry for everyone. I took this on the Discord channel and I didn't verify anything (nor I didn't have the time to test 1134 yet).
Werner
Posts: 2864 Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle
Post
by Werner » Sat Jul 25, 2020 1:28 pm
Thanks Ed,
I downloaded and compared it.
I made a message on discord too - hopefully will be deleted soon.
Werner
MikeB
Posts: 4889 Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania
Post
by MikeB » Sat Jul 25, 2020 2:44 pm
JohnS wrote: ↑ Sat Jul 25, 2020 10:06 am
Another quick test of 2344 against H6.03 using Nunn1 openings, G10s+0.2s - result +11 =8 -1.
Here is a crazy sacrifice by SFnnue on move 13. Of course - usual disclaimers and as Mike would say yomv and ymmv.
[pgn][Event "SF-NNUE - Houdini 6.03, Nunn1, G10s + 0.2s"]
[Site "Home"]
[Date "2020.07.25"]
[Round "1"]
[White "Stockfish+NNUE"]
[Black "Houdini 6.03"]
[Result "1-0"]
[TimeControl "10+0.2"]
[Time "17:49:43"]
[Board "9"]
[Termination "adjudication by engines' scores"]
[ECO "D11"]
[Opening "QGD Slav"]
1. d4 d5 2. c4 c6
3. Nf3 {D11: QGD Slav, 3.Nf3} e6 4. cxd5 exd5
5. Nc3 Nf6 6. Bg5 Be7
7. Qc2 Nbd7 8. e3 O-O
9. Bd3 Re8 10. O-O Nf8 {End of opening}
11. h3 {+0.55/21 1.7 1825739} Ne4 {-0.29/16 0.8 1659811} 12. Bf4 {+0.57/15 0.3 340609} f5 {-0.29/15 0.5 1077857}
13. Nxd5 {+2.78/17 0.3 365358} cxd5 {+2.19/14 0.2 541228} 14. Bc7 {-2.63/19 0.6 586658} Qd7 {+2.19/15 0.4 804820}
15. Rfc1 {-2.40/18 0.3 305302} a6 {+2.04/17 1.1 2499173} 16. Qb3 {-2.44/19 0.4 428054} Qe6 {+1.94/17 0.5 1132772}
17. Rc2 {-2.32/17 0.3 291583} b5 {+1.87/18 1.0 2388891} 18. Ne5 {-1.83/17 0.6 596654} Bb7 {+1.99/15 0.3 587827}
19. a4 {-1.68/21 1.1 1189223} b4 {+1.31/16 1.0 2281160} 20. f3 {-1.84/19 0.4 414811} Ng3 {+1.69/15 0.2 526878}
21. Rac1 {-0.68/17 0.4 413539} Qh6 {+0.89/17 1.9 4376992} 22. f4 {+0.00/20 0.2 258037} Ne6 {+0.78/17 0.8 1960946}
23. Rc6 {+0.00/20 0.4 479539} Rec8 {+0.49/17 0.9 2314155} 24. Rb6 {+0.00/20 0.3 363630} Ra7 {+1.47/12 0.2 418161}
25. Kh2 {+0.00/21 0.3 296852} Ne4 {-0.22/17 0.7 1695180} 26. Bxe4 {+1.25/19 0.3 307773} fxe4 {-0.22/16 0.0 637}
27. Qd1 {+1.91/23 1.9 2128183} Re8 {-0.73/19 1.1 2793150} 28. a5 {+3.28/17 0.2 208229} Qf6 {-1.09/18 0.9 2123492}
29. Qa4 {+3.83/21 0.3 350003} Rea8 {-1.21/19 0.4 1173762} 30. f5 {+3.02/23 0.8 895388} Qxf5 {-1.21/18 0.0 2235}
31. Qd7 {+4.07/19 0.2 282314} Bf8 {-1.31/19 0.4 974990} 32. Qxe6+ {+3.94/21 0.5 615758} Qxe6 {-1.20/18 0.3 819661}
33. Rxe6 {+4.06/21 0.3 422568} Rc8 {-1.35/19 0.3 1033236} 34. Kg3 {+4.81/19 0.3 344820} g6 {-1.55/17 0.6 1706853}
35. Rf1 {+4.70/17 0.3 399405} Ba8 {-2.14/17 0.4 952201} 36. Bd6 {+5.59/18 0.3 380173} Bg7 {-2.34/15 0.2 546724}
37. Kh4 {+6.52/17 0.2 270354} Kh8 {-2.27/14 0.2 544657} 38. Kg5 {+7.02/18 0.3 316968} Kg8 {-2.03/14 0.1 320824}
39. g4 {+7.70/18 0.3 413143} b3 {-2.38/15 0.3 742604} 40. h4 {+8.11/19 0.4 558349} Bh8 {-2.84/15 0.2 553155}
41. h5 {+8.56/18 0.3 419325} gxh5 {-2.91/17 0.2 474664} 42. gxh5 {+8.93/18 0.3 455113} Rd8 {-3.47/13 0.2 646262}
43. Ng4 {+9.46/18 0.4 506316} Bg7 {-6.58/15 0.2 586254} 44. Nh6+ {+9.53/16 0.1 155076} Bxh6+ {-6.46/18 0.2 615138}
45. Kxh6 {+11.84/19 0.2 245093} Rad7 {-5.65/16 0.1 312964} 46. Bc5 {+12.79/22 0.2 318832} Rc8 {-8.61/17 0.3 950241}
47. Ref6 {+18.81/29 0.2 309342} Rdd8 {-17.45/21 0.2 743347} 48. Be7 {M+7/41 0.2 353040} Bb7 {M-6/21 0.0 107765}
49. Rg1+ {M+6/51 0.2 326491} Kh8 {M-5/11 0.0 724} 1-0[/pgn]
Nice game
2344 will soon be "my" KOM at least, after 1134 's "lucky" run to stay on top of the heap. yomv and ymmv
two threads here - - not that it matters but these nets seem to test at very stable scaling once you get near 30+.03 or with SMP I will do that tc next with the same two nets to to see how close it it.
Code: Select all
pgn file: c:/cluster.mfb/pgn/2007250307-23441134.pgn
tc/base+inc: 60+0.60
games planned: 4000
Threads: 2
Hash: 256
Current date : time (EDST)
Date: 07/25/20 : 08:42:00
Projected-> Time: 8h:32m:0s
Running -> Time: 5h:34m:47s
2808 game(s) loaded
Rank Name Rating Δ + - # Σ Σ% W L D W% =% OppR
---------------------------------------------------------------------------------------------------------
1 2344 3502 0.0 8 8 2808 1418.5 50.5 644 615 1549 22.9 55.2 3498
2 1134 3498 3.8 8 8 2808 1389.5 49.5 615 644 1549 21.9 55.2 3502
---------------------------------------------------------------------------------------------------------
Δ = delta from the next higher rated opponent
# = number of games played
Σ = total score, 1 point for win, 1/2 point for draw
LOS:
23 11
2344 81
1134 18
2808 game(s) loaded
loops/scheduled: 149/228
waiting: 128
...seconds remaining: 128
cdani
Posts: 2204 Joined: Sat Jan 18, 2014 10:24 am
Location: Andorra
Post
by cdani » Sat Jul 25, 2020 3:07 pm
MikeB wrote: ↑ Sat Jul 25, 2020 2:44 pm
2344
For me the best net was 20200723-0511. Comparing it against 20200724-2344 after 1500 games 20+0.1 probably does not change this:
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 stnnuesergio20200723-0511 : 2859.0 4.5 792.0 1558 50.8%
2 stnnuesergio20200724-2344 : 2853.0 4.5 766.0 1558 49.2%
cdani
Posts: 2204 Joined: Sat Jan 18, 2014 10:24 am
Location: Andorra
Post
by cdani » Sat Jul 25, 2020 3:56 pm
Someone tested experimental nets? I don't see many comments about them.
Laskos
Posts: 10948 Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos
Post
by Laskos » Sat Jul 25, 2020 4:02 pm
cdani wrote: ↑ Sat Jul 25, 2020 3:56 pm
Someone tested experimental nets? I don't see many comments about them.
Two of them, happened to be weak, 20 or so Elo points weaker than the best.
My best one is 2141 from 22.07, one before yours.
cdani
Posts: 2204 Joined: Sat Jan 18, 2014 10:24 am
Location: Andorra
Post
by cdani » Sat Jul 25, 2020 4:16 pm
Laskos wrote: ↑ Sat Jul 25, 2020 4:02 pm
My best one is 2141 from 22.07, one before yours.
Not enough games:
Code: Select all
20+0.1
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 stnnuesergio20200723-0511 : 2857.0 2.9 1706.5 3393 50.3%
2 stnnuesergio20200722-2141 : 2855.0 2.9 1686.5 3393 49.7%
Laskos
Posts: 10948 Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos
Post
by Laskos » Sat Jul 25, 2020 4:22 pm
cdani wrote: ↑ Sat Jul 25, 2020 4:16 pm
Laskos wrote: ↑ Sat Jul 25, 2020 4:02 pm
My best one is 2141 from 22.07, one before yours.
Not enough games:
Code: Select all
20+0.1
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 stnnuesergio20200723-0511 : 2857.0 2.9 1706.5 3393 50.3%
2 stnnuesergio20200722-2141 : 2855.0 2.9 1686.5 3393 49.7%
Thanks, so your is the last of the series of usually improving nets (20-22 July up to yours of early 23). Then something happened, Sergio started experimenting, probably LR dropped too much.
cdani
Posts: 2204 Joined: Sat Jan 18, 2014 10:24 am
Location: Andorra
Post
by cdani » Sat Jul 25, 2020 5:14 pm
20200725-2051.bin seems better than 20200723-0511 after a few hundred games. I publish the test later with more games.
Laskos
Posts: 10948 Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos
Post
by Laskos » Sat Jul 25, 2020 5:19 pm
cdani wrote: ↑ Sat Jul 25, 2020 5:14 pm
20200725-2051.bin seems better than 20200723-0511 after a few hundred games. I publish the test later with more games.
About equal here after 500 games (to 2141).