It looks like SPCC uses a skylake CPU so that build should be good. Sadly I do not have an intel machine to test and compile with, but it should be just a little bit faster than the AVX2 builds I would think. It looks like SPCC also uses Hertz book which I did some tests with and found it was similar to the other book I was testing and not the TCEC S18 book. I believe Lkaufman posted all results with same book, so it would seem only reason for difference left is the binary or speed? (Since Larry tested K14 just now and it showed some performance as our prior results with SF-dev.)
I think the sample sizes are too big now for it to be pure bad/good luck. The project is still young so maybe some other issue exists...
SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
Moderators: hgm, Rebel, chrisw
-
- Posts: 99
- Joined: Sat Mar 10, 2018 6:16 am
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
jjoshua2 wrote: ↑Sun Jul 12, 2020 9:43 pm It looks like SPCC uses a skylake CPU so that build should be good. Sadly I do not have an intel machine to test and compile with, but it should be just a little bit faster than the AVX2 builds I would think. It looks like SPCC also uses Hertz book which I did some tests with and found it was similar to the other book I was testing and not the TCEC S18 book. I believe Lkaufman posted all results with same book, so it would seem only reason for difference left is the binary or speed? (Since Larry tested K14 just now and it showed some performance as our prior results with SF-dev.)
I think the sample sizes are too big now for it to be pure bad/good luck. The project is still young so maybe some other issue exists...
After 162 games vs. SF 11 same conditions your net is still +35 elo, so all my results are pretty self-consistent in assessing the elo as slightly higher than latest SF dev on one thread when running at 60% nps of SF11.
Komodo rules!
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
Of course. I measured the binary-speed and that build was the fastest on my machine. So, I used it for the testrun.
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
1) it is called HERT not Hertz (Human and Engine Relevant Theory)
2) Of course, I use it. Thomas Zipproth developed the 500 positions set for me and my testings and the 250 lowdraw set was filtered by me.
3) It is not a book, it is only a 500 (and 250 low draw) positions openings set (pgn). Way too small for making a book out of it.
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
It seems like both Jjoshua's and Nodchip's binaries were bugged in the past.lkaufman wrote: ↑Sun Jul 12, 2020 10:01 pmjjoshua2 wrote: ↑Sun Jul 12, 2020 9:43 pm It looks like SPCC uses a skylake CPU so that build should be good. Sadly I do not have an intel machine to test and compile with, but it should be just a little bit faster than the AVX2 builds I would think. It looks like SPCC also uses Hertz book which I did some tests with and found it was similar to the other book I was testing and not the TCEC S18 book. I believe Lkaufman posted all results with same book, so it would seem only reason for difference left is the binary or speed? (Since Larry tested K14 just now and it showed some performance as our prior results with SF-dev.)
I think the sample sizes are too big now for it to be pure bad/good luck. The project is still young so maybe some other issue exists...
After 162 games vs. SF 11 same conditions your net is still +35 elo, so all my results are pretty self-consistent in assessing the elo as slightly higher than latest SF dev on one thread when running at 60% nps of SF11.
Recent binaries no longer need non-default slowmover and are just mind-blowingly strong.
They just work without needing to adjust slowmover and they work well.
https://workupload.com/file/ggEUrvNVgmH
or if you're more trusting of Github and net:
https://github.com/nodchip/Stockfish/re ... 2020-07-15
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
Would you be willing to do a quick test with the binaries from the test above?
The earlier ones were legit bugged, the new ones work perfectly with default slowmover.
Doesn't have to be thorough, just a quick sanity test that everyone is getting these results now.
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
I started a new 5000 games testrun with latest bmi2-binary (200715) fromRaphexon wrote: ↑Wed Jul 15, 2020 8:29 pmWould you be willing to do a quick test with the binaries from the test above?
The earlier ones were legit bugged, the new ones work perfectly with default slowmover.
Doesn't have to be thorough, just a quick sanity test that everyone is getting these results now.
https://github.com/nodchip/Stockfish/releases
and with the gk200627 net, which is the strongest net so far in my pre-tests.
Will take 5-6 days. After 400 games played, the score is really impressive.
Stay tuned.
-
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: SPCC: Testruns of StockFiNN 0.2 and Lc0 J90-40 finished
To wait 5-6 days is really hard. I'm looking forward to the test results.pohl4711 wrote: ↑Fri Jul 17, 2020 7:49 amI started a new 5000 games testrun with latest bmi2-binary (200715) fromRaphexon wrote: ↑Wed Jul 15, 2020 8:29 pmWould you be willing to do a quick test with the binaries from the test above?
The earlier ones were legit bugged, the new ones work perfectly with default slowmover.
Doesn't have to be thorough, just a quick sanity test that everyone is getting these results now.
https://github.com/nodchip/Stockfish/releases
and with the gk200627 net, which is the strongest net so far in my pre-tests.
Will take 5-6 days. After 400 games played, the score is really impressive.
Stay tuned.
I have ben testing Stockfish NNUE Gekehenker chess engine and my test results are much better than my guess.