Hard-Talkchess-2020 set, final release

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Vinvin
Posts: 4909
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Hard-Talkchess-2020 set, final release

Post by Vinvin » Thu Dec 31, 2020 2:52 am

Vinvin wrote:
Sun Dec 27, 2020 10:09 pm
Results for 6 new engines (NN file used : nn-62ef826d1a6d.nnue) :

Code: Select all

SugaR.AI.ICCF.1.00 : 166 solved
ShashChess15.1     : 166 solved
Bluefish-12-W      : 162 solved
Stockfish_20121407 : 153 solved
Eman 6.61          : 153 solved
SugaR.AI.1.00      : 149 solved
Some engines that will be tested in the following days : Crystal_x64_110920, Cfish NUMA 261020 and Sting-sf-25.
Again a new record for Crystal-291220 (exe found here : https://krakenfiles.com/view/755b0dc671/file.html )

Code: Select all

Crystal-291220     : 169 solved
New link to the sheet of results : https://www.dropbox.com/s/069gvzysk6o22 ... 0.ods?dl=0

MikeGL
Posts: 1001
Joined: Thu Sep 01, 2011 12:49 pm

Re: Hard-Talkchess-2020 set, final release

Post by MikeGL » Thu Dec 31, 2020 3:01 am

Nice position. Thanks.
I checked with my SF12 dev version 32bit on my very old dual core bought 2008,
it found the best move 34.Rxd7 in less than 40 seconds.
abgursu wrote:
Wed Dec 30, 2020 2:07 pm

I was expecting to see this position in Hard-TalkChess. A lot harder than lots of positions in this set.
Taken from:
I told my wife that a husband is like a fine wine; he gets better with age. The next day, she locked me in the cellar.

Vinvin
Posts: 4909
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Hard-Talkchess-2020 set, final release

Post by Vinvin » Sun Jan 03, 2021 2:24 am

Vinvin wrote:
Mon Dec 28, 2020 8:13 pm
Jouni wrote:
Mon Dec 28, 2020 3:59 pm
According to CSS forum SugaR AI ICCF 1.0 mit Night Nurse 0.3 now beats Bluefish tactical clearly!
Thanks for the information !
I will test this NN.
I tested the Night Nurse 0.3 network.
Not superior in my test set : same number of positions found (166) and about same time average to found the solutions (111 sec to 113 sec).
But the solutions found are different.
Here are the biggest differences :
1) Found fast (time in seconds) by Night Nurse 0.3 but not found by nn-62ef826d1a6d in 30 minutes.

Code: Select all

 25) e4-e5       17
 65) .. Ba6-c8   13
 12) Rg1xg7      3
 77) Nc4-a5      0
 81) Rg2xg7      0
194) .. e4-e3    0
2) Found fast (time in seconds) by nn-62ef826d1a6d but not found by Night Nurse 0.3 in 30 minutes.

Code: Select all

133) Bh5-f3      	95
 24) Rc1xc3      	55
 20) a4-a5       	46
 73) .. e6-e5    	2
138) Qh4-d4      	0
187) Ba4xc6      	0

Jouni
Posts: 2384
Joined: Wed Mar 08, 2006 7:15 pm

Re: Hard-Talkchess-2020 set, final release

Post by Jouni » Sun Jan 03, 2021 12:42 pm

CSS forum claims this result:

Acer i7-8700, 6 Kerne, 3,2Ghz, 16 GB RAM, die Engines rechnen mit 8GB HT jeweils 5 Minuten pro Stellung.
HARD-TALKCHESS-2020-TEST

PLATZ #2
Bluefish XI-LP FD, defensive =off, tactical =2
a) Lösungen in 5 min 179/213
b) Lösungen in 1 min 142/213
PLATZ #1
SUGAR AI ICCF 1.0, multiPV=2, NNUE =NIGHT NURSE 0.3
a) Lösungen in 5 min 189/213
b) Lösungen in 1 min 170/213
Jouni

Vinvin
Posts: 4909
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Hard-Talkchess-2020 set, final release

Post by Vinvin » Wed Jan 06, 2021 12:38 am

Jouni wrote:
Sun Jan 03, 2021 12:42 pm
CSS forum claims this result:
...
PLATZ #1
SUGAR AI ICCF 1.0, multiPV=2, NNUE =NIGHT NURSE 0.3
a) Lösungen in 5 min 189/213
b) Lösungen in 1 min 170/213
I only test with multiPV=1

Vinvin
Posts: 4909
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Hard-Talkchess-2020 set, final release

Post by Vinvin » Sat Jan 16, 2021 10:28 pm

Vinvin wrote:
Thu Dec 31, 2020 2:52 am
Vinvin wrote:
Sun Dec 27, 2020 10:09 pm
Results for 6 new engines (NN file used : nn-62ef826d1a6d.nnue) :

Code: Select all

SugaR.AI.ICCF.1.00 : 166 solved
ShashChess15.1     : 166 solved
Bluefish-12-W      : 162 solved
Stockfish_20121407 : 153 solved
Eman 6.61          : 153 solved
SugaR.AI.1.00      : 149 solved
Some engines that will be tested in the following days : Crystal_x64_110920, Cfish NUMA 261020 and Sting-sf-25.
Again a new record for Crystal-291220 (exe found here : https://krakenfiles.com/view/755b0dc671/file.html )

Code: Select all

Crystal-291220     : 169 solved
New link to the sheet of results : https://www.dropbox.com/s/069gvzysk6o22 ... 0.ods?dl=0
Again again, latest Crystal (V3.1 from here http://talkchess.com/forum3/viewtopic.p ... 07#p879407 ) beat the record to reach 173 solutions found !!
Latest sheet with timings here : https://www.dropbox.com/s/adpfqz3ojuw5m ... 6.ods?dl=0

Note there will be a revision of the Hard-Talkchess-2020 set soon : mistakes, too easy puzzles and too hard fortresses will be removed.

Pi4Chess
Posts: 237
Joined: Mon Nov 16, 2020 11:13 am
Full name: Manuel Rivera

Re: Hard-Talkchess-2020 set, final release

Post by Pi4Chess » Sun Jan 17, 2021 11:35 am

Vinvin wrote:
Sat Jan 16, 2021 10:28 pm
Vinvin wrote:
Thu Dec 31, 2020 2:52 am
Vinvin wrote:
Sun Dec 27, 2020 10:09 pm
Results for 6 new engines (NN file used : nn-62ef826d1a6d.nnue) :

Code: Select all

SugaR.AI.ICCF.1.00 : 166 solved
ShashChess15.1     : 166 solved
Bluefish-12-W      : 162 solved
Stockfish_20121407 : 153 solved
Eman 6.61          : 153 solved
SugaR.AI.1.00      : 149 solved
Some engines that will be tested in the following days : Crystal_x64_110920, Cfish NUMA 261020 and Sting-sf-25.
Again a new record for Crystal-291220 (exe found here : https://krakenfiles.com/view/755b0dc671/file.html )

Code: Select all

Crystal-291220     : 169 solved
New link to the sheet of results : https://www.dropbox.com/s/069gvzysk6o22 ... 0.ods?dl=0
Again again, latest Crystal (V3.1 from here http://talkchess.com/forum3/viewtopic.p ... 07#p879407 ) beat the record to reach 173 solutions found !!
Latest sheet with timings here : https://www.dropbox.com/s/adpfqz3ojuw5m ... 6.ods?dl=0

Note there will be a revision of the Hard-Talkchess-2020 set soon : mistakes, too easy puzzles and too hard fortresses will be removed.
Hello can you try Black Diamond XI-NN with last SF default net ?

here is a link where you can download the engine: https://github.com/MichaelB7/Stockfish/releases/tag/NN

May be i am mistaken but you tested the non NN version.

MikeGL
Posts: 1001
Joined: Thu Sep 01, 2011 12:49 pm

Re: Hard-Talkchess-2020 set, final release

Post by MikeGL » Sun Jan 17, 2021 2:48 pm

The double rook sacrifice of Lc0 to checkmate SF12 was missed.
Maybe that is pretty tough for NNUE engines too.

http://talkchess.com/forum3/viewtopic.p ... 17#p839617

That's the shortest defeat of SF12 in a long time control I think.
I told my wife that a husband is like a fine wine; he gets better with age. The next day, she locked me in the cellar.

Vinvin
Posts: 4909
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Hard-Talkchess-2020 set, final release

Post by Vinvin » Sun Jan 17, 2021 6:12 pm

MikeGL wrote:
Sun Jan 17, 2021 2:48 pm
The double rook sacrifice of Lc0 to checkmate SF12 was missed.
Maybe that is pretty tough for NNUE engines too.

http://talkchess.com/forum3/viewtopic.p ... 17#p839617

That's the shortest defeat of SF12 in a long time control I think.
Nice position !
I added the test of Bluefish there.

Code: Select all

3 runs on my old i7-6*4 GHz with Bluefish-12-W : 1m40s, 35s and 1m55 (average 1m23s)

Vinvin
Posts: 4909
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Hard-Talkchess-2020 set, final release

Post by Vinvin » Fri Feb 12, 2021 12:46 am

The latest revision of the set is there : http://talkchess.com/forum3/viewtopic.p ... 36#p882236

Post Reply