Kai Laskos positional testing

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

mbabigian
Posts: 204
Joined: Tue Oct 15, 2013 2:34 am
Location: US
Full name: Mike Babigian

Kai Laskos positional testing

Post by mbabigian »

Kai, you used a "positional" test suite at one time that gave you a "feel" for how much positional understanding a program had. As I remember, Komodo scored the highest on this test. Have you tried the new NN version of SF to see if it has caught up or surpassed Komodo's score?

I'm curious. Thanks,
Mike.
“Censorship is telling a man he can't have a steak just because a baby can't chew it.” ― Mark Twain
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Kai Laskos positional testing

Post by Laskos »

mbabigian wrote: Thu Aug 20, 2020 12:38 am Kai, you used a "positional" test suite at one time that gave you a "feel" for how much positional understanding a program had. As I remember, Komodo scored the highest on this test. Have you tried the new NN version of SF to see if it has caught up or surpassed Komodo's score?

I'm curious. Thanks,
Mike.
At 10s/pos
SF NNUE is first, SF classical is the second, Komodo 14 is the third.
Absolute first on RTX GPU is Lc0 with LS15 (by a pretty long shot).
mbabigian
Posts: 204
Joined: Tue Oct 15, 2013 2:34 am
Location: US
Full name: Mike Babigian

Re: Kai Laskos positional testing

Post by mbabigian »

Thank you! Very interesting.

What is the numerical spread between the top 4?
“Censorship is telling a man he can't have a steak just because a baby can't chew it.” ― Mark Twain
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Kai Laskos positional testing

Post by Laskos »

mbabigian wrote: Thu Aug 20, 2020 7:31 pm Thank you! Very interesting.

What is the numerical spread between the top 4?
From memory, 10s / position. Lc0 far ahead with 160, then SF NNUE -- 140, SF classical -- 130, Komodo 14 -- 120, Andscacs 0.95 -- 100.
GPU favoring PC, RTX 2070, but only 4 core i7 3.8 GHz.
User avatar
Master Om
Posts: 449
Joined: Wed Nov 24, 2010 10:57 am
Location: INDIA

Re: Kai Laskos positional testing

Post by Master Om »

Laskos wrote: Thu Aug 20, 2020 7:45 pm
mbabigian wrote: Thu Aug 20, 2020 7:31 pm Thank you! Very interesting.

What is the numerical spread between the top 4?
From memory, 10s / position. Lc0 far ahead with 160, then SF NNUE -- 140, SF classical -- 130, Komodo 14 -- 120, Andscacs 0.95 -- 100.
GPU favoring PC, RTX 2070, but only 4 core i7 3.8 GHz.
Which net of Lc0 and NNUE SF ?
Always Expect the Unexpected
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Kai Laskos positional testing

Post by Laskos »

Master Om wrote: Sat Aug 22, 2020 8:47 am
Laskos wrote: Thu Aug 20, 2020 7:45 pm
mbabigian wrote: Thu Aug 20, 2020 7:31 pm Thank you! Very interesting.

What is the numerical spread between the top 4?
From memory, 10s / position. Lc0 far ahead with 160, then SF NNUE -- 140, SF classical -- 130, Komodo 14 -- 120, Andscacs 0.95 -- 100.
GPU favoring PC, RTX 2070, but only 4 core i7 3.8 GHz.
Which net of Lc0 and NNUE SF ?
LS15 for Lc0 and one of the newer SV nets for SF NNUE.