LC0 and tablebases

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Werewolf
Posts: 1796
Joined: Thu Sep 18, 2008 10:24 pm

Re: LC0 and tablebases

Post by Werewolf »

Albert Silver wrote: Mon Oct 08, 2018 4:51 pm
Werewolf wrote: Fri Oct 05, 2018 6:56 pm So I've got a bit of a weird result here, conditions below:

LC0 11089 (used in CCCC) without TB
LC0 11089 with Syzygy TB

1060 Nvidia.

after 100 games it was +6 -2 =92 to the non-TB version.
TB were enabled by directing to them in the UCI options and they do seem to work.

The non-TB version doesn't seem to use them although Fritz does have syzygy TB in the GUI enabled. Is it possible both were using TB somehow or don't they add much to LC0 yet?

Also, running the above against SF Dev (latest) on a single core with TB I get 58% in favour of SF Dev, which seems a poor result for LC0.
If Fritz has TB enabled in the GUI, then whenever they reach a TB ending, all moves are played with TBs by both sides.
This happens with normal engines but not with LC0, at least not on my system.

However, to avoid confusion I'm going to reinstall LC0, remove TBs from the GUI, and re-run matches vs LC0 without TBs and SF Dev.

Then I'll get a fuller picture of how TBs help / not help.
Werewolf
Posts: 1796
Joined: Thu Sep 18, 2008 10:24 pm

Re: LC0 and tablebases

Post by Werewolf »

Clean start, as described above. New match:

LC0 11248 (as used in CCCC) with Syzygy TBs on Nvidia 1060
vs
SF Dev Sept 27th 2018 Build Ultimaiq compile for top speed. 1 core (Broadwell @4.2 GHz)
http://chess.ultimaiq.net/stockfish.html
Also using Syzygy TBs

T/C G10min + 10 sec/move
Noomen short openings.
Ponder off.

Current score 6-6 with 2 wins, 2 losses and 8 draws each.
Werewolf
Posts: 1796
Joined: Thu Sep 18, 2008 10:24 pm

Re: LC0 and tablebases

Post by Werewolf »

Current score 10-10 with 4 wins each.
User avatar
Guenther
Posts: 4607
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: LC0 and tablebases

Post by Guenther »

Werewolf wrote: Wed Oct 10, 2018 10:50 am Current score 10-10 with 4 wins each.
With 2 posts for 24 games already, you need to post several 100 interim results (which no one will read)
to get a statistically slightly meaningful result for your goal and only if your setup is w/o errors.
https://rwbc-chess.de

trollwatch:
Talkchess nowadays is a joke - it is full of trolls/idiots/people stuck in the pleistocene > 80% of the posts fall into this category...