New engine: Stash

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

mhouppin
Posts: 116
Joined: Wed Feb 12, 2020 5:00 pm
Full name: Morgan Houppin

Re: New engine: Stash

Post by mhouppin »

Hi there, version 31 is out ! Here's the list of the changes made: https://github.com/mhouppin/stash-bot/b ... 2021-06-26

Stash scored +62 Elo in regression tests, but even though most of the gains came from eval improvements, they seem to be about ~30-35 Elo against other engines. It now has Ponder support and automated tuning (based on Andrew Grant's paper) integrated to the code base.

Good morning to everyone !
mhouppin
Posts: 116
Joined: Wed Feb 12, 2020 5:00 pm
Full name: Morgan Houppin

Re: New engine: Stash

Post by mhouppin »

mhouppin wrote: Mon Jun 28, 2021 10:47 am Hi there, version 31 is out ! Here's the list of the changes made: https://github.com/mhouppin/stash-bot/b ... 2021-06-26

Stash scored +62 Elo in regression tests, but even though most of the gains came from eval improvements, they seem to be about ~30-35 Elo against other engines. It now has Ponder support and automated tuning (based on Andrew Grant's paper) integrated to the code base.

Good morning to everyone !
Forgot to post the link for binaries: https://gitlab.com/mhouppin/stash-bot/-/releases/v31.0
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: New engine: Stash

Post by CMCanavessi »

Finally ponder!! :mrgreen:
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: New engine: Stash

Post by Rebel »

Have it run for the GRL.

1000 games.

http://rebel13.nl/a/grl.htm

Page automatically refreshes after 30 seconds.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: New engine: Stash

Post by Rebel »

+50

Code: Select all

Gambit Rating List
Running      : Gauntlet Stash 31.0
Time Control : Time control 40/120
Games        : 1000

Results from file gauntlet-stash.pgn:

No. Name           Win Draw Loss Unf.  Score Games       %
----------------------------------------------------------
  1 Stash 31.0    +442 =332 -226   *0  608.0  1000   60.8%
  2 Halogen 10     +42  =34  -24   *0   59.0   100   59.0%
  3 Seer 2.0.1     +33  =24  -43   *0   45.0   100   45.0%
  4 Danasah 8.8    +27  =34  -39   *0   44.0   100   44.0%
  5 Orion 0.8      +28  =31  -41   *0   43.5   100   43.5%
  6 Clover 2.3.1   +21  =43  -36   *0   42.5   100   42.5%
  7 Marvin 5.0     +23  =37  -40   *0   41.5   100   41.5%
  8 Berserk 4.1.0  +17  =43  -40   *0   38.5   100   38.5%
  9 Counter 3.7    +17  =31  -52   *0   32.5   100   32.5%
 10 Topple 0.8.0   +10  =29  -61   *0   24.5   100   24.5%
 11 Tucano 9.0      +8  =26  -66   *0   21.0   100   21.0%

Total Games:    1000
White Wins:      332 (33.2%)
Black Wins:      336 (33.6%)
Draws:           332 (33.2%)
Unfinished:        0 (0.0%)

Estimated elo gain for Stash_31.0
Elo pool : 3076
Stash 30.0 : 3100.0
Stash_31.0 : 3149.8
Difference : 49.8
90% of coding is debugging, the other 10% is writing bugs.
mhouppin
Posts: 116
Joined: Wed Feb 12, 2020 5:00 pm
Full name: Morgan Houppin

Re: New engine: Stash

Post by mhouppin »

Hi there, version 32 is out ! It took quite some time to get there (mostly because improving Stash gets harder as time passes, but also because I have been quite busy with my studies lately), and I'm really happy with the result.

Improvements are about 65 Elo in self-play, probably a bit lower against other engines.
Binaries are available here: https://gitlab.com/mhouppin/stash-bot/-/releases/v32.0

Good evening to everyone !
Guenther
Posts: 4718
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: New engine: Stash

Post by Guenther »

mhouppin wrote: Thu Dec 02, 2021 6:27 pm Hi there, version 32 is out ! It took quite some time to get there (mostly because improving Stash gets harder as time passes, but also because I have been quite busy with my studies lately), and I'm really happy with the result.

Improvements are about 65 Elo in self-play, probably a bit lower against other engines.
Binaries are available here: https://gitlab.com/mhouppin/stash-bot/-/releases/v32.0

Good evening to everyone !
Great! Thanks a lot.
https://rwbc-chess.de

[Trolls n'existent pas...]
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: New engine: Stash

Post by Rebel »

Stash 32.0 for the GRL

Games : 1000

Elo pool : 3170

http://rebel13.nl/a/grl.htm
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: New engine: Stash

Post by Rebel »

Estimated elo gain for Stash_32.0 : +43

Code: Select all

Gambit Rating List
Running      : Gauntlet Stash 32.0
Time Control : Time control : 40/120
Games        : 1000

Results from file gauntlet-stash.pgn:

No. Name        Win Draw Loss Unf.  Score Games       %
-------------------------------------------------------
  1 Stash 32.0 +354 =366 -280   *0  537.0  1000   53.7%
  2 Wasp 5.00   +66  =73  -61   *0  102.5   200   51.2%
  3 Seer 2.1.0  +63  =66  -71   *0   96.0   200   48.0%
  4 Minic 3.14  +62  =63  -75   *0   93.5   200   46.8%
  5 Weiss 1.4   +48  =80  -72   *0   88.0   200   44.0%
  6 Halogen 10  +41  =84  -75   *0   83.0   200   41.5%

Total Games:    1000
White Wins:      309 (30.9%)
Black Wins:      325 (32.5%)
Draws:           366 (36.6%)
Unfinished:        0 (0.0%)

Estimated elo gain for Stash_32.0
Elo pool : 3170
Stash 31.0 : 3148.0
Stash_32.0 : 3191.8
Difference : 43.8
90% of coding is debugging, the other 10% is writing bugs.
mhouppin
Posts: 116
Joined: Wed Feb 12, 2020 5:00 pm
Full name: Morgan Houppin

Re: New engine: Stash

Post by mhouppin »

Rebel wrote: Fri Dec 03, 2021 7:50 am Estimated elo gain for Stash_32.0 : +43

Code: Select all

Gambit Rating List
Running      : Gauntlet Stash 32.0
Time Control : Time control : 40/120
Games        : 1000

Results from file gauntlet-stash.pgn:

No. Name        Win Draw Loss Unf.  Score Games       %
-------------------------------------------------------
  1 Stash 32.0 +354 =366 -280   *0  537.0  1000   53.7%
  2 Wasp 5.00   +66  =73  -61   *0  102.5   200   51.2%
  3 Seer 2.1.0  +63  =66  -71   *0   96.0   200   48.0%
  4 Minic 3.14  +62  =63  -75   *0   93.5   200   46.8%
  5 Weiss 1.4   +48  =80  -72   *0   88.0   200   44.0%
  6 Halogen 10  +41  =84  -75   *0   83.0   200   41.5%

Total Games:    1000
White Wins:      309 (30.9%)
Black Wins:      325 (32.5%)
Draws:           366 (36.6%)
Unfinished:        0 (0.0%)

Estimated elo gain for Stash_32.0
Elo pool : 3170
Stash 31.0 : 3148.0
Stash_32.0 : 3191.8
Difference : 43.8
Good to see that the gains are holding this time ^^ Thanks for testing it !