Crazyhouse tournaments and rating list

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Blitz rating list, 2016-11-29

Post by Vinvin »

Ferdy wrote:Blitz rating list all versions.

Code: Select all

   # PLAYER                          :  RATING    +/-   GAMES  PTS(%)
   1 Stockfish zh 15Nov2016 64bit    :  3083.4   57.5     370      85
...
Average depth and time comparison, when score is mate depth is not considered.

Code: Select all

 
 nr                       player  games  pts%      sumTime aveDep    aveTime

  1            Sunsetter 9 32bit   1529  49.6  03:18:25:45  16.27  00:06:928
  2 Stockfish zh 15Nov2016 64bit    370  85.1  00:20:25:04  15.25  00:06:041
 ...
https://sites.google.com/site/zhassocia ... list/blitz
Hello Ferdinand, I'm quite curious to know how multi-threads perform in Crazyhouse.
Please, would you mind to run some games SF-1core vs SF-4cores ?

Thanks,
Vincent
Isaac
Posts: 265
Joined: Sat Feb 22, 2014 8:37 pm

Re: Blitz rating list, 2016-11-29

Post by Isaac »

Vinvin wrote: Hello Ferdinand, I'm quite curious to know how multi-threads perform in Crazyhouse.
Please, would you mind to run some games SF-1core vs SF-4cores ?

Thanks,
Vincent
I am also curious about the same thing, but I think he has a quad-core and that to get the most accurate results it's better not to use more than 3 cores in his case. I'd appreciate if SF-zh running on 2 cores was added.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Blitz rating list, 2016-11-29

Post by Ferdy »

Vinvin wrote:
Ferdy wrote:Blitz rating list all versions.

Code: Select all

   # PLAYER                          :  RATING    +/-   GAMES  PTS(%)
   1 Stockfish zh 15Nov2016 64bit    :  3083.4   57.5     370      85
...
Average depth and time comparison, when score is mate depth is not considered.

Code: Select all

 
 nr                       player  games  pts%      sumTime aveDep    aveTime

  1            Sunsetter 9 32bit   1529  49.6  03:18:25:45  16.27  00:06:928
  2 Stockfish zh 15Nov2016 64bit    370  85.1  00:20:25:04  15.25  00:06:041
 ...
https://sites.google.com/site/zhassocia ... list/blitz
Hello Ferdinand, I'm quite curious to know how multi-threads perform in Crazyhouse.
Please, would you mind to run some games SF-1core vs SF-4cores ?

Thanks,
Vincent
My pc is busy now, I use it in the on going zh champs, I can not run such a match at this time.

Why not run it yourself?
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Blitz rating list, 2016-11-29

Post by Vinvin »

Ferdy wrote:
Vinvin wrote:
Ferdy wrote:Blitz rating list all versions.

Code: Select all

   # PLAYER                          :  RATING    +/-   GAMES  PTS(%)
   1 Stockfish zh 15Nov2016 64bit    :  3083.4   57.5     370      85
...
Average depth and time comparison, when score is mate depth is not considered.

Code: Select all

 
 nr                       player  games  pts%      sumTime aveDep    aveTime

  1            Sunsetter 9 32bit   1529  49.6  03:18:25:45  16.27  00:06:928
  2 Stockfish zh 15Nov2016 64bit    370  85.1  00:20:25:04  15.25  00:06:041
 ...
https://sites.google.com/site/zhassocia ... list/blitz
Hello Ferdinand, I'm quite curious to know how multi-threads perform in Crazyhouse.
Please, would you mind to run some games SF-1core vs SF-4cores ?

Thanks,
Vincent
My pc is busy now, I use it in the on going zh champs, I can not run such a match at this time.

Why not run it yourself?
I'll try ...
Can I use Winboard-AA http://www.talkchess.com/forum/viewtopic.php?t=62331 ? I saw the "Number of threats" is for both engines, true ?
Do I have to use a book ? Which book ?
I'll use 1m+1s TC

Vincent
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Blitz rating list, 2016-11-29

Post by Ferdy »

Vinvin wrote:
Ferdy wrote:
Vinvin wrote:
Ferdy wrote:Blitz rating list all versions.

Code: Select all

   # PLAYER                          :  RATING    +/-   GAMES  PTS(%)
   1 Stockfish zh 15Nov2016 64bit    :  3083.4   57.5     370      85
...
Average depth and time comparison, when score is mate depth is not considered.

Code: Select all

 
 nr                       player  games  pts%      sumTime aveDep    aveTime

  1            Sunsetter 9 32bit   1529  49.6  03:18:25:45  16.27  00:06:928
  2 Stockfish zh 15Nov2016 64bit    370  85.1  00:20:25:04  15.25  00:06:041
 ...
https://sites.google.com/site/zhassocia ... list/blitz
Hello Ferdinand, I'm quite curious to know how multi-threads perform in Crazyhouse.
Please, would you mind to run some games SF-1core vs SF-4cores ?

Thanks,
Vincent
My pc is busy now, I use it in the on going zh champs, I can not run such a match at this time.

Why not run it yourself?
I'll try ...
Can I use Winboard-AA http://www.talkchess.com/forum/viewtopic.php?t=62331 ? I saw the "Number of threats" is for both engines, true ?
Do I have to use a book ? Which book ?
I'll use 1m+1s TC

Vincent
1. Use Cute Chess GUI
2. Create 2 dir, for same sf, but the sf in 1st dir set the threads to 1 and the sf in 2nd dir set threads to 4. Then install those in GUI.
3. Download ccva-520start.pgn from
https://sites.google.com/site/zhassociation/download
look in the start positions dir, use it as opening suite inside the GUI. Since there 520 positions you can set games per encounter to 520*2=1040, set rounds to 1 and check play each opening twice in the GUI. Depending on your hardware set the concurrent games to 1.

To install engines, press tools/settings and press the button with + symbol.

After pressing tournament/new in the GUI,

Image
User avatar
hgm
Posts: 27793
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Blitz rating list, 2016-11-29

Post by hgm »

Vinvin wrote:I'll try ...
Can I use Winboard-AA http://www.talkchess.com/forum/viewtopic.php?t=62331 ? I saw the "Number of threats" is for both engines, true ?
Do I have to use a book ? Which book ?
I'll use 1m+1s TC
Just register Stockfish twice through the Load Engine dialog, under different Nicknames. And the second time add as 'Special WinBoard option':

-initString "cores 4\nnew"

Then that version will always use 4 cores, because the 'cores 4' command just before the 'new' will overrule whatever cores command the GUI would have sent before. You can then use the common CPUs setting to control the number of cores used by the other.
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Blitz rating list, 2016-11-29

Post by Vinvin »

Ferdy wrote:
Vinvin wrote:I'll try ...
Can I use Winboard-AA http://www.talkchess.com/forum/viewtopic.php?t=62331 ? I saw the "Number of threats" is for both engines, true ?
Do I have to use a book ? Which book ?
I'll use 1m+1s TC

Vincent
1. Use Cute Chess GUI
2. Create 2 dir, for same sf, but the sf in 1st dir set the threads to 1 and the sf in 2nd dir set threads to 4. Then install those in GUI.
3. Download ccva-520start.pgn from
https://sites.google.com/site/zhassociation/download
look in the start positions dir, use it as opening suite inside the GUI. Since there 520 positions you can set games per encounter to 520*2=1040, set rounds to 1 and check play each opening twice in the GUI. Depending on your hardware set the concurrent games to 1.

To install engines, press tools/settings and press the button with + symbol.

After pressing tournament/new in the GUI,

https://i.imgur.com/S7LpMuh.png
thanks, it's working !
Current results :

Code: Select all

Score of stockfish-windows-amd64 vs stockfish-windows-amd64b: 35 - 8 - 1 [0.807]
ELO difference: 248.32 +/- 143.01

44 of 1040 games finished.
6 cores for stockfish-windows-amd64
1 core for stockfish-windows-amd64b

I had troubles with the Winboard solution.
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Blitz rating list, 2016-11-29

Post by Vinvin »

Vinvin wrote:
Ferdy wrote:
Vinvin wrote:I'll try ...
Can I use Winboard-AA http://www.talkchess.com/forum/viewtopic.php?t=62331 ? I saw the "Number of threats" is for both engines, true ?
Do I have to use a book ? Which book ?
I'll use 1m+1s TC

Vincent
1. Use Cute Chess GUI
2. Create 2 dir, for same sf, but the sf in 1st dir set the threads to 1 and the sf in 2nd dir set threads to 4. Then install those in GUI.
3. Download ccva-520start.pgn from
https://sites.google.com/site/zhassociation/download
look in the start positions dir, use it as opening suite inside the GUI. Since there 520 positions you can set games per encounter to 520*2=1040, set rounds to 1 and check play each opening twice in the GUI. Depending on your hardware set the concurrent games to 1.

To install engines, press tools/settings and press the button with + symbol.

After pressing tournament/new in the GUI,

https://i.imgur.com/S7LpMuh.png
thanks, it's working !
Current results :

Code: Select all

Score of stockfish-windows-amd64 vs stockfish-windows-amd64b: 35 - 8 - 1 [0.807]
ELO difference: 248.32 +/- 143.01

44 of 1040 games finished.
6 cores for stockfish-windows-amd64
1 core for stockfish-windows-amd64b

I had troubles with the Winboard solution.
I restarted the match with bigger HT : 512 MB

I stopped the match after 780 games :

Code: Select all

Score of stockfish-windows-1-core vs stockfish-windows-6-cores: 123 - 630 - 27 [0.175]
ELO difference: -269.37 +/- 31.25

780 of 1040 games finished.
Games are here : https://www.dropbox.com/s/w0j3vvm48viu4 ... e.zip?dl=0

There are some too unbalanced openings in (>1.5 for white), may be this file would be useful to find and delete this lines. Search for games where 1-core get white and has a winning score during the whole game.
User avatar
hgm
Posts: 27793
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Blitz rating list, 2016-11-29

Post by hgm »

I would not trust the egine score on initial positions at this stage. Crazyhouse is much more difficult to evaluate than Chess, and even Stockfish might still lack important eval terms. That it is stronger than all other engines might not be because of its eval, but despite its eval, and purely based on a better search. In Shogi I have often seen that positions with a large positive eval are nevertheless mostly lost when you play them out.

Also keep in mind that Crazyhouse scores are not nearly as decisive as in Chess, and that it is not unusual to lose after having had a scores of +8.

So I usually ignore the score, and judge positions purely on their WDL statistics.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Blitz rating list, 2016-11-29

Post by Ferdy »

Vinvin wrote:There are some too unbalanced openings in (>1.5 for white), may be this file would be useful to find and delete this lines. Search for games where 1-core get white and has a winning score during the whole game.
Some lines are added because it is popular in human games based from lichess zh database, like the Crosky gambit. It is interesting to see how the engines would play this type of positions. I am aware of the end positions of this opening suite. I hope to get some hits on this type of positions during the stage 1 of the champs tour since the engines have more time.

In stage 2, 4-player crossover semi final and final, I will be using a different opening suite called ccva-ch-64start.pgn. If you have interesting positions to include post it here, it is more likely that I will add it since my collection so far is still at 25, trying to reach 64 around 10 days from now. In this suite I am trying to avoid position which may lead to the same opening in the actual game. Like, given

Code: Select all

e4 e6 d4 d5,
don't include

Code: Select all

e4 e6 d4 d5 e5
Better add 2 positions like this,

Code: Select all

e4 e6 d4 d5 e5
e4 e6 d4 d5 ed5
I also like more variety, perhaps couple of b4, b3, c4, f4 lines. All of these will be used twice per match so it would be fair for both players.
I also plan to add Chess960 start positions perhaps 4 of them.

Here is what I have so far.

Code: Select all

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Bc5 4. O-O Nf6
5. d3 O-O 6. Nc3 d6 7. Bg5 h6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Bc5 4. c3
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Be7 4. O-O Nf6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 Bc5 4. O-O Nf6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 Nf6 4. Nc3 Be7
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e5 2. Nf3 Nc6 3. Nc3 Bc5 4. Be2 Nf6 5. O-O d6 6. d3
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e6 2. d4 d5 3. e5 c5 4. c3 Nc6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e6 2. d4 Nc6 3. Nf3 Nf6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e6 2. d4 d5 3. exd5 exd5
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e6 2. d4 d5 3. Nc3 Bb4 4. e5
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 e6 2. d4 d5 3. Nc3 dxe4 4. Nxe4 Nc6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 Nf6 2. e5 d5 3. exf6 exf6 4. d4 Be7
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 d6 2. d4 Nf6 3. Nc3 Bg4 4. Be2 Bxe2 5. Ngxe2
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 d6 2. d4 Nf6 3. Nc3 g6 4. Nf3 Bg7
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. d4 d5 2. Nf3 Nf6 3. Bf4 Bf5 4. e3 e6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. d4 d5 2. Nf3 Nf6 3. Bg5 Ne4
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. Nf3 Nf6 2. g3 d5 3. Bg2 Nc6 4. d4 Bf5 5. O-O e6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. b3 e5 2. Bb2 Nc6 3. e3
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. b3 Nf6 2. Bb2 d5 3. e3
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 d5 2. exd5 Qxd5 3. Nc3 Qa5 4. Nf3 Nf6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 d5 2. exd5 Qxd5 3. Nc3 Qd8 4. d4
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. d4 Nf6 2. c4 e6 3. Nf3 Nc6
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. d4 Nf6 2. c4 e6 3. Nc3 Bb4 4. Nf3 d5 5. cxd5 exd5
*

[Event "?"]
[Site "?"]
[Date "?"]
[Round "-"]
[White "?"]
[Black "?"]
[Result "*"]
[Variant "crazyhouse"]

1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Nxd4 *