UHO 2024 released

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
pohl4711
Posts: 2833
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

UHO 2024 released

Post by pohl4711 »

I am happy to announce, that I released my UHO 2024 Openings.

https://www.sp-cc.de/uho_2024.htm

Direct download:
https://www.sp-cc.de/files/uho_2024.7z

Whats new in UHO 2024:
The UHO 2024 opening sets are filtered out of the Megabase 2024 (by ChessBase). And the only filter, I am using, is the eval of KomodoDragon 3.3 in the endposition of each opening-line. And the UHO 2024 files are around +100% bigger than the UHO 2022 files, because the the Elo-limit was lowered to 2200 (instead of 2300 Elo in UHO 2022) (=both human players had to have an Elo of >= 2200).

What did I do exactly?
- sorted the games of the Megabase 2024 by Elo (using SCID)
- cutted all games after 6/8 moves (12/16 plies).
- removed all Chess960 games
- removed all lines with double endpositons, so each endposition is unique. And because the games are sorted by Elo of players, each opening line in the UHO-sets is played by the strongest players (if weaker players played the same opening line, this game was deleted by pgn-extract, because pgn-extract always keeps the first appearance of a line in a pgn-file) - removed all lines, were not both queens are still on board in the endposition.
After doing these work, there were 185983 6-moves deep opening-lines remaining and 532810 8-moves deep opening-lines remaining (all with unique endpositions).
Finally, these opening-lines were evaluated (endpositions) with KomodoDragon 3.3 (10 seconds per endposition on a 8 core AMD Ryzen CPU) and kept all endpositions in an eval interval of [-1.99;+1.99] (this is the UHO 2024 RawData (can be found in the download, too)). That took around 80 days of computing...

The UHO 2024 RawData can be very useful for other purposes, because it contains all opening-lines from very good for black to very good for white. Feel free to filter these openings as you like...The eval (and search depth) is stored in the Annotator-Tag of each line:
[Annotator "depth=29 eval=+114"]
You can use ChessBase or pgn-extract (for example) for searching. Examples of searching:
"eval=-05" finds all lines in an eval-interval of [-0.50;-0.59]
"eval=+00" finds all lines in an eval-interval of [+0.00;+0.09]
"eval=-1" finds all lines in an eval-interval of [-1.00;-1.99]

So the Unbalanced Human Openings contain:
- 100% moves played by humans, only. Both players had at least 2200 Elo.
- opening lines played by the stronges players are at the beginning of the pgn/epd-files.
- no manually constructed openings (like my Drawkiller openings)
- no manually added moves to make castling impossible (like my NBSC openings)
- no selection of piece-patterns

There are 8 folders with different UHO 2024 openings-sets, with increasing advantage for white:
*** IMPORTANT: *** KomodoDragon 3.3 shows evals, which are around -0.25 lower, than KomodoDragon 2.6 does, which I used for evaluating the UHO 2022 openings. So, the Eval-intervals in the new UHO 2024 are lower: UHO 2024 starts with Eval [+0.85;+0.94] instead of Eval [+1.10;+1.19] (UHO 2022).

Eval [+0.85;+0.94] 6mvs: 6696 lines 8mvs: 19303 lines 8mvs_big: 37622 lines
Eval [+0.90;+0.99] 6mvs: 6292 lines 8mvs: 17145 lines 8mvs_big: 33559 lines
Eval [+0.95;+1.04] 6mvs: 5238 lines 8mvs: 14256 lines 8mvs_big: 30372 lines
Eval [+1.00;+1.09] 6mvs: 4740 lines 8mvs: 13227 lines 8mvs_big: 25916 lines
Eval [+1.05;+1.14] 6mvs: 4125 lines 8mvs: 11660 lines 8mvs_big: 22828 lines
Eval [+1.10;+1.19] 6mvs: 3460 lines 8mvs: 9601 lines 8mvs_big: 20600 lines
Eval [+1.15;+1.24] 6mvs: 3161 lines 8mvs: 8940 lines 8mvs_big: 17470 lines
Eval [+1.20;+1.29] 6mvs: 2717 lines 8mvs: 7869 lines 8mvs_big: 15464 lines

Each folder contains 3 UHO openings-sets: 6 moves, 8 moves and a bigger 8 moves file with a bigger eval interval of 0.19 instead of 0.09.
As you can see, in UHO 2024 the Eval-stages "overlap" ([+0.85;+0.94] [+0.90;+0.99] for example)... the reason is, that the draw-ratio can be adjusted better: Each higher eval-stage of UHO 2024 lowers the draw-ratio around -5%. The idea is to adjust the draw-ratio of engine-tests and tournaments in a recommended interval of around 45%-60% by using a different UHO 2024 opening set.
At the moment, it is recommended to use the first UHO 2024 set with [+0.85;+0.94]. But if this set gives a too high draw-ratio, because of a very drawish test-environment (Stockfish vs. another Stockfish for example), you can use a higher UHO 2024 set, to shrink the draw-ratio.
Same for the computerchess in the future, where faster hardware and stronger engines will lead to increasing draw-ratio, too. Then using a higher UHO 2024 (more advantage for white) set can be useful.
But mention, that the draw-ratio should not get too low (below 45%), because this will lead to a lot of 1:1-pairs (= one opening line is clearly won for white, when Engine A and Engine B plays white in a head-to-head, both Engines win one game, using that opening-line (=1:1 points/pair)). If the draw-ratio in your engine-testings is below 45%, you should switch to a lower UHO 2024 set (=smaller advantage for white) otherwise you will shrink the Elo spreading of your test-results!!!
Mention, that the UHO 2024 files are getting smaller and smaller, the higher the Eval-interval is, because the games in the Megabase getting rarer and rarer, giving white such a huge advantage after 6/8 moves.
The UHO openings give white a clear advantage, so these openings can rescored to gamepairs using my Gampairs Rescorer Tool (included in the download)

Here the testing-results of UHO 2024 and some non-biased openings and one huge UHO_4060_v3 opening-set (used on Fishtest) for comparsion:

Code: Select all

Stockfish 16 vs. Torch 1, singlethread, 3min+1sec, 1000 games. Results from Stockfish 16 point of view.

For comparison:
Balanced openings:
SF_8moves_v3  :     1000 (+64,=916,-20),     Score: 52.2%, Elo: +15, Draws: 91.6%
Feobos-6m-v2.1:     1000 (+78,=911,-11),     Score: 53.4%, Elo: +24, Draws: 91.1%
UHO big file, used in Fishtest:
UHO_4060_v3   :     1000 (+375,=470,-155),   Score: 61.0%, Elo: +78, Draws: 47.0%

New UHO 2024:
6mvs_+085_+094:     1000 (+335,=569,- 96),   Score: 62.0%, Elo: +85, Draws: 56.9%
8mvs_+085_+094:     1000 (+347,=537,-116),   Score: 61.5%, Elo: +82, Draws: 53.7%
8mvs_big_+080_+099: 3000 (+1008,=1654,-338), Score: 61.2%, Elo: +80, Draws: 55.1%

6mvs_+090_+099:     1000 (+354,=525,-121),   Score: 61.6%, Elo: +83, Draws: 52.5%
8mvs_+090_+099:     1000 (+354,=502,-144),   Score: 60.5%, Elo: +75, Draws: 50.2%
8mvs_big_+085_+104: 3000 (+1097,=1453,-450), Score: 60.8%, Elo: +77, Draws: 48.4%
 
6mvs_+095_+104:     1000 (+380,=456,-164),   Score: 60.8%, Elo: +77, Draws: 45.6%
8mvs_+095_+104:     1000 (+415,=426,-159),   Score: 62.8%, Elo: +92, Draws: 42.6%
8mvs_big_+090_+109: 3000 (+1161,=1336,-503), Score: 61.0%, Elo: +78, Draws: 44.5%

6mvs_+100_+109:     1000 (+410,=403,-187),   Score: 61.1%, Elo: +79, Draws: 40.3%
8mvs_+100_+109:     1000 (+400,=404,-196),   Score: 60.2%, Elo: +73, Draws: 40.4%
8mvs_big_+095_+114: 3000 (+1222,=1205,-573), Score: 60.8%, Elo: +77, Draws: 40.2%

6mvs_+105_+114:     1000 (+425,=356,-219),   Score: 60.3%, Elo: +73, Draws: 35.6%
8mvs_+105_+114:     1000 (+430,=329,-241),   Score: 59.5%, Elo: +67, Draws: 32.9%
8mvs_big_+100_+119: 3000 (+1289,=1057,-654), Score: 60.6%, Elo: +75, Draws: 35.2%

Krzysztof Grzelak
Posts: 1586
Joined: Tue Jul 15, 2014 12:47 pm

Re: UHO 2024 released

Post by Krzysztof Grzelak »

I have a question. Can you make a book that does not exceed +0.45 for testing chess engines?
User avatar
pohl4711
Posts: 2833
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: UHO 2024 released

Post by pohl4711 »

Krzysztof Grzelak wrote: Sun Feb 25, 2024 7:58 am I have a question. Can you make a book that does not exceed +0.45 for testing chess engines?
I could, but because this makes IMO absolutely no sense in these days, I will not do it.
But the Rawdata is included in the download. Means all lines with endpositions in an eval-interval of [-1.99,+1.99].
It is very easy to filter out any evals, you want.
From the ReadMe:
The UHO 2024 RawData can be very useful for other purposes, because it contains all opening-lines from very good for black to very good for white. Feel free to filter these openings as you like...The eval (and search depth) is stored in the Annotator-Tag of each line:
[Annotator "depth=29 eval=+114"]
You can use ChessBase or pgn-extract (for example) for searching. Examples of searching:
"eval=-05" finds all lines in an eval-interval of [-0.50;-0.59]
"eval=+00" finds all lines in an eval-interval of [+0.00;+0.09]
"eval=-1" finds all lines in an eval-interval of [-1.00;-1.99]

After doing several filter-operations, just merge the found lines together in one pgn-file and sort it with SCID by Elo. Done.
Modern Times
Posts: 3770
Joined: Thu Jun 07, 2012 11:02 pm

Re: UHO 2024 released

Post by Modern Times »

There are always the SPCC IM 4moves book and SuperGM 4moves books. They are in fact the two most used books on the CCRL blitz list.
User avatar
pohl4711
Posts: 2833
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: UHO 2024 released

Post by pohl4711 »

Modern Times wrote: Sun Feb 25, 2024 10:29 am There are always the SPCC IM 4moves book and SuperGM 4moves books. They are in fact the two most used books on the CCRL blitz list.
These books are very old. I definitly do not recommend using them anymore. If anybody really wants to use balanced openings (i have no idea, why), I recommend the much newer and bigger ones from my website, because these openings were analyzed with KomodoDragon 1.0 (an early nnue-engine, so the evaluation is much better here!):

https://www.sp-cc.de/files/big_classica ... ections.7z

From the readme:
Classical human openings, balanced endpositions. Queens still on the board.
All lines filtered out of MegaBase 2020. No double endpositions.

KomodoDragon 1.0 analyzed each endposition on a QuadcorePC with 15 seconds thinking-time.
Allowed Eval [-0.39;+0.59]

4 different Sets:

6 moves deep:
2400+_6mvs_40k = 40720 different endpositions. Both players 2400 Elo or better
2600+_6mvs_9792 = 9792 different endpositions. Both players 2600 Elo or better

8 moves deep:
2400+_8mvs_100k = 106627 different endpositions. Both players 2400 Elo or better
2600+_8mvs_20k = 20981 different endpositions. Both players 2600 Elo or better

Files are sorted by Elo:
Both players 2600+ Elo followed by both players 2500+ Elo followed by both players 2400+ Elo
User avatar
Graham Banks
Posts: 44963
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: UHO 2024 released

Post by Graham Banks »

pohl4711 wrote: Sun Feb 25, 2024 10:41 amIf anybody really wants to use balanced openings (i have no idea, why).....
Different testers have different goals.

I prefer balanced chess openings mainly due to a love of chess the way that is usually played by the best human players, whereas you prefer your UHO openings to try and get more decisive games between the top engines.

It's all a matter of preference.
gbanksnz at gmail.com
Krzysztof Grzelak
Posts: 1586
Joined: Tue Jul 15, 2014 12:47 pm

Re: UHO 2024 released

Post by Krzysztof Grzelak »

pohl4711 wrote: Sun Feb 25, 2024 10:23 am I could, but because this makes IMO absolutely no sense in these days, I will not do it.
But the Rawdata is included in the download. Means all lines with endpositions in an eval-interval of [-1.99,+1.99].
It is very easy to filter out any evals, you want.
From the ReadMe:
The UHO 2024 RawData can be very useful for other purposes, because it contains all opening-lines from very good for black to very good for white. Feel free to filter these openings as you like...The eval (and search depth) is stored in the Annotator-Tag of each line:
[Annotator "depth=29 eval=+114"]
You can use ChessBase or pgn-extract (for example) for searching. Examples of searching:
"eval=-05" finds all lines in an eval-interval of [-0.50;-0.59]
"eval=+00" finds all lines in an eval-interval of [+0.00;+0.09]
"eval=-1" finds all lines in an eval-interval of [-1.00;-1.99]

After doing several filter-operations, just merge the found lines together in one pgn-file and sort it with SCID by Elo. Done.
Please do this to other people as well. I will be very grateful.
chesskobra
Posts: 358
Joined: Thu Jul 21, 2022 12:30 am
Full name: Chesskobra

Re: UHO 2024 released

Post by chesskobra »

pohl4711 wrote: Sun Feb 25, 2024 10:23 am
Krzysztof Grzelak wrote: Sun Feb 25, 2024 7:58 am I have a question. Can you make a book that does not exceed +0.45 for testing chess engines?
You can use ChessBase or pgn-extract (for example) for searching. Examples of searching:
"eval=-05" finds all lines in an eval-interval of [-0.50;-0.59]
"eval=+00" finds all lines in an eval-interval of [+0.00;+0.09]
"eval=-1" finds all lines in an eval-interval of [-1.00;-1.99]

After doing several filter-operations, just merge the found lines together in one pgn-file and sort it with SCID by Elo. Done.
To get all games with eval -0.49 to 0.49, I write the following lines in a file, say tagfile:

Code: Select all

Annotator =~ ".* eval=-04"
Annotator =~ ".* eval=-03"
Annotator =~ ".* eval=-02"
Annotator =~ ".* eval=-01"
Annotator =~ ".* eval=-00"
Annotator =~ ".* eval=+00"
Annotator =~ ".* eval=+01"
Annotator =~ ".* eval=+02"
Annotator =~ ".* eval=+03"
Annotator =~ ".* eval=+04"
and then

Code: Select all

pgn-extract -t tagfile in.pgn -o out.pgn
Krzysztof Grzelak
Posts: 1586
Joined: Tue Jul 15, 2014 12:47 pm

Re: UHO 2024 released

Post by Krzysztof Grzelak »

chesskobra wrote: Sun Feb 25, 2024 12:06 pm To get all games with eval -0.49 to 0.49, I write the following lines in a file, say tagfile:

Code: Select all

Annotator =~ ".* eval=-04"
Annotator =~ ".* eval=-03"
Annotator =~ ".* eval=-02"
Annotator =~ ".* eval=-01"
Annotator =~ ".* eval=-00"
Annotator =~ ".* eval=+00"
Annotator =~ ".* eval=+01"
Annotator =~ ".* eval=+02"
Annotator =~ ".* eval=+03"
Annotator =~ ".* eval=+04"
and then

Code: Select all

pgn-extract -t tagfile in.pgn -o out.pgn
Such a request for you. I don't know anything about the application pgn extract. Can you do this for me and set -0.45 and 0.45. And share - I will be very grateful and thank you in advance.
chesskobra
Posts: 358
Joined: Thu Jul 21, 2022 12:30 am
Full name: Chesskobra

Re: UHO 2024 released

Post by chesskobra »

I have uploaded it to git lab; let me know when you download it, so I will delete it.
https://gitlab.com/beejaganita/chess-data
But I suggest do learn to use pgn-extract, it is very useful and easy to use.