I think that even if Texel's TB probing strategy is ideal, the result is not ideal because it also depends on how efficient the regular search is. I think that if texel's TB probing strategy was implemented in stockfish, it would likely get lower than 47.80 moves to mate on average for this test suite.Laskos wrote:The ideal play exhibited by Texel 1.07 + Syzygy-5-men + Gaviota-5-men shows average length to Mate of 47.80 moves. I will now post a table of "efficiency" or "length to Mate" of top engines enabled with Syzygy-5-men. The time control is 1 second per move on these 225 hard 5-men Wins.
Code: Select all
Engine Moves to Mate ------------------------------------------ Ideal play 47.80 Houdini 6.03 59.43 Stockfish 9 (Ronald patch) 63.71 Komodo 11.2.2 64.57 Stockfish 8 68.25 ------------------------------------------
Syzygy implementations of top engines
Moderators: hgm, Rebel, chrisw
-
- Posts: 688
- Joined: Mon Apr 19, 2010 7:07 pm
- Location: Sweden
- Full name: Peter Osterlund
Re: Syzygy implementations of top engines
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Syzygy implementations of top engines
Ok, I thought that having 5-men DTZ50 and DTM can give perfect (shortest) play on 5-men at root wins. Well, if it depends on the search, then you are surely right, and I should have replaced "Ideal play" with "Texel probing play".petero2 wrote:I think that even if Texel's TB probing strategy is ideal, the result is not ideal because it also depends on how efficient the regular search is. I think that if texel's TB probing strategy was implemented in stockfish, it would likely get lower than 47.80 moves to mate on average for this test suite.Laskos wrote:The ideal play exhibited by Texel 1.07 + Syzygy-5-men + Gaviota-5-men shows average length to Mate of 47.80 moves. I will now post a table of "efficiency" or "length to Mate" of top engines enabled with Syzygy-5-men. The time control is 1 second per move on these 225 hard 5-men Wins.
Code: Select all
Engine Moves to Mate ------------------------------------------ Ideal play 47.80 Houdini 6.03 59.43 Stockfish 9 (Ronald patch) 63.71 Komodo 11.2.2 64.57 Stockfish 8 68.25 ------------------------------------------
-
- Posts: 688
- Joined: Mon Apr 19, 2010 7:07 pm
- Location: Sweden
- Full name: Peter Osterlund
Re: Syzygy implementations of top engines
It certainly can happen, but I don't know if it actually did happen in your test. You could try letting texel search some of the hardest positions for significantly longer than 1 second to see if it finds shorter mates than it did after 1 second.Laskos wrote:Ok, I thought that having 5-men DTZ50 and DTM can give perfect (shortest) play on 5-men at root wins. Well, if it depends on the search, then you are surely right, and I should have replaced "Ideal play" with "Texel probing play".petero2 wrote:I think that even if Texel's TB probing strategy is ideal, the result is not ideal because it also depends on how efficient the regular search is. I think that if texel's TB probing strategy was implemented in stockfish, it would likely get lower than 47.80 moves to mate on average for this test suite.
The problematic case happens when DTZ50 < 100ply but DTM > 100ply. Following DTZ50 blindly could lead to an unnecessary long path to mate, and following DTM blindly could lead to a draw by the 50-move rule. In these cases search is needed to find the best "mix" of the two strategies, and you could potentially need a very deep search to find the DTM50 optimal strategy.
-
- Posts: 2821
- Joined: Fri Sep 25, 2015 9:38 pm
- Location: Sortland, Norway
Re: Syzygy implementations of top engines
Kai Laskos: DTM50 give shortest mates + enforcing 50-move rule. Unfortunately DTM50 increase size enormously.
5-men DTM50 ~ 100 GB | Who want to allocate so much SSD space for 5-men bases?
5-men DTM50 ~ 100 GB | Who want to allocate so much SSD space for 5-men bases?
-
- Posts: 12540
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Syzygy implementations of top engines
You can buy a 2 TB SSD for about $360. In ten years, it will be 2 PB for $360 (give or take).Nordlandia wrote:Kai Laskos: DTM50 give shortest mates + enforcing 50-move rule. Unfortunately DTM50 increase size enormously.
5-men DTM50 ~ 100 GB | Who want to allocate so much SSD space for 5-men bases?
Within 10 years I hope to have the syzygy 7 man DTM files built and operational on SSD. I guess it will be something like a NAS motherboard with a big mess of m.2 gumstick SSDs.
I just bought some of these:
https://serverpartdeals.com/micron-mtfd ... 06EALw_wcB
Cheap at twice the price.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 688
- Joined: Mon Apr 19, 2010 7:07 pm
- Location: Sweden
- Full name: Peter Osterlund
Re: Syzygy implementations of top engines
I don't know if someone has made a serious attempt at creating a good compression scheme for DTM50 tables. It seems you could get really good compression by predicting that the value for hmc+1 is the same as for hmc and only encode the deviations.Nordlandia wrote:5-men DTM50 ~ 100 GB | Who want to allocate so much SSD space for 5-men bases?
Also for short mates there could be a lot of "don't care" values in the table. For example if a position is mate in 10 at hmc=0, you know that it is mate in 10 for all hmc<80, so all those positions can be represented by a "don't care" value in the tables.
Similarly for draws. If a position is drawn at hmc=0, it is also drawn for all hmc>0 so all those values can be represented by "don't care" values.
-
- Posts: 2821
- Joined: Fri Sep 25, 2015 9:38 pm
- Location: Sortland, Norway
Re: Syzygy implementations of top engines
Peter Österlund: better ask Ronald about compression improvement for DTM50 but he said about 100 times larger than regular 5-man bases.
Link: http://galen.metapath.org/egtb50/
Link: http://galen.metapath.org/egtb50/
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Syzygy implementations of top engines
I tested at 5s/move, but the average came a bit larger, 47.96 moves compared to 47.80 moves at 1s/move on these 225 positions.petero2 wrote:It certainly can happen, but I don't know if it actually did happen in your test. You could try letting texel search some of the hardest positions for significantly longer than 1 second to see if it finds shorter mates than it did after 1 second.Laskos wrote:Ok, I thought that having 5-men DTZ50 and DTM can give perfect (shortest) play on 5-men at root wins. Well, if it depends on the search, then you are surely right, and I should have replaced "Ideal play" with "Texel probing play".petero2 wrote:I think that even if Texel's TB probing strategy is ideal, the result is not ideal because it also depends on how efficient the regular search is. I think that if texel's TB probing strategy was implemented in stockfish, it would likely get lower than 47.80 moves to mate on average for this test suite.
The problematic case happens when DTZ50 < 100ply but DTM > 100ply. Following DTZ50 blindly could lead to an unnecessary long path to mate, and following DTM blindly could lead to a draw by the 50-move rule. In these cases search is needed to find the best "mix" of the two strategies, and you could potentially need a very deep search to find the DTM50 optimal strategy.
Here are the number of position and the length in moves to Mate, they are different quite often form 1s to 5s, but the average on 225 positions is very close.
187 identical lengths
38 different lengths
Code: Select all
1s / move
{{1, 56}, {2, 81}, {3, 50}, {4, 47}, {5, 43}, {6, 42}, {7, 41}, {8,
40}, {9, 96}, {10, 62}, {11, 55}, {12, 86}, {13, 67}, {14, 59}, {15,
49}, {16, 48}, {17, 54}, {18, 46}, {19, 53}, {20, 52}, {21,
51}, {22, 50}, {23, 49}, {24, 48}, {25, 44}, {26, 40}, {27,
46}, {28, 45}, {29, 44}, {30, 43}, {31, 49}, {32, 48}, {33,
47}, {34, 47}, {35, 47}, {36, 48}, {37, 47}, {38, 47}, {39,
48}, {40, 48}, {41, 47}, {42, 48}, {43, 48}, {44, 43}, {45,
44}, {46, 43}, {47, 44}, {48, 44}, {49, 44}, {50, 44}, {51,
43}, {52, 42}, {53, 41}, {54, 41}, {55, 42}, {56, 23}, {57,
50}, {58, 49}, {59, 45}, {60, 44}, {61, 45}, {62, 46}, {63,
47}, {64, 46}, {65, 45}, {66, 44}, {67, 42}, {68, 41}, {69,
40}, {70, 53}, {71, 52}, {72, 40}, {73, 47}, {74, 48}, {75,
49}, {76, 49}, {77, 48}, {78, 48}, {79, 49}, {80, 49}, {81,
49}, {82, 49}, {83, 49}, {84, 49}, {85, 48}, {86, 47}, {87,
46}, {88, 47}, {89, 45}, {90, 44}, {91, 43}, {92, 42}, {93,
40}, {94, 41}, {95, 40}, {96, 49}, {97, 49}, {98, 48}, {99,
47}, {100, 43}, {101, 49}, {102, 46}, {103, 52}, {104, 52}, {105,
53}, {106, 62}, {107, 74}, {108, 45}, {109, 62}, {110, 65}, {111,
59}, {112, 48}, {113, 47}, {114, 43}, {115, 41}, {116, 40}, {117,
40}, {118, 40}, {119, 59}, {120, 63}, {121, 58}, {122, 75}, {123,
41}, {124, 40}, {125, 41}, {126, 40}, {127, 36}, {128, 32}, {129,
31}, {130, 30}, {131, 49}, {132, 48}, {133, 47}, {134, 46}, {135,
47}, {136, 44}, {137, 42}, {138, 43}, {139, 54}, {140, 53}, {141,
45}, {142, 58}, {143, 55}, {144, 50}, {145, 49}, {146, 48}, {147,
63}, {148, 43}, {149, 42}, {150, 40}, {151, 41}, {152, 40}, {153,
60}, {154, 59}, {155, 53}, {156, 51}, {157, 50}, {158, 45}, {159,
48}, {160, 42}, {161, 41}, {162, 41}, {163, 40}, {164, 43}, {165,
50}, {166, 49}, {167, 51}, {168, 65}, {169, 55}, {170, 60}, {171,
41}, {172, 40}, {173, 41}, {174, 40}, {175, 47}, {176, 47}, {177,
42}, {178, 43}, {179, 44}, {180, 47}, {181, 46}, {182, 47}, {183,
46}, {184, 45}, {185, 44}, {186, 43}, {187, 42}, {188, 42}, {189,
41}, {190, 40}, {191, 43}, {192, 42}, {193, 41}, {194, 42}, {195,
41}, {196, 40}, {197, 41}, {198, 40}, {199, 58}, {200, 57}, {201,
51}, {202, 50}, {203, 49}, {204, 48}, {205, 46}, {206, 48}, {207,
41}, {208, 40}, {209, 41}, {210, 40}, {211, 89}, {212, 46}, {213,
44}, {214, 42}, {215, 41}, {216, 40}, {217, 62}, {218, 61}, {219,
62}, {220, 42}, {221, 40}, {222, 42}, {223, 77}, {224, 59}, {225,
51}}
5s / move
{{1, 51}, {2, 74}, {3, 50}, {4, 47}, {5, 43}, {6, 42}, {7, 41}, {8,
40}, {9, 88}, {10, 62}, {11, 52}, {12, 77}, {13, 71}, {14, 77}, {15,
49}, {16, 48}, {17, 53}, {18, 46}, {19, 53}, {20, 52}, {21,
51}, {22, 50}, {23, 49}, {24, 48}, {25, 44}, {26, 40}, {27,
46}, {28, 45}, {29, 44}, {30, 43}, {31, 49}, {32, 48}, {33,
47}, {34, 47}, {35, 47}, {36, 48}, {37, 47}, {38, 47}, {39,
48}, {40, 48}, {41, 47}, {42, 48}, {43, 48}, {44, 43}, {45,
44}, {46, 43}, {47, 44}, {48, 44}, {49, 44}, {50, 44}, {51,
43}, {52, 42}, {53, 41}, {54, 41}, {55, 42}, {56, 23}, {57,
50}, {58, 49}, {59, 45}, {60, 44}, {61, 45}, {62, 46}, {63,
47}, {64, 46}, {65, 45}, {66, 44}, {67, 42}, {68, 41}, {69,
40}, {70, 53}, {71, 52}, {72, 40}, {73, 47}, {74, 48}, {75,
49}, {76, 49}, {77, 48}, {78, 48}, {79, 49}, {80, 49}, {81,
49}, {82, 49}, {83, 49}, {84, 49}, {85, 48}, {86, 47}, {87,
46}, {88, 47}, {89, 45}, {90, 44}, {91, 43}, {92, 42}, {93,
40}, {94, 41}, {95, 40}, {96, 49}, {97, 49}, {98, 48}, {99,
47}, {100, 43}, {101, 49}, {102, 46}, {103, 59}, {104, 58}, {105,
54}, {106, 65}, {107, 77}, {108, 45}, {109, 54}, {110, 62}, {111,
65}, {112, 48}, {113, 47}, {114, 43}, {115, 41}, {116, 40}, {117,
40}, {118, 40}, {119, 58}, {120, 63}, {121, 61}, {122, 71}, {123,
41}, {124, 40}, {125, 41}, {126, 40}, {127, 36}, {128, 32}, {129,
31}, {130, 30}, {131, 49}, {132, 48}, {133, 47}, {134, 46}, {135,
47}, {136, 44}, {137, 42}, {138, 43}, {139, 57}, {140, 56}, {141,
45}, {142, 56}, {143, 61}, {144, 50}, {145, 49}, {146, 48}, {147,
64}, {148, 43}, {149, 42}, {150, 40}, {151, 41}, {152, 40}, {153,
54}, {154, 59}, {155, 74}, {156, 78}, {157, 50}, {158, 45}, {159,
48}, {160, 42}, {161, 41}, {162, 41}, {163, 40}, {164, 43}, {165,
50}, {166, 49}, {167, 51}, {168, 60}, {169, 58}, {170, 62}, {171,
41}, {172, 40}, {173, 41}, {174, 40}, {175, 47}, {176, 47}, {177,
42}, {178, 43}, {179, 44}, {180, 47}, {181, 46}, {182, 47}, {183,
46}, {184, 45}, {185, 44}, {186, 43}, {187, 42}, {188, 42}, {189,
41}, {190, 40}, {191, 43}, {192, 42}, {193, 41}, {194, 42}, {195,
41}, {196, 40}, {197, 41}, {198, 40}, {199, 55}, {200, 56}, {201,
51}, {202, 50}, {203, 49}, {204, 48}, {205, 46}, {206, 48}, {207,
41}, {208, 40}, {209, 41}, {210, 40}, {211, 82}, {212, 46}, {213,
44}, {214, 42}, {215, 41}, {216, 40}, {217, 63}, {218, 62}, {219,
58}, {220, 42}, {221, 40}, {222, 42}, {223, 71}, {224, 61}, {225,
51}}
-
- Posts: 5566
- Joined: Tue Feb 28, 2012 11:56 pm
Re: Syzygy implementations of top engines
I only said the uncompressed tables are 100x as large.Nordlandia wrote:Peter Österlund: better ask Ronald about compression improvement for DTM50 but he said about 100 times larger than regular 5-man bases.
-
- Posts: 2821
- Joined: Fri Sep 25, 2015 9:38 pm
- Location: Sortland, Norway
Re: Syzygy implementations of top engines
Is it possible to calculate rough estimation for compressed 5-men bases?syzygy wrote:I only said the uncompressed tables are 100x as large.Nordlandia wrote:Peter Österlund: better ask Ronald about compression improvement for DTM50 but he said about 100 times larger than regular 5-man bases.