i7-3930K CPUs 4.25 GHz 90'+30" TC 1 core for all engines Ponder off 1024 Hash 3-4-5 EGTBs (when available) in SSDs 150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on the last recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match Games available for download, including eval/time/depth and PV for each move
Aser Huerga wrote: AH_LTC Match: Houdini 3 vs Stockfish_SZ 13110122
i7-3930K CPUs 4.25 GHz 90'+30" TC 1 core for all engines Ponder off 1024 Hash 3-4-5 EGTBs (when available) in SSDs 150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on the last recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match Games available for download, including eval/time/depth and PV for each move
Your results are reasonably consistent with my contention that both Stockfish and Komodo scale much better than Houdini 3. Komodo 6 made a much better score in your test than Houdini 3 did, although Houdini 3 is ahead on all of the short-time limit rating lists. Stockfish (any version around end of October) is now quite a bit stronger than Komodo 6 in my bullet testing (though behind the latest Komodo version as playing in TCEC) so the winning result for Stockfish at long time control suggests no significant difference in scaling between SF and Komodo. Unless Houdini 4 is a big improvement over Houdini 3, it appears that it is relegated to third place.
Aser Huerga wrote: AH_LTC Match: Houdini 3 vs Stockfish_SZ 13110122
i7-3930K CPUs 4.25 GHz 90'+30" TC 1 core for all engines Ponder off 1024 Hash 3-4-5 EGTBs (when available) in SSDs 150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on the last recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match Games available for download, including eval/time/depth and PV for each move
Your results are reasonably consistent with my contention that both Stockfish and Komodo scale much better than Houdini 3. Komodo 6 made a much better score in your test than Houdini 3 did, [Komodo lost by 1,8 % less...]
although Houdini 3 is ahead on all of the short-time limit rating lists. [Houdini is still ahead on all of the ratinglists...]
Stockfish (any version around end of October) is now quite a bit stronger than Komodo 6 in my bullet testing (though behind the latest Komodo version as playing in TCEC) [at LS (bullet)list, SF_0211 scores 529 out of 1000 is 52,9% against Komodo 6. In Aser Huergas LTC test, SF scores 54,67%
If 1,8% is a "much bigger score" than this difference of 1,8% between score of Komodo at bullet and at LTC against Stockfish this should be nothing else than significant difference in scaling between SF and Komodo]
so the winning result for Stockfish at long time control suggests no significant difference in scaling between SF and Komodo. Unless Houdini 4 is a big improvement over Houdini 3, it appears that it is relegated to third place.
Aser Huerga wrote: AH_LTC Match: Houdini 3 vs Stockfish_SZ 13110122
i7-3930K CPUs 4.25 GHz 90'+30" TC 1 core for all engines Ponder off 1024 Hash 3-4-5 EGTBs (when available) in SSDs 150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on the last recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match Games available for download, including eval/time/depth and PV for each move
Your results are reasonably consistent with my contention that both Stockfish and Komodo scale much better than Houdini 3. Komodo 6 made a much better score in your test than Houdini 3 did, [Komodo lost by 1,8 % less...]
although Houdini 3 is ahead on all of the short-time limit rating lists. [Houdini is still ahead on all of the ratinglists...]
Stockfish (any version around end of October) is now quite a bit stronger than Komodo 6 in my bullet testing (though behind the latest Komodo version as playing in TCEC) [at LS (bullet)list, SF_0211 scores 529 out of 1000 is 52,9% against Komodo 6. In Aser Huergas LTC test, SF scores 54,67%
If 1,8% is a "much bigger score" than this difference of 1,8% between score of Komodo at bullet and at LTC against Stockfish this should be nothing else than significant difference in scaling between SF and Komodo]
so the winning result for Stockfish at long time control suggests no significant difference in scaling between SF and Komodo. Unless Houdini 4 is a big improvement over Houdini 3, it appears that it is relegated to third place.
1.8 % difference is about 12 1/2 elo. Komodo is now ahead of Houdini and Stockfish on the only long-time control list I know of that includes recent versions, the TCEC. I readily admit that Houdini is still number one at blitz.
