Testing Stockfish vs Houdinis 1.5, 2, 3 and 4

[felix]

Code: Select all

Level: Blitz 0:30/0,5
No opening book
Hardware: Intel(R) Core(TM) i3-2310M CPU @ 2.10GHz with 2,7 GB Memory
Operating system: Windows 7 Home Basic Home Edition Service Pack 1 (Build 7601) 32 bit
Table created with: Arena 3.5
Avg: 22 games/hour

The ones with -1 or better continues

All eliminated!

    Engine                              Score                                                     Ho
01: Houdini_4.0_Pro_w32-v1x             113,0/142 ·················································· 
02: Stockfish_13020311_32bit            4,0/10    =0=1=001=0                                         
03: Stockfish_13020309_32bit_1359878912 3,5/10    =101==0000                                         
04: Stockfish_13020207_32bit            2,5/8     0101=000                                           
05: Stockfish_13021612_32bit            2,0/6     010=0=                                             
05: Stockfish_13021920_32bit            2,0/6     0=010=                                             
07: Stockfish_13020910_32bit_1360403738 1,5/6     =00100                                             
07: Stockfish_13022107_32bit            1,5/6     01=000                                             
09: Stockfish_13020422_32bit_1360015160 1,0/4     =0=0                                               
09: Stockfish_13020620_32bit            1,0/4     =0=0                                               
09: Stockfish_13020811_32bit            1,0/4     0100                                               
09: Stockfish_13020206_32bit_1359783665 1,0/4     =00=                                               
09: Stockfish_13021320_32bit_1360782836 1,0/4     0==0                                               
09: Stockfish_13020309_32bit_1359879784 1,0/4     =00=                                               
09: Stockfish_13020217_32bit            1,0/4     0=0=                                               
09: Stockfish_13022105_32bit            1,0/4     0==0                                               
09: Stockfish_13020422_32bit_1360011641 1,0/4     0=0=                                               
09: Stockfish_13022317_32bit            1,0/4     =0=0                                               
19: Stockfish_13022012_32bit            0,5/4     0=00                                               
19: Stockfish_13020607_32bit            0,5/4     0=00                                               
19: Stockfish_13020422_32bit_1360012624 0,5/4     0=00                                               
19: Stockfish_13021320_32bit_1360782824 0,5/4     =000                                               
23: Stockfish_13020910_32bit_1360403720 0,0/2     00                                                 
23: Stockfish_13020506_32bit            0,0/2     00                                                 
23: Stockfish_13020916_32bit            0,0/2     00                                                 
23: Stockfish_13021100_32bit            0,0/2     00                                                 
23: Stockfish_13020206_32bit_1359783844 0,0/2     00                                                 
23: Stockfish_13020608_32bit            0,0/2     00                                                 
23: Stockfish_13021511_32bit            0,0/2     00                                                 
23: Stockfish_13021516_32bit            0,0/2     00                                                 
23: Stockfish_13020310_32bit            0,0/2     00                                                 
23: Stockfish_13021907_32bit            0,0/2     00                                                 
23: Stockfish_13020706_32bit            0,0/2     00                                                 
23: Stockfish_13020809_32bit            0,0/2     00                                                 
23: Stockfish_13020810_32bit            0,0/2     00                                                 
23: Stockfish_13020216_32bit            0,0/2     00                                                 
23: Stockfish_13020907_32bit            0,0/2     00                                                 
23: Stockfish_13022319_32bit            0,0/2     00                                                 
23: Stockfish_13022708_32bit            0,0/2     00                                                 

[Ajedrecista]

Hello Félix:

113/142 in various Houdini vs. SF matches looks suspicious to me. Are you sure that both Houdini and SF used the same number of cores? Please remember that the default number of cores used by Houdini is the number of physical cores of your PC while lastest versions of SF have their default to only one.

Thanks for your tests!

Regards from Spain.

Ajedrecista.

[felix]

Hi Jesús

Thanks for your input.

Same conditions for everyone, thats why i removed the opening books. Arena 3.0 has a little bug where Houdini (was the only engine with that problem) use all the default cores on a tournament. That was fixed in Arena 3.5.

This tests until now are about old versions of Stockfish, very weak and not a single surprise. Of course, Houdini at fast time controls is very strong.

After 201305 thinks started to be a bit difficult to Houdini and after 201310 is suffering quite a lot.

About the time control
30 initial seconds because i am not using books.
500 ms increment because if I use less, older stockfish versions starts to give pieces like candies or allowing ridiculous checkmates.

I believe the time control is fair. Not too fast. I can sit an enjoy a good game of chess instead of TV.

A lot of fun!

Best wishes

[felix]

Code: Select all

Level: Blitz 0:30/0,5
No opening book
Hardware: Intel(R) Core(TM) i3-2310M CPU @ 2.10GHz with 2,7 GB Memory
Operating system: Windows 7 Home Basic Home Edition Service Pack 1 (Build 7601) 32 bit
Table created with: Arena 3.5
Avg: 22 games/hour

The ones with -1 or better continues

    Engine                              Score                          Ho
1: Houdini_4.0_Pro_w32-v1x             40,0/78 ·················································· 

Continues!

2: Stockfish_14032911_32bit            15,5/26 11=0110=1100110===11=1010=                         

Eliminated!

3: Stockfish_14032910_32bit            11,0/24 110110=1=11=000=00==0=0=                           
4: Stockfish_14032908_32bit_1396078675 6,5/16  =1=1==000101=000                                   
5: Stockfish_14032908_32bit_1396079140 5,0/12  0=1110==00=0                                       

[felix]

Code: Select all

Level: Blitz 0:30/0,5
No opening book
Hardware: Intel(R) Core(TM) i3-2310M CPU @ 2.10GHz with 2,7 GB Memory
Operating system: Windows 7 Home Basic Home Edition Service Pack 1 (Build 7601) 32 bit
Table created with: Arena 3.5
Avg: 22 games/hour

The ones with -1 or better continues

All eliminated!

    Engine                              Score                                                    Ho
01: Houdini_4.0_Pro_w32-v1x             79,0/106 ·················································· 
02: Stockfish_13032520_32bit            4,5/12   0111010=0000                                       
03: Stockfish_13031119_32bit            4,0/10   =1==1=0000                                         
04: Stockfish_13031919_32bit            3,0/8    1=01=000                                           
05: Stockfish_13030409_32bit_1362385620 2,0/6    100==0                                             
05: Stockfish_13030409_32bit_1362385786 2,0/6    ==0100                                             
05: Stockfish_13030409_32bit_1362386516 2,0/6    010==0                                             
05: Stockfish_13033022_32bit            2,0/6    =0010=                                             
09: Stockfish_13031509_32bit            1,5/6    010=00                                             
09: Stockfish_13030109_32bit            1,5/6    =00100                                             
11: Stockfish_13030408_32bit_1362383544 1,0/4    0=0=                                               
11: Stockfish_13032321_32bit            1,0/4    0==0                                               
11: Stockfish_13030108_32bit            1,0/4    0=0=                                               
11: Stockfish_13030213_32bit_1362226130 1,0/4    0=0=                                               
15: Stockfish_13030409_32bit_1362384468 0,5/4    0=00                                               
16: Stockfish_13030107_32bit            0,0/2    00                                                 
16: Stockfish_13031611_32bit_1363428755 0,0/2    00                                                 
16: Stockfish_13031611_32bit_1363429203 0,0/2    00                                                 
16: Stockfish_13031820_32bit            0,0/2    00                                                 
16: Stockfish_13030213_32bit_1362226840 0,0/2    00                                                 
16: Stockfish_13032312_32bit            0,0/2    00                                                 
16: Stockfish_13030408_32bit_1362382255 0,0/2    00                                                 
16: Stockfish_13032423_32bit            0,0/2    00                                                 
16: Stockfish_13031122_32bit            0,0/2    00                                                 
16: Stockfish_13031219_32bit            0,0/2    00                                                 

[felix]

Code: Select all

Level: Blitz 0:30/0,5
No opening book
Hardware: Intel(R) Core(TM) i3-2310M CPU @ 2.10GHz with 2,7 GB Memory
Operating system: Windows 7 Home Basic Home Edition Service Pack 1 (Build 7601) 32 bit
Table created with: Arena 3.5
Avg: 22 games/hour

The ones with -1 or better continues

All eliminated!

    Engine                              Score                                                    Ho
01: Houdini_4.0_Pro_w32-v1x             90,5/118 ·················································· 
02: Stockfish_13040711_32bit_1365327951 3,0/8    01=0010=                                           
03: Stockfish_13040710_32bit            2,5/8    ===01000                                           
03: Stockfish_13040508_32bit            2,5/8    ==0===00                                           
05: Stockfish_13040421_32bit            2,0/6    010=0=                                             
05: Stockfish_13040516_32bit            2,0/6    100==0                                             
05: Stockfish_13041910_32bit            2,0/6    0=010=                                             
05: Stockfish_13042510_32bit            2,0/6    0====0                                             
09: Stockfish_13042612_32bit            1,5/6    =00100                                             
10: Stockfish_13041423_32bit            1,0/4    0=0=                                               
10: Stockfish_13040711_32bit_1365327943 1,0/4    0=0=                                               
10: Stockfish_13040923_32bit_1365543117 1,0/4    0=0=                                               
10: Stockfish_13042521_32bit            1,0/4    =00=                                               
10: Stockfish_13040923_32bit_1365543126 1,0/4    1000                                               
10: Stockfish_13042713_32bit            1,0/4    0100                                               
10: Stockfish_13043019_32bit_1367343763 1,0/4    0100                                               
10: Stockfish_13043020_32bit            1,0/4    ==00                                               
18: Stockfish_13042512_32bit_1366887457 0,5/4    =000                                               
18: Stockfish_13042900_32bit            0,5/4    0=00                                               
18: Stockfish_13042512_32bit_1366884300 0,5/4    0=00                                               
18: Stockfish_13042512_32bit_1366884797 0,5/4    =000                                               
22: Stockfish_13041909_32bit            0,0/2    00                                                 
22: Stockfish_13040607_32bit            0,0/2    00                                                 
22: Stockfish_13042619_32bit            0,0/2    00                                                 
22: Stockfish_13040319_32bit            0,0/2    00                                                 
22: Stockfish_13041022_32bit_1365625240 0,0/2    00                                                 
22: Stockfish_13043019_32bit_1367343741 0,0/2    00                                                 
22: Stockfish_13041022_32bit_1365625428 0,0/2    00                                                 
22: Stockfish_13040723_32bit            0,0/2    00                                                 

[ernest]

I think nobody understands what you are showing...

Which explains the complete absence of discussion in this thread!

[felix]

Hi Ernest

Just for fun, i want to know of the all stockfish releases the ones who can survive n*2 (where n= 1,2,..,oo) rounds against Houdini 4. The tournament will stop when ALL the stockfish remaining have +5 or more.

So i'm doing a tournament with all stockfish releases from the very beginning until forever against Houdini 4 with learning on (can't find the stockfish option)

Rules

Time 30s initial time 500 ms increment
No books

Every stockfish release, to continue, has to survive an even number of games (2, 4,..., 2*n, where n = 1, 2,...oo) without getting a -2 score.

00 := -2 := out
0= := -1 := continue
0=0= := -2 := out
0=01 := -1 := cotinue
0=01=0 :=-2 := out
0=01== := -1 := continue
11 := +2 := continue

etc

The survivors will play a round robin tournament with all the houdinis i have and komodo.

Best regards

[felix]

Code: Select all

Level: Blitz 0:30/0,5
No opening book
Hardware: Intel(R) Core(TM) i3-2310M CPU @ 2.10GHz with 2,7 GB Memory
Operating system: Windows 7 Home Basic Home Edition Service Pack 1 (Build 7601) 32 bit
Table created with: Arena 3.5
Avg: 22 games/hour

The ones with -1 or better continues

All eliminated!

    Engine                              Score                                                         Ho
01: Houdini_4.0_Pro_w32-v1x             120.0/166 ······················································ 
02: Stockfish_13050512_32bit_1367749631 9.5/22    0=01==110011=0=01==000                                 
03: Stockfish_13050411_32bit            4.0/10    0===01010=                                             
04: Stockfish_13050512_32bit_1367749892 3.5/10    1=100==000                                             
05: Stockfish_13050412_32bit            3.0/8     =0==010=                                               
05: Stockfish_13051111_32bit_1368263586 3.0/8     0=1=0=0=                                               
05: Stockfish_13051423_32bit            3.0/8     010===0=                                               
05: Stockfish_13053109_32bit            3.0/8     =0=1=0=0                                               
09: Stockfish_13051921_32bit_1368992183 2.5/8     010=0100                                               
10: Stockfish_13051111_32bit_1368265784 2.0/6     0=100=                                                 
10: Stockfish_13051500_32bit_1368569171 2.0/6     0=010=                                                 
10: Stockfish_13051222_32bit            2.0/6     ==0100                                                 
10: Stockfish_13051319_32bit            2.0/6     1=0=00                                                 
14: Stockfish_13051913_32bit            1.5/6     =0==00                                                 
15: Stockfish_13050513_32bit            1.0/4     ==00                                                   
15: Stockfish_13050823_32bit            1.0/4     1000                                                   
15: Stockfish_13052512_32bit_1369478294 1.0/4     0=0=                                                   
15: Stockfish_13051520_32bit            1.0/4     0==0                                                   
19: Stockfish_13051500_32bit_1368570845 0.5/4     =000                                                   
19: Stockfish_13050209_32bit            0.5/4     0=00                                                   
21: Stockfish_13050522_32bit            0.0/2     00                                                     
21: Stockfish_13050123_32bit            0.0/2     00                                                     
21: Stockfish_13050919_32bit            0.0/2     00                                                     
21: Stockfish_130501_3-32-ja            0.0/2     00                                                     
21: Stockfish_13051616_32bit            0.0/2     00                                                     
21: Stockfish_13050310_32bit_1367568751 0.0/2     00                                                     
21: Stockfish_13050310_32bit_1367569563 0.0/2     00                                                     
21: Stockfish_13051921_32bit_1368992516 0.0/2     00                                                     
21: Stockfish_13051922_32bit            0.0/2     00                                                     
21: Stockfish_13052317_32bit            0.0/2     00                                                     
21: Stockfish_13052512_32bit_1369476110 0.0/2     00                                                     
21: Stockfish_13050315_32bit            0.0/2     00                                                     
21: Stockfish_13052513_32bit            0.0/2     00                                                     
21: Stockfish_13052717_32bit            0.0/2     00                                                     
21: Stockfish_13051320_32bit            0.0/2     00                                                     

[felix]

Code: Select all

Level: Blitz 0:30/0,5
No opening book
Hardware: Intel(R) Core(TM) i3-2310M CPU @ 2.10GHz with 2,7 GB Memory
Operating system: Windows 7 Home Basic Home Edition Service Pack 1 (Build 7601) 32 bit
Table created with: Arena 3.5
Avg: 22 games/hour

The ones with -1 or better continues

All eliminated!

    Engine                              Score                                                         Ho
01: Houdini_4.0_Pro_w32-v1x             137.5/190 ······················································ 
02: Stockfish_13062310_32bit_1371974964 6.0/14    0110=01=01=00=                                         
03: Stockfish_13061611_32bit            5.5/14    0===10==011000                                         
04: Stockfish_13063011_32bit            5.0/12    =10101==0=00                                           
05: Stockfish_13060113_32bit            4.0/10    01010=010=                                             
06: Stockfish_13062212_32bit            3.0/8     01010==0                                               
07: Stockfish_13061307_32bit            2.5/8     ==0=0100                                               
07: Stockfish_13062313_32bit_1371985993 2.5/8     ==0===00                                               
07: Stockfish_13061408_32bit_1371190862 2.5/8     ====0=00                                               
10: Stockfish_13062310_32bit_1371975403 2.0/6     ===00=                                                 
10: Stockfish_13062911_32bit            2.0/6     =01=00                                                 
10: Stockfish_13062311_32bit            2.0/6     ==0100                                                 
13: Stockfish_13061907_32bit            1.5/6     ==0=00                                                 
13: Stockfish_13060913_32bit_1370778878 1.5/6     010=00                                                 
13: Stockfish_13062309_32bit            1.5/6     010=00                                                 
16: Stockfish_13061319_32bit_1371145832 1.0/4     0=0=                                                   
16: Stockfish_13061320_32bit            1.0/4     0==0                                                   
16: Stockfish_13060912_32bit_1370774644 1.0/4     0=0=                                                   
16: Stockfish_13061408_32bit_1371191226 1.0/4     0=0=                                                   
16: Stockfish_13060912_32bit_1370775365 1.0/4     ==00                                                   
16: Stockfish_13061709_32bit            1.0/4     0=0=                                                   
16: Stockfish_13061319_32bit_1371145609 1.0/4     0100                                                   
16: Stockfish_13063010_32bit            1.0/4     0100                                                   
16: Stockfish_13062109_32bit            1.0/4     1000                                                   
25: Stockfish_13062313_32bit_1371986343 0.5/4     0=00                                                   
25: Stockfish_13060911_32bit_1370768471 0.5/4     0=00                                                   
25: Stockfish_13060912_32bit_1370773936 0.5/4     0=00                                                   
25: Stockfish_13060810_32bit            0.5/4     0=00                                                   
29: Stockfish_13060923_32bit_1370813227 0.0/2     00                                                     
29: Stockfish_13060923_32bit_1370813806 0.0/2     00                                                     
29: Stockfish_13061610_32bit            0.0/2     00                                                     
29: Stockfish_13060116_32bit            0.0/2     00                                                     
29: Stockfish_13061613_32bit            0.0/2     00                                                     
29: Stockfish_13060911_32bit_1370771559 0.0/2     00                                                     
29: Stockfish_13061718_32bit_1371484979 0.0/2     00                                                     
29: Stockfish_13061718_32bit_1371485535 0.0/2     00                                                     
29: Stockfish_13060913_32bit_1370776221 0.0/2     00                                                     
29: Stockfish_13060811_32bit            0.0/2     00