Bullet 20"+1" test of 26 engines

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Gusev
Posts: 1476
Joined: Mon Jan 28, 2013 2:51 pm

Bullet 20"+1" test of 26 engines

Post by Gusev »

At the peak load (4 cores, 8 threads), a few engines crashed often (BlackMamba, Critter, Arasan, Protector), Nirvanachess and Firenzina crashed once, Komodo and asmFish proved prone to time forfeits under Arena 3.5.1, even though the time buffer for asmFish and all other fish was increased from 30 to 50 and kept at 75 for McBrain, which has it as its default. I don't think it makes sense to complete the second round robin. Here are the results.

Code: Select all

    Engine                                           Score  McCfStAsHoBoEnFiFiGuAnIvHaEqMaKoNiStFiPrTeArFrCrBlNa    S-B
01: McBrain_2017_v25_x64_bmi2                        22.5/25 · = = = 1 1 1 1 1 1 1 1 1 1 = 1 1 1 1 1 1 1 1 = 1 1  264.25
02: Cfish_2017-06-19_YC_x64_bmi2_NUMA                20.5/25 = · 1 = 0 1 1 = 1 1 1 1 0 1 = 1 1 1 1 1 1 1 1 1 = 1  239.75
03: Stockfish_170616_x64_bmi2                        20.0/25 = 0 · 0 = 1 1 1 0 1 1 = 1 1 1 1 1 1 = 1 1 1 1 1 1 1  219.75
04: AsmFishW_2017-06-09_bmi2                         19.0/25 = = 1 · 0 1 0 = 1 1 1 1 1 1 = 1 0 1 1 1 1 1 1 1 1 0  224.75
05: Houdini_5_Pro_pext_x64                           17.5/25 0 1 = 1 · 0 1 = = = 1 0 0 1 = 1 1 1 1 1 1 1 1 1 1 0  203.25
06: Booot6_popcnt                                    16.5/25 0 0 0 0 1 · 0 1 = 1 0 = 1 = 1 1 1 0 1 1 1 1 1 1 1 1  166.75
07: EngineDeepShredder13UCIx64                       15.5/25 0 0 0 1 0 1 · 0 0 1 1 = 0 1 = 1 1 1 = 1 1 0 1 1 1 1  164.50
08: Fire 5 x64 popcnt                                15.0/25 0 = 0 = = 0 1 · 1 = = = 1 1 1 0 = = = = 1 1 = = 1 1  164.75
09: Fizbo19x64_bmi2                                  15.0/25 0 0 1 0 = = 1 0 · 1 = = 1 0 1 = = 1 1 = = = = 1 1 1  164.25
10: Gull.3.1_JVx64                                   15.0/25 0 0 0 0 = 0 0 = 0 · 1 1 1 1 1 1 = 1 = 1 1 1 0 1 1 1  148.00
11: Andscacsb                                        15.0/25 0 0 0 0 0 1 0 = = 0 · = 1 = 1 1 1 = 1 = 1 1 1 1 1 1  143.50
12: Ivanhoe1945a_x64_AVX2_Intel_2015-07-28           12.0/25 0 0 = 0 1 = = = = 0 = · = = = 0 = 0 1 1 0 = 1 = 1 1  129.00
13: Hannibal1.7x64                                   11.5/25 0 1 0 0 1 0 1 0 0 0 0 = · 0 = 1 1 = 0 0 0 1 1 1 1 1  119.25
14: Equinox 3.30-x64                                 11.5/25 0 0 0 0 0 = 0 0 1 0 = = 1 · 0 = 1 = 1 1 = 1 1 0 = 1  112.50
15: Mars_3.5_AVX2_x64                                10.5/25 = = 0 = = 0 = 0 0 0 0 = = 1 · 0 1 = 0 = = 0 = 1 1 1  113.75
16: Komodo-11.01-64bit                               10.5/25 0 0 0 0 0 0 0 1 = 0 0 1 0 = 1 · 0 1 1 0 1 1 1 0 = 1  100.00
17: Nirvanachess 2.3 (Popcount)                      10.0/25 0 0 0 1 0 0 0 = = = 0 = 0 0 0 1 · = 1 1 1 = 0 1 1 0  106.00
18: Sting-sf-81                                      10.0/25 0 0 0 0 0 1 0 = 0 0 = 1 = = = 0 = · = 0 = 1 1 0 1 1   97.25
19: Firenzina_2-4-3_xTreme_x64_AVX2_Intel_2015-07-28 9.5/25  0 0 = 0 0 0 = = 0 = 0 0 1 0 1 0 0 = · = 0 = 1 1 1 1   90.00
20: Protector_Win64                                  9.5/25  0 0 0 0 0 0 0 = = 0 = 0 1 0 = 1 0 1 = · 0 0 1 1 1 1   86.50
21: Texel64                                          9.5/25  0 0 0 0 0 0 0 0 = 0 0 1 1 = = 0 0 = 1 1 · = 0 1 1 1   84.50
22: Arasanx-64-popcnt [001]                          7.0/25  0 0 0 0 0 0 1 0 = 0 0 = 0 0 1 0 = 0 = 1 = · = 0 0 1   71.00
23: Fritz 15                                         7.0/25  0 0 0 0 0 0 0 = = 1 0 0 0 0 = 0 1 0 0 0 1 = · 1 0 1   68.75
24: Critter_1.6a_64bit                               6.5/25  = 0 0 0 0 0 0 = 0 0 0 = 0 1 0 1 0 1 0 0 0 1 0 · 1 0   68.25
25: BlackMamba_MP_x64                                4.5/25  0 = 0 0 0 0 0 0 0 0 0 0 0 = 0 = 0 0 0 0 0 1 1 0 · 1   39.25
26: Naum46_x64                                       4.0/25  0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 ·   53.00

325 of 650 games played
Name of the tournament: Tourn13
Site/ Country: ASUS-DANDELION, United States
Level: Blitz 0:20/1
Hardware: Intel(R) Core(TM) i7-4710HQ CPU @ 2.50GHz with 16.0 GB Memory
Operating system: Windows 10 Home Home Edition (Build 9200) 64 bit