Shredder Classic 4 is close to Spike 1.2 in strength........

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

pichy
Posts: 2564
Joined: Thu Mar 09, 2006 3:04 am

Shredder Classic 4 is close to Spike 1.2 in strength........

Post by pichy »

The next match will be in chess960 between these two gladiators.

Engine Score En Sp S-B
1: EngineClassic4 11.0/20 ···················· 10=0=101=10===1=101= 99.00
2: Spike 1.2 9.0/20 01=1=010=01===0=010= ···················· 99.00

20 games played / Tournament is finished
Name of the tournament: Arena tournament
Site/ Country: Jorge-07F2FB56AF, United States
Level: Tournament Game in 10 Minutes
Hardware: AMD Athlon(TM) XP 2000+ 1662 MHz with 992 MB Memory
Operating system: Microsoft Windows XP Home Edition Service Pack 3 (Build 2600)
PGN-File: C:\Program Files\Arena\Arena.pgn
Website:
E-Mail Address:


1 Rybka 2.3.1 Arena 256MB Athlon 1200 MHz 2962 47 -44 252 67% 2837
2 Rybka 1.2 256MB Athlon 1200 MHz 2909 26 -25 845 72% 2748
3 Hiarcs 11.1 256MB Athlon 1200 MHz 2871 51 -51 189 52% 2858
4 Junior 10.1 256MB Athlon 1200 MHz 2867 32 -30 563 72% 2702
5 Junior 10 256MB Athlon 1200 MHz 2851 25 -24 874 70% 2703
6 Hiarcs 10 HypMod 256MB Athlon 1200 MHz 2845 22 -21 1238 73% 2672
7 Fruit 2.2.1 256MB Athlon 1200 MHz 2837 21 -20 1224 64% 2734
8 Shredder 10 UCI 256MB Athlon 1200 MHz 2830 25 -24 857 69% 2689
9 Spike 1.2 256MB Athlon 1200 MHz 2825 30 -29 582 61% 2749
10 Shredder 9.0 UCI 256MB Athlon 1200 MHz 2814 20 -20 1280 66% 2701
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

What is close after 20 games? ...

Post by IWB »

Hi
pichy wrote: Engine Score En Sp S-B
1: EngineClassic4 11.0/20 ···················· 10=0=101=10===1=101= 99.00
2: Spike 1.2 9.0/20 01=1=010=01===0=010= ···················· 99.00

20 games played / Tournament is finished...
I really think that 20 games are a tiny littly bit to less to judge - something.

This is my result:

Code: Select all

   Program                          Elo    +   -   Games   Score   Av.Op.  Draws

 1 Rybka 3 1T                     : 2826   10  10  3600    75.9 %   2627   32.2 %
 2 Rybka 3 1T 32-bit              : 2768   14  14  1700    67.7 %   2639   35.7 %
 3 Deep Shredder 12               : 2723   14  14  1600    64.1 %   2622   36.5 %
 4 Rybka 2.3.2a                   : 2717    6   6  8900    62.5 %   2629   39.3 %
 5 Deep Shredder 12 UCI 32-bit    : 2715   14  14  1600    63.1 %   2622   37.5 %
 6 Naum 4                         : 2695    7   7  6100    54.8 %   2662   40.5 %
 7 Rybka 1.2f                     : 2669    6   6  8000    64.1 %   2568   33.8 %
 8 Fritz 12 32-bit                : 2647   16  16  1100    51.4 %   2638   41.3 %
 9 Deep Fritz 11 32-bit           : 2636   14  14  1500    55.9 %   2595   38.6 %
10 Stockfish 1.4 JA               : 2624   13  13  1800    49.1 %   2630   37.9 %
11 Shredder Bonn 1T 32-bit        : 2622   10  10  3000    50.8 %   2616   40.0 %
12 Zappa Mexico II                : 2620    6   6  8900    46.4 %   2645   40.2 %
13 Deep Shredder 11               : 2600    9   9  3700    52.1 %   2586   39.4 %
14 Onno-1-1-1                     : 2598   12  12  1800    47.1 %   2618   40.3 %
15 Rybka 1.0 Beta                 : 2595   11  11  2500    53.2 %   2573   36.3 %
16 Naum 3.1                       : 2589    7   7  5600    47.8 %   2605   38.9 %
17 Onno-1-0-0                     : 2585   13  13  1600    44.9 %   2620   39.9 %
18 Deep Sjeng WC2008              : 2577    7   7  6000    38.6 %   2658   35.5 %
19 Toga II 1.4 beta5c BB          : 2571    6   6  8400    39.1 %   2648   37.8 %
20 Hiarcs 12.1 MP 32-bit          : 2567    6   6  9500    38.4 %   2649   37.0 %
21 Deep Sjeng 3.0                 : 2563   10  10  3200    41.0 %   2626   33.8 %
->22 Shredder Classic 4             : 2550   17  17  1000    49.5 %   2553   37.8 %
23 Glaurung 2.2 JA                : 2548    8   8  5600    34.3 %   2661   33.6 %
24 Naum 2.2                       : 2542   10  10  2700    43.5 %   2588   42.9 %
25 Rybka 1.0 Beta 32-bit          : 2541    8   8  4500    50.0 %   2541   33.4 %
26 HIARCS 11.2 32-bit             : 2535    7   7  6600    45.5 %   2566   36.3 %
27 Fruit 05/11/03 32-bit          : 2532    5   5 10400    36.0 %   2632   36.9 %
28 DS 10 Balmung                  : 2529   10  10  2600    49.9 %   2530   42.5 %
29 LoopMP 12.32 32-bit            : 2524    7   7  5600    44.7 %   2561   34.7 %
30 Loop 13.5 32-bit               : 2523    8   8  4700    43.4 %   2569   37.0 %
31 Toga II 1.2.1a                 : 2519    7   7  6600    46.6 %   2542   35.2 %
32 ListMP 11.64b                  : 2516   12  12  2200    44.0 %   2558   35.9 %
33 Glaurung 2.1                   : 2509   19  19   900    42.7 %   2560   33.9 %
34 Deep Shredder 10               : 2506    5   5 12300    35.3 %   2611   33.9 %
35 HIARCS 11 MP 32-bit            : 2505   19  19   800    44.9 %   2540   36.4 %
36 Naum 2.1                       : 2504    9   9  3700    44.6 %   2542   36.4 %
37 Toga II 1.3x4                  : 2497   19  19   800    44.6 %   2535   38.9 %
->38 Spike 1.2 Turin 32-bit         : 2480    5   5 13800    32.1 %   2610   33.0 %
39 Deep Shredder 9.02             : 2465   16  16  1400    37.9 %   2551   29.1 %
40 Deep Sjeng 2.7                 : 2453   13  13  2000    31.2 %   2591   33.1 %
41 Glaurung 2-epsilon/5           : 2445   16  16  1300    34.8 %   2554   30.9 %
42 Deep Sjeng 2.5                 : 2385   20  20   900    29.9 %   2533   30.6 %
I have 70 Elo. You have to judge if this is close.

And just by luck I have 100 games vs Spike 1.2 (1Thread, 256 MB Hash, 4pc TBs/Sbases, Ponder ON (as in a Tourney), 6 + 3, 50 opening positions, changing colors (100 games))

Code: Select all

Shredder Classic 4                      : 2550  1000 (+306,=378,-316), 49.5 %

Zappa Mexico II x64 1T        : 100 (+ 18,= 38,- 44), 37.0 %
Deep Shredder 10 x64 1T       : 100 (+ 34,= 37,- 29), 52.5 %
Spike 1.2 Turin               : 100 (+ 41,= 33,- 26), 57.5 %
Fruit 05/11/03                : 100 (+ 37,= 44,- 19), 59.0 %
H12.1 MP 1T                   : 100 (+ 24,= 43,- 33), 45.5 %
Toga II 1.4 beta5c BB         : 100 (+ 31,= 36,- 33), 49.0 %
Rybka 1.0 Beta 32-bit         : 100 (+ 34,= 39,- 27), 53.5 %
DSjeng WC2008 x64 1T          : 100 (+ 25,= 40,- 35), 45.0 %
Glaurung 2.2 JA 1T            : 100 (+ 36,= 37,- 27), 54.5 %
Onno-1-1-1 x64                : 100 (+ 26,= 31,- 43), 41.5 %
Bye
Ingo
pichy
Posts: 2564
Joined: Thu Mar 09, 2006 3:04 am

Re: What is close after 20 games? ...

Post by pichy »

IWB wrote:Hi
pichy wrote: Engine Score En Sp S-B
1: EngineClassic4 11.0/20 ···················· 10=0=101=10===1=101= 99.00
2: Spike 1.2 9.0/20 01=1=010=01===0=010= ···················· 99.00

20 games played / Tournament is finished...
I really think that 20 games are a tiny littly bit to less to judge - something.

This is my result:

Code: Select all

   Program                          Elo    +   -   Games   Score   Av.Op.  Draws

 1 Rybka 3 1T                     : 2826   10  10  3600    75.9 %   2627   32.2 %
 2 Rybka 3 1T 32-bit              : 2768   14  14  1700    67.7 %   2639   35.7 %
 3 Deep Shredder 12               : 2723   14  14  1600    64.1 %   2622   36.5 %
 4 Rybka 2.3.2a                   : 2717    6   6  8900    62.5 %   2629   39.3 %
 5 Deep Shredder 12 UCI 32-bit    : 2715   14  14  1600    63.1 %   2622   37.5 %
 6 Naum 4                         : 2695    7   7  6100    54.8 %   2662   40.5 %
 7 Rybka 1.2f                     : 2669    6   6  8000    64.1 %   2568   33.8 %
 8 Fritz 12 32-bit                : 2647   16  16  1100    51.4 %   2638   41.3 %
 9 Deep Fritz 11 32-bit           : 2636   14  14  1500    55.9 %   2595   38.6 %
10 Stockfish 1.4 JA               : 2624   13  13  1800    49.1 %   2630   37.9 %
11 Shredder Bonn 1T 32-bit        : 2622   10  10  3000    50.8 %   2616   40.0 %
12 Zappa Mexico II                : 2620    6   6  8900    46.4 %   2645   40.2 %
13 Deep Shredder 11               : 2600    9   9  3700    52.1 %   2586   39.4 %
14 Onno-1-1-1                     : 2598   12  12  1800    47.1 %   2618   40.3 %
15 Rybka 1.0 Beta                 : 2595   11  11  2500    53.2 %   2573   36.3 %
16 Naum 3.1                       : 2589    7   7  5600    47.8 %   2605   38.9 %
17 Onno-1-0-0                     : 2585   13  13  1600    44.9 %   2620   39.9 %
18 Deep Sjeng WC2008              : 2577    7   7  6000    38.6 %   2658   35.5 %
19 Toga II 1.4 beta5c BB          : 2571    6   6  8400    39.1 %   2648   37.8 %
20 Hiarcs 12.1 MP 32-bit          : 2567    6   6  9500    38.4 %   2649   37.0 %
21 Deep Sjeng 3.0                 : 2563   10  10  3200    41.0 %   2626   33.8 %
->22 Shredder Classic 4             : 2550   17  17  1000    49.5 %   2553   37.8 %
23 Glaurung 2.2 JA                : 2548    8   8  5600    34.3 %   2661   33.6 %
24 Naum 2.2                       : 2542   10  10  2700    43.5 %   2588   42.9 %
25 Rybka 1.0 Beta 32-bit          : 2541    8   8  4500    50.0 %   2541   33.4 %
26 HIARCS 11.2 32-bit             : 2535    7   7  6600    45.5 %   2566   36.3 %
27 Fruit 05/11/03 32-bit          : 2532    5   5 10400    36.0 %   2632   36.9 %
28 DS 10 Balmung                  : 2529   10  10  2600    49.9 %   2530   42.5 %
29 LoopMP 12.32 32-bit            : 2524    7   7  5600    44.7 %   2561   34.7 %
30 Loop 13.5 32-bit               : 2523    8   8  4700    43.4 %   2569   37.0 %
31 Toga II 1.2.1a                 : 2519    7   7  6600    46.6 %   2542   35.2 %
32 ListMP 11.64b                  : 2516   12  12  2200    44.0 %   2558   35.9 %
33 Glaurung 2.1                   : 2509   19  19   900    42.7 %   2560   33.9 %
34 Deep Shredder 10               : 2506    5   5 12300    35.3 %   2611   33.9 %
35 HIARCS 11 MP 32-bit            : 2505   19  19   800    44.9 %   2540   36.4 %
36 Naum 2.1                       : 2504    9   9  3700    44.6 %   2542   36.4 %
37 Toga II 1.3x4                  : 2497   19  19   800    44.6 %   2535   38.9 %
->38 Spike 1.2 Turin 32-bit         : 2480    5   5 13800    32.1 %   2610   33.0 %
39 Deep Shredder 9.02             : 2465   16  16  1400    37.9 %   2551   29.1 %
40 Deep Sjeng 2.7                 : 2453   13  13  2000    31.2 %   2591   33.1 %
41 Glaurung 2-epsilon/5           : 2445   16  16  1300    34.8 %   2554   30.9 %
42 Deep Sjeng 2.5                 : 2385   20  20   900    29.9 %   2533   30.6 %
I have 70 Elo. You have to judge if this is close.

And just by luck I have 100 games vs Spike 1.2 (1Thread, 256 MB Hash, 4pc TBs/Sbases, Ponder ON (as in a Tourney), 6 + 3, 50 opening positions, changing colors (100 games))

Code: Select all

Shredder Classic 4                      : 2550  1000 (+306,=378,-316), 49.5 %

Zappa Mexico II x64 1T        : 100 (+ 18,= 38,- 44), 37.0 %
Deep Shredder 10 x64 1T       : 100 (+ 34,= 37,- 29), 52.5 %
Spike 1.2 Turin               : 100 (+ 41,= 33,- 26), 57.5 %
Fruit 05/11/03                : 100 (+ 37,= 44,- 19), 59.0 %
H12.1 MP 1T                   : 100 (+ 24,= 43,- 33), 45.5 %
Toga II 1.4 beta5c BB         : 100 (+ 31,= 36,- 33), 49.0 %
Rybka 1.0 Beta 32-bit         : 100 (+ 34,= 39,- 27), 53.5 %
DSjeng WC2008 x64 1T          : 100 (+ 25,= 40,- 35), 45.0 %
Glaurung 2.2 JA 1T            : 100 (+ 36,= 37,- 27), 54.5 %
Onno-1-1-1 x64                : 100 (+ 26,= 31,- 43), 41.5 %
Bye
Ingo
All that I am trying to do is to have an idea of hoe close these two programs are, probably 500 games are needed beween these two programs, but they seems to be very close within 40 rating points from each other :roll:
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: What is close after 20 games? ...

Post by bob »

pichy wrote:
IWB wrote:Hi
pichy wrote: Engine Score En Sp S-B
1: EngineClassic4 11.0/20 ···················· 10=0=101=10===1=101= 99.00
2: Spike 1.2 9.0/20 01=1=010=01===0=010= ···················· 99.00

20 games played / Tournament is finished...
I really think that 20 games are a tiny littly bit to less to judge - something.

This is my result:

Code: Select all

   Program                          Elo    +   -   Games   Score   Av.Op.  Draws

 1 Rybka 3 1T                     : 2826   10  10  3600    75.9 %   2627   32.2 %
 2 Rybka 3 1T 32-bit              : 2768   14  14  1700    67.7 %   2639   35.7 %
 3 Deep Shredder 12               : 2723   14  14  1600    64.1 %   2622   36.5 %
 4 Rybka 2.3.2a                   : 2717    6   6  8900    62.5 %   2629   39.3 %
 5 Deep Shredder 12 UCI 32-bit    : 2715   14  14  1600    63.1 %   2622   37.5 %
 6 Naum 4                         : 2695    7   7  6100    54.8 %   2662   40.5 %
 7 Rybka 1.2f                     : 2669    6   6  8000    64.1 %   2568   33.8 %
 8 Fritz 12 32-bit                : 2647   16  16  1100    51.4 %   2638   41.3 %
 9 Deep Fritz 11 32-bit           : 2636   14  14  1500    55.9 %   2595   38.6 %
10 Stockfish 1.4 JA               : 2624   13  13  1800    49.1 %   2630   37.9 %
11 Shredder Bonn 1T 32-bit        : 2622   10  10  3000    50.8 %   2616   40.0 %
12 Zappa Mexico II                : 2620    6   6  8900    46.4 %   2645   40.2 %
13 Deep Shredder 11               : 2600    9   9  3700    52.1 %   2586   39.4 %
14 Onno-1-1-1                     : 2598   12  12  1800    47.1 %   2618   40.3 %
15 Rybka 1.0 Beta                 : 2595   11  11  2500    53.2 %   2573   36.3 %
16 Naum 3.1                       : 2589    7   7  5600    47.8 %   2605   38.9 %
17 Onno-1-0-0                     : 2585   13  13  1600    44.9 %   2620   39.9 %
18 Deep Sjeng WC2008              : 2577    7   7  6000    38.6 %   2658   35.5 %
19 Toga II 1.4 beta5c BB          : 2571    6   6  8400    39.1 %   2648   37.8 %
20 Hiarcs 12.1 MP 32-bit          : 2567    6   6  9500    38.4 %   2649   37.0 %
21 Deep Sjeng 3.0                 : 2563   10  10  3200    41.0 %   2626   33.8 %
->22 Shredder Classic 4             : 2550   17  17  1000    49.5 %   2553   37.8 %
23 Glaurung 2.2 JA                : 2548    8   8  5600    34.3 %   2661   33.6 %
24 Naum 2.2                       : 2542   10  10  2700    43.5 %   2588   42.9 %
25 Rybka 1.0 Beta 32-bit          : 2541    8   8  4500    50.0 %   2541   33.4 %
26 HIARCS 11.2 32-bit             : 2535    7   7  6600    45.5 %   2566   36.3 %
27 Fruit 05/11/03 32-bit          : 2532    5   5 10400    36.0 %   2632   36.9 %
28 DS 10 Balmung                  : 2529   10  10  2600    49.9 %   2530   42.5 %
29 LoopMP 12.32 32-bit            : 2524    7   7  5600    44.7 %   2561   34.7 %
30 Loop 13.5 32-bit               : 2523    8   8  4700    43.4 %   2569   37.0 %
31 Toga II 1.2.1a                 : 2519    7   7  6600    46.6 %   2542   35.2 %
32 ListMP 11.64b                  : 2516   12  12  2200    44.0 %   2558   35.9 %
33 Glaurung 2.1                   : 2509   19  19   900    42.7 %   2560   33.9 %
34 Deep Shredder 10               : 2506    5   5 12300    35.3 %   2611   33.9 %
35 HIARCS 11 MP 32-bit            : 2505   19  19   800    44.9 %   2540   36.4 %
36 Naum 2.1                       : 2504    9   9  3700    44.6 %   2542   36.4 %
37 Toga II 1.3x4                  : 2497   19  19   800    44.6 %   2535   38.9 %
->38 Spike 1.2 Turin 32-bit         : 2480    5   5 13800    32.1 %   2610   33.0 %
39 Deep Shredder 9.02             : 2465   16  16  1400    37.9 %   2551   29.1 %
40 Deep Sjeng 2.7                 : 2453   13  13  2000    31.2 %   2591   33.1 %
41 Glaurung 2-epsilon/5           : 2445   16  16  1300    34.8 %   2554   30.9 %
42 Deep Sjeng 2.5                 : 2385   20  20   900    29.9 %   2533   30.6 %
I have 70 Elo. You have to judge if this is close.

And just by luck I have 100 games vs Spike 1.2 (1Thread, 256 MB Hash, 4pc TBs/Sbases, Ponder ON (as in a Tourney), 6 + 3, 50 opening positions, changing colors (100 games))

Code: Select all

Shredder Classic 4                      : 2550  1000 (+306,=378,-316), 49.5 %

Zappa Mexico II x64 1T        : 100 (+ 18,= 38,- 44), 37.0 %
Deep Shredder 10 x64 1T       : 100 (+ 34,= 37,- 29), 52.5 %
Spike 1.2 Turin               : 100 (+ 41,= 33,- 26), 57.5 %
Fruit 05/11/03                : 100 (+ 37,= 44,- 19), 59.0 %
H12.1 MP 1T                   : 100 (+ 24,= 43,- 33), 45.5 %
Toga II 1.4 beta5c BB         : 100 (+ 31,= 36,- 33), 49.0 %
Rybka 1.0 Beta 32-bit         : 100 (+ 34,= 39,- 27), 53.5 %
DSjeng WC2008 x64 1T          : 100 (+ 25,= 40,- 35), 45.0 %
Glaurung 2.2 JA 1T            : 100 (+ 36,= 37,- 27), 54.5 %
Onno-1-1-1 x64                : 100 (+ 26,= 31,- 43), 41.5 %
Bye
Ingo
All that I am trying to do is to have an idea of hoe close these two programs are, probably 500 games are needed beween these two programs, but they seems to be very close within 40 rating points from each other :roll:
Unfortunately the closer they are, the more games you need to figure out what is what.