ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

4'+2" UPDATE: Loop 13.5 is here... matches underway
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches Flat
View previous topic :: View next topic  
Author Message
Erik Roggenburg
Guest





PostPost subject: Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa    Posted: Sun Apr 08, 2007 9:03 am Reply to topic Reply with quote

In the Pruned List, which consists only of the "best/strongest" engine versions that have been tested, Loop 13.5.32 2CPU takes over the #2 position from HIARCS 11.1 MP UCI. It is a very, very close, and statistically speaking, the engines are identical in strength.

From a stability standpoint, Loop did not crash once in 1,400 games, so that makes me very happy.

What is going to be interesting on a go forward basis is seeing whether or not engines like HIARCS, Loop, and Rybka maintain the amount that they improve from old version to new version.

HIARCS 11.1 MP UCI was a 35 Elo improvement over HIARCS 11 MP UCI according to the FULL LIST. That's about a 1.3% improvement.

Loop 13.5.32 2CPU was a 25 Elo improvement over LoopMP 12.32 2CPU, a .92% improvement.

Rybka 2.3.1 mp 32-bit was a 11 Elo improvement over Rybka 2.2 mp 32-bit, a .39% improvement.

What might this indicate? Well, it indicates that it could get harder and harder to squeeze Elo improvement out of an existing engine. Sort of a law of diminishing returns in the programming world, I guess.

Let's speculate for fun! What if HIARCS team squeezes out a .75% improvement in their next version over HIARCS 11.1 MP UCI? That would put them at 2751 Elo.

Now, what if Vas and company eek out the same .39% improvement in their next version over Rybka 2.3.1 mp 32-bit? That would put them at 2839 Elo.

Rybka still would have a commanding lead in the Elo race, but it would be shrinking.

What if the HIARCS team pulls off another fine improvement, and eeks out 1.3% instead of the previously assumed .75%? That puts HIARCS at 2813 Elo. AHA! Now things start to get interesting! Wink

As a fan of computer chess engines, I truly hope that one or two engines can continue to make the kinds of strides that they have been able to make lately. I'd like to see the performance gap closed a bit between Rybka and the rest of the field. I bet the playchess.com server would become a more interesting place if Rybka were no longer a clear #1. Remember the days when Shredder was #1? It was #1, but it wasn't a DOMINANT #1, so folks could toss out HIARCS, Fritz, Chess Tiger, Junior, etc. and still be competitive.

We'll see what develops!

PRUNED LIST:
Code:
    Program                          Elo    +   -   Games   Score   Av.Op.  Draws

  1 Rybka 2.3.1 mp 32-bit          : 2825   17  17  1400    75.9 %   2626   25.0 %
  2 Loop 13.5.32 2CPU              : 2730   15  15  1400    63.7 %   2632   34.9 %
  3 HIARCS 11.1 MP UCI             : 2729   15  15  1400    63.5 %   2633   33.6 %
  4 Deep Fritz 10                  : 2721   19  19   960    60.2 %   2649   29.2 %
  5 Naum 2.1 MP                    : 2665   18  18   960    51.8 %   2653   36.5 %
  6 Deep Shredder 10 UCI           : 2664   19  19   960    51.6 %   2653   28.8 %
  7 Deep Junior 10.1               : 2636   18  18   960    47.3 %   2654   31.1 %
  8 Toga II 1.2.1a                 : 2633   18  18   960    46.9 %   2655   32.1 %
  9 Fruit 2.2.1                    : 2628   18  18   960    46.2 %   2655   32.8 %
 10 Spike 1.2 Turin                : 2626   18  18   960    45.8 %   2655   36.8 %
 11 Glaurung 1.2 SMP               : 2597   19  19   960    41.4 %   2657   28.6 %
 12 Chess Tiger 2007 UCI           : 2557   19  19   960    35.7 %   2659   30.3 %
 13 Scorpio 1.91 2CPU              : 2541   19  19   960    33.5 %   2660   32.3 %
 14 Deep Pharaon 3.5.1             : 2536   19  19   960    32.9 %   2661   29.3 %
 15 Deep Frenzee 3.0               : 2509   20  20   960    29.3 %   2662   24.1 %
Back to top
Display posts from previous:   
Subject Author Date/Time
4'+2" UPDATE: Loop 13.5 is here... matches underway Erik Roggenburg Sun Mar 25, 2007 3:42 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Mon Mar 26, 2007 5:19 am
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Paulo Soares Mon Mar 26, 2007 6:23 pm
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dr.Wael Deeb Mon Mar 26, 2007 6:26 pm
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Mon Mar 26, 2007 6:27 pm
                              Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dr.Wael Deeb Mon Mar 26, 2007 6:29 pm
                              Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Paulo Soares Mon Mar 26, 2007 9:16 pm
                                    Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Mon Mar 26, 2007 9:23 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Mon Mar 26, 2007 6:38 pm
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dr.Wael Deeb Mon Mar 26, 2007 6:47 pm
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Mon Mar 26, 2007 6:48 pm
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dr.Wael Deeb Mon Mar 26, 2007 6:52 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Tue Mar 27, 2007 11:01 am
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Wed Mar 28, 2007 2:57 am
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Wed Mar 28, 2007 11:40 am
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Wed Mar 28, 2007 4:49 pm
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Paulo Soares Wed Mar 28, 2007 5:00 pm
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Wed Mar 28, 2007 5:25 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Wed Mar 28, 2007 11:59 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Thu Mar 29, 2007 7:07 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Fri Mar 30, 2007 10:12 am
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Fri Mar 30, 2007 10:20 am
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Fri Mar 30, 2007 11:56 am
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Tony Thomas Fri Mar 30, 2007 2:41 pm
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Fri Mar 30, 2007 3:39 pm
                              Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Tony Thomas Fri Mar 30, 2007 3:45 pm
                                    Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dr.Wael Deeb Fri Mar 30, 2007 3:56 pm
                                          Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Tony Thomas Fri Mar 30, 2007 7:13 pm
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa rdan1987 Fri Mar 30, 2007 9:08 pm
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Fri Mar 30, 2007 10:43 pm
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Shaun Brewer Fri Mar 30, 2007 11:16 pm
                              Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Fri Mar 30, 2007 11:31 pm
                                    Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Shaun Brewer Fri Mar 30, 2007 11:39 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sat Mar 31, 2007 9:24 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sun Apr 01, 2007 12:45 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Tue Apr 03, 2007 3:10 am
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Wed Apr 04, 2007 1:02 am
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Fri Apr 06, 2007 10:13 am
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sat Apr 07, 2007 12:54 am
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sat Apr 07, 2007 12:53 pm
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sat Apr 07, 2007 9:05 pm
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sun Apr 08, 2007 2:34 am
      Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sun Apr 08, 2007 8:42 am
            Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sun Apr 08, 2007 9:03 am
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Spock Sun Apr 08, 2007 9:08 am
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sun Apr 08, 2007 9:13 am
                              Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Yarget Sun Apr 08, 2007 10:33 am
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dr.Wael Deeb Sun Apr 08, 2007 9:14 am
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Shaun Brewer Sun Apr 08, 2007 11:33 am
                        Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Erik Roggenburg Sun Apr 08, 2007 5:08 pm
                              Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Shaun Brewer Sun Apr 08, 2007 9:19 pm
                  Re: 4'+2" UPDATE: Loop 13.5 is here... matches underwa Dadi Jonsson Sun Apr 08, 2007 3:03 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads