March Madness

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

tsmiller1

Re: March Madness

Post by tsmiller1 »

Nice idea, but why are you using older versions?
I made a deliberate decision to test the engines that have been rated by the CCRL organization (plus one of the Ippolit family). I used the latest list I had access to (04/09/10). Obviously, the latest versions of engines will take a little time to make the CCRL list as they are tested. I don't want to start chasing the latest version of every engine, because that could be a never-ending pursuit, plus, the latest versions are not always the highest rated (per CCRL).

However, after I'm finished with this tournament (it'll probably take me 1.5 to 2 months), I may do the whole thing all over again using the engines from the latest and greatest CCRL list.

The Ippolit engine was a bit of an issue, because they are not rated by CCRL, so I did a 300-game G/5 round robin of the 5 members of the Ippolit family of which I could find the latest versions: Ippolit, Robbolito, Firebird, Igorrit, and IvanHoe. Ippolit 0.080b3 won this tourney with 69.0/120.0, so I chose it to represent the Ippolit family. Maybe not the most rigorous way to do things, but this is just my fun thing I'm doing.
jdart
Posts: 4408
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: March Madness

Post by jdart »

>Well, that particular CCRL list is a list of "best version only",
> which means that only the "best" of each family of engines is ranked.
>All the other versions are listed for the sake of comparison, but only
>the best version is ranked.

This doesn't seem to be the case. The list has Arasan 10.0 with a rank but Arasan 11.7 is above it in the list in terms of rating - and 11.7 is indeed almost certainly stronger than 10.0
tsmiller1

Re: March Madness

Post by tsmiller1 »

jdart wrote:>Well, that particular CCRL list is a list of "best version only",
> which means that only the "best" of each family of engines is ranked.
>All the other versions are listed for the sake of comparison, but only
>the best version is ranked.

This doesn't seem to be the case. The list has Arasan 10.0 with a rank but Arasan 11.7 is above it in the list in terms of rating - and 11.7 is indeed almost certainly stronger than 10.0
You'll notice that Arasan 11.7 is listed in non-bold type. That means that they haven't tested it with enough games to give it on official CCRL rating, but they listed it so people would be aware that the testing is underway, and the higher rating may (or may not) hold up. Maybe too much information, but I think once you work with it a while it is very good way to present the list.
tsmiller1

Re: March Madness

Post by tsmiller1 »

OK, Round 1 in Bracket A continues with No.2 seed Thinker defeating No. 15 seed Philou 4.5-0.5. Spunky little Philou drew the first game, then it was all Thinker the rest of the way. For an engine that doesn't show it's thinking, Thinker thinks pretty darn well, apparently.

No. 3 seed Bright put a hurtin' on No. 14 seed Little Goliath Evolution, winning easily 5-0.

Next up: No.4 seed Bison vs. No. 13 seed GarboChess!
tsmiller1

Re: March Madness

Post by tsmiller1 »

No. 4 seed Bison made quick work of No. 13 seed GarboChess, winning 5-1.

I'm having a heck of a time finding either Crafty 23.1 or Tornado 2.2. If some kind soul can point me in the right direction to get these two engines, I will be appreciative.

Thanks.
tsmiller1

Re: March Madness

Post by tsmiller1 »

Until I can find Crafty 23.1 and Tornado 2.2, I'm going to complete the rest of the Bracket A. No. 6 seed Alaric faced No. 11 seed Amyan. This was a tough battle for a while, but Alaric pulled ahead to win 4.5-2.5.

Next up: No. 7 seed Collosus vs. No. 10 seed Deuterium.
User avatar
Graham Banks
Posts: 44698
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: March Madness

Post by Graham Banks »

tsmiller1 wrote:No. 4 seed Bison made quick work of No. 13 seed GarboChess, winning 5-1.

I'm having a heck of a time finding either Crafty 23.1 or Tornado 2.2. If some kind soul can point me in the right direction to get these two engines, I will be appreciative.

Thanks.
Sorry - just saw this. I'll put them in CCRL public for you shortly.

Cheers,
Graham.
gbanksnz at gmail.com
User avatar
Graham Banks
Posts: 44698
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: March Madness

Post by Graham Banks »

Graham Banks wrote:
tsmiller1 wrote:No. 4 seed Bison made quick work of No. 13 seed GarboChess, winning 5-1.

I'm having a heck of a time finding either Crafty 23.1 or Tornado 2.2. If some kind soul can point me in the right direction to get these two engines, I will be appreciative.

Thanks.
Sorry - just saw this. I'll put them in CCRL public for you shortly.

Cheers,
Graham.
There now.
http://kirill-kryukov.com/chess/discuss ... f=7&t=5077
gbanksnz at gmail.com
tsmiller1

Re: March Madness

Post by tsmiller1 »

Thanks to Graham, I am now playing the match No.5 seed Crafty vs. No 12 seed Tornado. I'll let you know how it goes. Just a reminder, you can view the Brackets and the results at:

http://spreadsheets.google.com/ccc?key= ... aX2c&hl=en
tsmiller1

Re: March Madness

Post by tsmiller1 »

No. 5 seed Crafty defeats No. 12 seed Tornado 4.5-1.5.

Next up: No. 7 seed Colossus vs. No. 10 seed Deuterium.