Updating engines mid-tournament

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Jesse Gersenson
Posts: 593
Joined: Sat Aug 20, 2011 9:43 am

Updating engines mid-tournament

Post by Jesse Gersenson »

For engine-engine tournaments, common practice is use one version of each engine for the duration of the event. Mid-event upgrades are not allowed.

1. what's the reason for this?
2. are there exceptions?
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Updating engines mid-tournament

Post by Guenther »

Jesse Gersenson wrote: Fri Feb 01, 2019 3:29 pm For engine-engine tournaments, common practice is use one version of each engine for the duration of the event. Mid-event upgrades are not allowed.

1. what's the reason for this?
2. are there exceptions?
1.
  • it requires extra work (and wasn't easy in the past) and requires intervention in a normally automated process
  • it could be abused by triggerhappy developers (you won't be happy, if one is updating each round I guess?)
  • if the goal was some rating calculation too, it diminishes the number of games per entity
  • you need extra rules
2.
  • A lot of tournaments in the past allowed 'updates' under certain circumstances (more or less as bugfix), or to a certain
    early fixed point in the tournament
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
Ras
Posts: 2487
Joined: Tue Aug 30, 2016 8:19 pm
Full name: Rasmus Althoff

Re: Updating engines mid-tournament

Post by Ras »

1. In addition to Guenther's points, it rewards proper testing of the software, which is also part of the quality.
Rasmus Althoff
https://www.ct800.net
JVMerlino
Posts: 1357
Joined: Wed Mar 08, 2006 10:15 pm
Location: San Francisco, California

Re: Updating engines mid-tournament

Post by JVMerlino »

Agreed on all points. On the other side, you would have (for example) Olivier Deville's excellent ChessWar and OpenWar tournaments, in which each round took 1-3 days. If you saw your engine do something stupid, or were working on something that you weren't QUITE finished with, you knew you could get a new version in as soon as it was ready. Olivier was very accommodating.

Sadly, Olivier stopped running these tournaments in 2012. I met many people at those tournaments that I still chat with.
User avatar
hgm
Posts: 27787
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Updating engines mid-tournament

Post by hgm »

It is ideed a pitty that ChessWar was discontinued. It was the best Chess engine competition I have ever seen.
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Updating engines mid-tournament

Post by Graham Banks »

Jesse Gersenson wrote: Fri Feb 01, 2019 3:29 pm For engine-engine tournaments, common practice is use one version of each engine for the duration of the event. Mid-event upgrades are not allowed.

1. what's the reason for this?
2. are there exceptions?
I allow updated versions to replace existing ones during my tournaments, as long as it's not past a certain point in the tournament.
Easy enough to do under ChessGUI.
gbanksnz at gmail.com
Sergio Martinez
Posts: 1975
Joined: Fri Oct 05, 2012 2:35 pm
Location: Spain

Re: Updating engines mid-tournament

Post by Sergio Martinez »

hgm wrote: Fri Feb 01, 2019 7:50 pm It is ideed a pitty that ChessWar was discontinued. It was the best Chess engine competition I have ever seen.
I agree with that but adding the Leo tournaments. Two different systems but for me they were the most interesting tournaments I've seen.

On the other hand, the CCT tournaments also seemed very interesting.
Member of the CCRL Group. Write me if you want I test your engine.
JVMerlino
Posts: 1357
Joined: Wed Mar 08, 2006 10:15 pm
Location: San Francisco, California

Re: Updating engines mid-tournament

Post by JVMerlino »

Ah, yes, Leo Dijksman as well!

So happy that the CCRL is still going strong and also doing fun tournaments.