Elo tag for cutechess

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Pvt. Ryan
Posts: 65
Joined: Mon Sep 12, 2022 3:50 am
Location: Christchurch, NZ
Full name: Ray Bongalon

Elo tag for cutechess

Post by Pvt. Ryan »

Hi everyone. I was wondering if there's a way to include the Elo rating in the batch file. Thank you.
Halifax
Posts: 12
Joined: Fri Nov 11, 2022 8:50 pm
Full name: Ian Rastall

Re: Elo tag for cutechess

Post by Halifax »

Sorry to be a broken record, but I was curious about this, too, so I asked ChatGPT. This is the output:

*****

Yes, it is possible to assign ratings to engines before they are tested in CuteChess CLI. This can be useful if you want to start a tournament with engines that already have established ratings based on their previous performance, or if you want to test new engines against a set of established opponents with known ratings.

Here's how you can assign ratings to engines in CuteChess CLI:

1. Create a file to store the engine ratings. You can use a plain text file with a simple format, such as:

```
engine1 2800
engine2 2700
engine3 2600
```

This file lists the names of the engines and their corresponding ratings.

2. In the CuteChess CLI configuration file, add the following option:

```
ratingfile=ratings.txt
```

This option tells CuteChess CLI to read the engine ratings from the file "ratings.txt".

3. When you run a tournament, CuteChess CLI will use the ratings from the file to determine the expected score of each engine. The actual scores from the tournament will be used to update the ratings in the file for the next tournament.

Note that the initial ratings in the file are only used for the first tournament. After the first tournament, the ratings will be updated based on the actual scores from the games played in the tournament.

Also, keep in mind that the rating system used by CuteChess CLI is based on the Glicko-2 algorithm, which takes into account the uncertainty in the ratings and the strength of the opponents. Therefore, the actual rating of an engine can fluctuate based on its performance in the tournament and the performance of the other engines in the tournament.
Pvt. Ryan
Posts: 65
Joined: Mon Sep 12, 2022 3:50 am
Location: Christchurch, NZ
Full name: Ray Bongalon

Re: Elo tag for cutechess

Post by Pvt. Ryan »

Halifax wrote: Mon May 01, 2023 1:09 am Sorry to be a broken record, but I was curious about this, too, so I asked ChatGPT. This is the output:

*****

Yes, it is possible to assign ratings to engines before they are tested in CuteChess CLI. This can be useful if you want to start a tournament with engines that already have established ratings based on their previous performance, or if you want to test new engines against a set of established opponents with known ratings.

Here's how you can assign ratings to engines in CuteChess CLI:

1. Create a file to store the engine ratings. You can use a plain text file with a simple format, such as:

```
engine1 2800
engine2 2700
engine3 2600
```

This file lists the names of the engines and their corresponding ratings.

2. In the CuteChess CLI configuration file, add the following option:

```
ratingfile=ratings.txt
```

This option tells CuteChess CLI to read the engine ratings from the file "ratings.txt".

3. When you run a tournament, CuteChess CLI will use the ratings from the file to determine the expected score of each engine. The actual scores from the tournament will be used to update the ratings in the file for the next tournament.

Note that the initial ratings in the file are only used for the first tournament. After the first tournament, the ratings will be updated based on the actual scores from the games played in the tournament.

Also, keep in mind that the rating system used by CuteChess CLI is based on the Glicko-2 algorithm, which takes into account the uncertainty in the ratings and the strength of the opponents. Therefore, the actual rating of an engine can fluctuate based on its performance in the tournament and the performance of the other engines in the tournament.
Cheers. I'm always curious about ChatGPT.
JoAnnP38
Posts: 253
Joined: Mon Aug 26, 2019 4:34 pm
Location: Clearwater, Florida USA
Full name: JoAnn Peeler

Re: Elo tag for cutechess

Post by JoAnnP38 »

Are we sure that ChatGPT isn't just lying? Here is a response to my question:

How do I specify the starting Elo ratings of engines in cutechess-cli?

To specify the starting Elo ratings of engines in cutechess-cli, you can use the -elo option followed by a comma-separated list of Elo ratings for each engine. For example, if you want to set the starting Elo rating of engine A to 2000 and engine B to 2200, you can use the following command:

cutechess-cli -engine cmd=engine_A -engine cmd=engine_B -games 2 -rounds 2 -pgnout output.pgn -elo 2000,2200

This will run two games between engine A and engine B with two rounds each and save the output in a PGN file called output.pgn. The starting Elo rating of engine A will be set to 2000 and that of engine B will be set to 2200.

I hope this helps! Let me know if you have any other questions.
Pvt. Ryan
Posts: 65
Joined: Mon Sep 12, 2022 3:50 am
Location: Christchurch, NZ
Full name: Ray Bongalon

Re: Elo tag for cutechess

Post by Pvt. Ryan »

I'll try to experiment with the options.
JoAnnP38
Posts: 253
Joined: Mon Aug 26, 2019 4:34 pm
Location: Clearwater, Florida USA
Full name: JoAnn Peeler

Re: Elo tag for cutechess

Post by JoAnnP38 »

I think it is instructive to pay attention how answers generated by ChatGPT are being treated by stackoverflow.
Halifax
Posts: 12
Joined: Fri Nov 11, 2022 8:50 pm
Full name: Ian Rastall

Re: Elo tag for cutechess

Post by Halifax »

My apologies. Won't happen again.