Search found 330 matches

by OliverBr
Mon Jul 27, 2020 4:01 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

This may be a mistake.. Arasan 22.1 resigned while winning. It looks like it happened one other time, the other wins were correct. Could be a bug. I'll see if I can reproduce. I usually run matches with the "-t" flag to Arasan on the command line, which causes it to put out a lot of debug informati...
by OliverBr
Sun Jul 26, 2020 9:29 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

11.7 was a long time ago. There were a lot of steps. There is actually a lengthy changelog if you want to see: https://github.com/jdart1/arasan-chess/blob/master/doc/CHANGES --Jon It would be interesting to know which steps were most strength gaining. PS: In this very moment I let Leela (with a GTX...
by OliverBr
Sun Jul 26, 2020 2:35 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

Standard practic for most of the strong engines including Stockfish is to use matches of the new candidate version against the previous commit. I do sometimes run gauntlet matches against other engines for gauging progress, but I don't any longer routinely use these for testing changes. --Jon Hi Jo...
by OliverBr
Fri Jul 24, 2020 8:32 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

Jealous of your 32. Been looking at possibilities, but it’s a maze out there. Actually, it's less expensive than I thought before, about 140 EUR/month. If you consider that the CPU alone costs 2500 EUR, I find the price quite good. Only drawback, while not for me: You have to use Linux, because wit...
by OliverBr
Fri Jul 24, 2020 1:16 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

Windows Task Manager, you can monitor CPU usage for each core and with GPU-X, the temperature of your CPU. Pushing either of those to limits probably not a good idea. You could also send nps to a logfile and monitor that. If your 20 core machine runs 40 threads at, let's say 50% of nps when running...
by OliverBr
Thu Jul 23, 2020 10:11 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

My engine does not have parallel search either, but for testing any CPU helps to collect as much games as possible. This week I rented a 32 Core system, it was less expensive than one may think and I am quite happy with it, because cutechess-cli with concurrency 32 runs really smoothly. Tinker could...
by OliverBr
Thu Jul 23, 2020 8:18 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

For 4 and 8 CPU matches I use 3 sec inc. This is quite a lot. I like to play 40/90 which is more than 2 seconds per move. But this is very slow and I am not a very patient person. Even with a 32 Core Machine this is needs several hours to play 2000 games in order to get reliable results. I am still...
by OliverBr
Thu Jul 23, 2020 1:14 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

I have some question to other users who use cutechess or similar software.

Which is you preferred Time Control in order to play thousands of matches?

Which is your setting about resign and draw? How much CPU can be saved with it?
by OliverBr
Thu Jul 23, 2020 1:11 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Looking for automatic Engine Testing Software
Replies: 51
Views: 2515

Re: Looking for automatic Engine Testing Software

There was a time when Fruit 2.1 was the strongest chess engine in the world. And teeny source code Olithink is closing in fast. :shock: Unfortunately it is not that fast. I am fighting now for 10 ELOs and need thousands of game in order to measure it. From a relative point of view in 2008 OliThink ...
by OliverBr
Wed Jul 22, 2020 6:17 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Cutechessing with Fruit/Gnuchess on a 16-core errors with "connection stalls"
Replies: 8
Views: 455

Re: Cutechessing with Fruit/Gnuchess on a 16-core errors with "connection stalls"

Fruit 2.1 does not support XBoard protocol. AFAIK GNU Chess 6 is a version of Fruit that combines a version of Polyglot hacked to use the GNU dialect fo XBoard protocol and the Fruit engine in one executable. It might be multi-threaded, using separate threads to run the adapter and the engine. Than...