CCCC and TCEC hardware is unfair?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

tomitank
Posts: 276
Joined: Sat Mar 04, 2017 12:24 pm
Location: Hungary

CCCC and TCEC hardware is unfair?

Post by tomitank »

Many people think that hardware conditions are not fair.
So if Leela win, then it's basically unjust. (?)
But SF will be wrongly judge by everyone.

What do you think about this?
How would it be fairer?
Jouni
Posts: 3291
Joined: Wed Mar 08, 2006 8:15 pm

Re: CCCC and TCEC hardware is unfair?

Post by Jouni »

Leela is too weak and didn't reach final in either tournament :!: .
Jouni
tomitank
Posts: 276
Joined: Sat Mar 04, 2017 12:24 pm
Location: Hungary

Re: CCCC and TCEC hardware is unfair?

Post by tomitank »

Jouni wrote: Fri Oct 12, 2018 10:51 am Leela is too weak (and didn't reach final in either tournament :!: .)
Not for long.
User avatar
AdminX
Posts: 6340
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: CCCC and TCEC hardware is unfair?

Post by AdminX »

I judge chess engines based on the quality of the chess moves played and discovered. Seems like they are saying that GPUs should never play CPUs, AB engines can only play NN engines as long as it is on the same hardware. As for me, I really don't care. I just want to see quality chess.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: CCCC and TCEC hardware is unfair?

Post by zullil »

AdminX wrote: Fri Oct 12, 2018 11:37 am I judge chess engines based on the quality of the chess moves played and discovered. Seems like they are saying that GPUs should never play CPUs, AB engines can only play NN engines as long as it is on the same hardware. As for me, I really don't care. I just want to see quality chess.
Well said! I agree.
Modern Times
Posts: 3550
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCCC and TCEC hardware is unfair?

Post by Modern Times »

Yes, the concept of "equal hardware" is thrown out the window with GPU engines vs CPU engines.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: CCCC and TCEC hardware is unfair?

Post by Milos »

tomitank wrote: Fri Oct 12, 2018 10:46 am Many people think that hardware conditions are not fair.
So if Leela win, then it's basically unjust. (?)
But SF will be wrongly judge by everyone.

What do you think about this?
How would it be fairer?
Why do you say it's unfair? How can 50'000$ 6 months old hardware vs. 5000$ 2 years old hardware be unfair??? :lol:
Next time they should put SF to play on cellphone, that way the games will be even more spectacular. :lol: :lol: :lol:
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: CCCC and TCEC hardware is unfair?

Post by jp »

tomitank wrote: Fri Oct 12, 2018 10:46 am What do you think about this?
Did you read the thread http://talkchess.com/forum3/viewtopic.php?f=2&t=68253 at the time?
Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Re: CCCC and TCEC hardware is unfair?

Post by Nay Lin Tun »

jp wrote: Fri Oct 12, 2018 3:12 pm
tomitank wrote: Fri Oct 12, 2018 10:46 am What do you think about this?
Did you read the thread http://talkchess.com/forum3/viewtopic.php?f=2&t=68253 at the time?
I am pretty sure that 90% of people wont believe my post at that time ( at that time Leela was in division 3 in TCEC with GPU problem and had performance about 3150 only and I was claiming as equivalent to 3500 rated SF , :shock: :lol: ). And now with CCC/TCEC hardware they both are within 30 elo, either SF or Leela will likely be champion.(Unusual odd can happen in small sample size tournament though)

Right now $1200 2080Ti on leela is very close to $1300 16 cores SF Dev. (within 30 elo in favour of SF), so it is very fair for personal use at least.

Here is, how corr GM see leela.
Capture 3.PNG
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: CCCC and TCEC hardware is unfair?

Post by Dann Corbit »

Nay Lin Tun wrote: Sat Oct 13, 2018 2:09 am {snip}
And now with CCC/TCEC hardware they both are within 30 elo, either SF or Leela will likely be champion.(Unusual odd can happen in small sample size tournament though)

Right now $1200 2080Ti on leela is very close to $1300 16 cores SF Dev. (within 30 elo in favour of SF), so it is very fair for personal use at least.
{snip}
Is this correct for the current configuration:
TCEC CPU Hardware
CPUs: 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz Cores: 44 physical Motherboard: Supermicro X10DRL-i RAM: 64 GB DDR4 ECC SSD: Crucial CT250M500 240 GB Chassis: Supermicro OS: Windows Server 2012 R2

TCEC GPU Hardware
GPUs: 2xV100 CPUs: 4xSkylake vCPU RAM: 15GB SSD: 20GB + 165GB for TB OS: Ubuntu 18.04 server

If LC0 makes it to the finals against SF, that would be interesting indeed.

P.S.
Tansel Turgut is about as expert as you will find on the topic.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.