ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
Hai
Posts: 455
Joined: Sun Aug 04, 2013 11:19 am

ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Post by Hai » Thu Jul 11, 2019 9:42 pm

INT8 is much better than FP16.

Some days ago at TCEC:
Scorpio INT8 vs LCZero1pct v0.21.2-n42547 +0 =4 -0
Scorpio INT8 vs LCZeroCPU v0.21.2-nLD2 +0 =4 -0

Now Scorpio INT8 vs LCZeroCPU v0.21.2-nLD2 +1 =1 -0

Will LC0 ever use INT8 instead of FP16?

Dann Corbit
Posts: 10204
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Post by Dann Corbit » Thu Jul 11, 2019 10:02 pm

I don't think we can conclude superiority from ten games.

Logically, though, faster is better. I guess that if Scorpio starts drilling LC0 into the ground, they will look at what Scorpio is doing and try to imitate it.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

Chessqueen
Posts: 632
Joined: Wed Sep 05, 2018 12:16 am
Full name: Nancy M Pichardo

Re: ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Post by Chessqueen » Fri Jul 12, 2019 4:45 am

Hai wrote:
Thu Jul 11, 2019 9:42 pm
INT8 is much better than FP16.

Some days ago at TCEC:
Scorpio INT8 vs LCZero1pct v0.21.2-n42547 +0 =4 -0
Scorpio INT8 vs LCZero1pct +0 =4 -0

Now Scorpio INT8 vs LCZeroCPU v0.21.2-nLD2 +1 =1 -0

Will LC0 ever use INT8 instead of FP16?

You are aware that LCZero1pct v0.21.2-n42547 was only using 1 pct or percent, LOOK CLOSELY.... LCZero1pct, and...... in this case LCZeroCPU v0.21.2-nLD2 +1 =1 -0 was using the cpu with a smaller Net, NOT the GPU version, therefore, the cpu version performs much worse at least 400 Elo lower than the GPU version at 100% percent :shock: :mrgreen:

Uri Blass
Posts: 8609
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Post by Uri Blass » Fri Jul 12, 2019 6:14 am

Chessqueen wrote:
Fri Jul 12, 2019 4:45 am
Hai wrote:
Thu Jul 11, 2019 9:42 pm
INT8 is much better than FP16.

Some days ago at TCEC:
Scorpio INT8 vs LCZero1pct v0.21.2-n42547 +0 =4 -0
Scorpio INT8 vs LCZero1pct +0 =4 -0

Now Scorpio INT8 vs LCZeroCPU v0.21.2-nLD2 +1 =1 -0

Will LC0 ever use INT8 instead of FP16?

You are aware that LCZero1pct v0.21.2-n42547 was only using 1 pct or percent, LOOK CLOSELY.... LCZero1pct, and...... in this case LCZeroCPU v0.21.2-nLD2 +1 =1 -0 was using the cpu with a smaller Net, NOT the GPU version, therefore, the cpu version performs much worse at least 400 Elo lower than the GPU version at 100% percent :shock: :mrgreen:
Ethereal 11.50 lost 2.5-1.5 against LCZeroCPU v0.21.2-nLD2 so I guess that the difference between the cpu version and the gpu version is less than 400 elo.

Edit:Xiphos0.5.3 also drew 2-2 against the same cpu version and Xiphos0.5 is number 5 in the CCRL 40/40 rating list

dkappe
Posts: 273
Joined: Tue Aug 21, 2018 5:52 pm
Full name: Dietrich Kappe

Re: ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Post by dkappe » Fri Jul 12, 2019 2:35 pm

ScorpioNN is good and might make it to DivP. The weakest part is probably the NN. It needed another 10-20 million self-play games to catch up to t30, but I wasn’t willing to shell out on vast.ai resources to get there. So until someone cooks up a better net, it’s likely to be a bit weaker than lc0/Allie/etc.

Also, Scorpio uses custom TB’s which are not present on TCEC, so it is essentially playing without them.

supersharp77
Posts: 764
Joined: Sat Jul 05, 2014 5:54 am
Location: Southwest USA

Re: ScorpioNN v2.9.0-n_maddex_INT8 is great:)

Post by supersharp77 » Fri Jul 12, 2019 8:49 pm

dkappe wrote:
Fri Jul 12, 2019 2:35 pm
ScorpioNN is good and might make it to DivP. The weakest part is probably the NN. It needed another 10-20 million self-play games to catch up to t30, but I wasn’t willing to shell out on vast.ai resources to get there. So until someone cooks up a better net, it’s likely to be a bit weaker than lc0/Allie/etc.

Also, Scorpio uses custom TB’s which are not present on TCEC, so it is essentially playing without them.
Scorpio NN settings are very complex.ditto for Nebiyu chess.....having trouble getting the NN's to interface properly with the engines...actually LC0 is easier to set up these days! Think a Scorpio NN autodetect feature is called for..:) :wink:

Post Reply