He could well be right. More games are needed.PK wrote:Thanks for the tournament
As for nanoSzachy, its author thinks that 3.7 was somehow overrated, and 3.8 is very similar (slightly faster + some endgame stuff).
21st Amateur Series Division 5
Moderator: Ras
-
Graham Banks
- Posts: 45166
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Final Standings
gbanksnz at gmail.com
-
Piotr Cichy
- Posts: 75
- Joined: Sun Jul 30, 2006 11:13 pm
- Location: Kalisz, Poland
Re: Final Standings
Versions 3.7 and 3.8 of nano are almost identical and generate in 99.99% cases the same moves. There are only 2 differences between 3.7 and 3.8:
1. added recognition of some drawish pawnless endings
2. some speed optimizations
ad 1: these endings are too rare to have any influence on playing strength
ad 2: the speedup is about 3-4%, in practice hard to notice any difference
Normally I would not release version 3.8, because it is generally the same as 3.7, but version 3.8 took place in IOPCCC, so I decided to release it.
In CCRL we can see:
NanoSzachy 3.7 2600 +37 −37 54.9% −39.0 28.2% 255
NanoSzachy 3.8 2532 +30 −30 50.9% −8.1 28.6% 377
It is strange, that almost identical engines produce so different results, their ranges of ELO even don't overlap! What is the reason? Maybe not enough games or different set of opponents?
1. added recognition of some drawish pawnless endings
2. some speed optimizations
ad 1: these endings are too rare to have any influence on playing strength
ad 2: the speedup is about 3-4%, in practice hard to notice any difference
Normally I would not release version 3.8, because it is generally the same as 3.7, but version 3.8 took place in IOPCCC, so I decided to release it.
In CCRL we can see:
NanoSzachy 3.7 2600 +37 −37 54.9% −39.0 28.2% 255
NanoSzachy 3.8 2532 +30 −30 50.9% −8.1 28.6% 377
It is strange, that almost identical engines produce so different results, their ranges of ELO even don't overlap! What is the reason? Maybe not enough games or different set of opponents?
-
Graham Banks
- Posts: 45166
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Final Standings
Taking into account what you've said, it could well be a combination of both. When I give NanoSzachy some more games, it will be with the intention of trying to get the average opponent rating closer to that of NanoSzachy 3.8.Piotr Cichy wrote:Versions 3.7 and 3.8 of nano are almost identical and generate in 99.99% cases the same moves. There are only 2 differences between 3.7 and 3.8:
1. added recognition of some drawish pawnless endings
2. some speed optimizations
ad 1: these endings are too rare to have any influence on playing strength
ad 2: the speedup is about 3-4%, in practice hard to notice any difference
Normally I would not release version 3.8, because it is generally the same as 3.7, but version 3.8 took place in IOPCCC, so I decided to release it.
In CCRL we can see:
NanoSzachy 3.7 2600 +37 −37 54.9% −39.0 28.2% 255
NanoSzachy 3.8 2532 +30 −30 50.9% −8.1 28.6% 377
It is strange, that almost identical engines produce so different results, their ranges of ELO even don't overlap! What is the reason? Maybe not enough games or different set of opponents?
Piotr - would you like the results combined under NanoSzachy 3.8? That would save me some work.
Cheers,
Graham.
gbanksnz at gmail.com
-
Graham Banks
- Posts: 45166
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Final Standings
The playoff match between Pawny 0.2 and NanoSzachy 3.8 is in progress. Pawny currently leads by 5.0-3.0, but NanoSzachy could be winning Game 9.
gbanksnz at gmail.com
-
Piotr Cichy
- Posts: 75
- Joined: Sun Jul 30, 2006 11:13 pm
- Location: Kalisz, Poland
Re: Final Standings
YesGraham Banks wrote: Piotr - would you like the results combined under NanoSzachy 3.8? That would save me some work.
-
Graham Banks
- Posts: 45166
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Final Standings
Very good. This will be done for next weekend's update because this weekend's one has already been done.Piotr Cichy wrote:YesGraham Banks wrote: Piotr - would you like the results combined under NanoSzachy 3.8? That would save me some work.
Cheers,
Graham.
PS - I like NanoSzachy. Thanks for your efforts.
gbanksnz at gmail.com
-
Graham Banks
- Posts: 45166
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Final Standings
Pawny prevailed by 6.0-4.0, so will play in Division 4 of the next series.Graham Banks wrote:The playoff match between Pawny 0.2 and NanoSzachy 3.8 is in progress. Pawny currently leads by 5.0-3.0, but NanoSzachy could be winning Game 9.
gbanksnz at gmail.com
-
Mincho Georgiev
- Posts: 454
- Joined: Sat Apr 04, 2009 6:44 pm
- Location: Bulgaria
Re: Final Standings
Great! My intention is to delay the next release until sufficient amount of games gets collected (200+) to avoid the headache for you and others testers. Thanks Graham!
-
Piotr Cichy
- Posts: 75
- Joined: Sun Jul 30, 2006 11:13 pm
- Location: Kalisz, Poland
Re: Final Standings
A pity for nanoSzachyGraham Banks wrote:Pawny prevailed by 6.0-4.0, so will play in Division 4 of the next series.Graham Banks wrote:The playoff match between Pawny 0.2 and NanoSzachy 3.8 is in progress. Pawny currently leads by 5.0-3.0, but NanoSzachy could be winning Game 9.
Graham, could you consider testing pikoSzachy instead of nanoSzachy? I think it is quite interesting engine because of it's size - only 10KB, and is not much weaker than nano.
-
Graham Banks
- Posts: 45166
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Final Standings
I'll ask the CCRL blitz testers if they could test pikoSzachy for you if they haven't already done so.Piotr Cichy wrote:A pity for nanoSzachyGraham Banks wrote:Pawny prevailed by 6.0-4.0, so will play in Division 4 of the next series.Graham Banks wrote:The playoff match between Pawny 0.2 and NanoSzachy 3.8 is in progress. Pawny currently leads by 5.0-3.0, but NanoSzachy could be winning Game 9.However, I don't plan to release new version in near future, so it probably will go down in ranking lists.
Graham, could you consider testing pikoSzachy instead of nanoSzachy? I think it is quite interesting engine because of it's size - only 10KB, and is not much weaker than nano.
I'm having difficulty keeping up with all the new engine releases at present, but I'll try to test pikoSzachy at some stage too.
Cheers,
Graham.
gbanksnz at gmail.com