Weird results Tunguska 1.1 vs Jonny 4.0

[Guenther]

I checked some of the game, there are not that bad.

It would be sufficient to have depth lowered by some factor...
(cpu load due to too much concurrent games and other possibilities)

example vs. Minic
10. Bf4? discarded at depth 8 , 13.Bf2?? discarded at depth 7, both in less than 0.5 sec
(and Jonny is exremely fast in nps and reaches quite high depths normally despite being from 2010)

[pgn][Event "CCRL 40/4"] [Site "CCRL"] [Date "2019.04.28"] [Round "222.5"] [White "Jonny 4.00"] [Black "Minic 0.47 64-bit 4CPU"] [Result "0-1"] [ECO "C02"] [WhiteElo "2746"] [BlackElo "2880"] [PlyCount "55"] [EventDate "2019.??.??"] 1. e4 e6 2. d4 d5 3. e5 c5 4. c3 Nc6 5. Nf3 Nge7 6. Na3 Nf5 7. Nc2 cxd4 8. g4 Nh4 9. Ncxd4 Bd7 10. Bf4 Nxd4 11. Nxd4 Bc5 12. Be3 O-O 13. f4 Rc8 14. Bf2 Ng6 15. Qd2 f6 16. Bg3 fxe5 17. fxe5 Nh4 18. Be2 Bxd4 19. Qxd4 Bb5 20. Qxa7 Ng2+ 21. Kd2 d4 22. c4 Qg5+ 23. Kc2 Qe3 24. Kd1 Bxc4 25. Bxc4 Rxc4 26. Qa3 d3 27. Qxf8+ Kxf8 28. Rf1+ 0-1[/pgn]

[xr_a_y]

Yes clearly something wrong but not like win on time or crash.

[Guenther]

Yes clearly something wrong but not like win on time or crash.

Of course wins on time or crashes would be checked for a reason.

More subtile errors could go unchecked (for a while), although one would expect
a check, if an established program suddenly loses 10 or 20 or more games
in a row vs. an equal opponent.
Moreover I would always run the full pgn (which we don't have now) against a depth stats program.
(e.g. search for the 'Devel' incident
viewtopic.php?f=6&t=65572&p=736948&hili ... em#p736948)

[xr_a_y]

I wasn't aware, and now even more thankful, that the testing process was so professional.
Thanks again to all testers.

[Guenther]

I wasn't aware, and now even more thankful, that the testing process was so professional.
Thanks again to all testers.

Well, I am no CCRL tester, I only described what I would do, if it was my test ;-)

[Sergio Martinez]

Certainly there are something bad here. I cant check now (out of home) but i will investigate it the monday.

I have seen these last games of Jonny were played in my Dual Xeon 5675. I leave some cores free there (Xeon has 12cores and I use 8-9 at same time max) so it cant be the reason.

I use Arena Gui (3.51), at the moment I dont know the reason why Jonny plays this way but i will try to repeat the games and I will tell you.

Thank you guys.

[xr_a_y]

So you discarded all recent Jonny's games ?

[Modern Times]

So you discarded all recent Jonny's games ?

A work in progress. Jonny's default hash size is a tiny 1MB and the theory is that Arena is sometimes not setting the hash size correctly, which means it plays with the default 1MB which cripples it. The Arena bug is discussed here:

viewtopic.php?t=46586

[Guenther]

So you discarded all recent Jonny's games ?

A work in progress. Jonny's default hash size is a tiny 1MB and the theory is that Arena is sometimes not setting the hash size correctly, which means it plays with the default 1MB which cripples it. The Arena bug is discussed here:

viewtopic.php?t=46586

I don't think 1MB hash cripples as much as the results shown in some cases, especially if the real tc was perhaps 40/2.5.
(will try a few test matches with 1MB for Jonny vs. 512MB others)
I guess you still have the commented games somewhere with eval/depths and may be taskmanager logs?

BTW except for the 7 or 8 results already mentioned by me, I also later noticed a very strange behaviour in a very long match
vs. Godel 4.07 in 2018, where the CCRL 40/4 head to head table shows 24 losses in a row for Jonny 4.00 in the last
third of the match.
This match has the strange length of 112 games, which seems unusual?

(not sure though, if you resort the games even in a single match for whatever reason?)
The chance for this between programs of may be a diff of 40-45 rating points is... uhm... slightly around zero.

[Modern Times]

BTW except for the 7 or 8 results already mentioned by me, I also later noticed a very strange behaviour in a very long match
vs. Godel 4.07 in 2018, where the CCRL 40/4 head to head table shows 24 losses in a row for Jonny 4.00 in the last
third of the match.

Yes they go back to 2017 and maybe before. There are several opponents affected.