Open Source Blitz: Cheng3 1.07

[lucasart]

New version of Cheng3 by Martin Sedlak. Testing in progress, but estimated rating so far, after 148/400 games

Code: Select all

Rank Name                  Elo    +    - games score oppo. draws 
   1 Critter 1.4          3242   33   32   350   74%  3044   34% 
   2 IvanHoe 999946h      3185   31   31   350   64%  3061   37% 
   3 Stockfish 2.2.1      3166   31   30   400   66%  3015   32% 
   4 Protector 1.4        2913   34   34   350   46%  2949   22% 
   5 Umko 1.2             2859   28   28   500   50%  2870   24% 
   6 Toga 1.4.1           2836   26   26   600   55%  2813   22% 
   7 Daydreamer 1.75      2734   27   27   450   60%  2660   29% 
   8 Fruit 2.1            2700   25   24   550   52%  2683   27% 
   9 Crafty 23.4          2653   27   27   500   38%  2760   24% 
  10 Cheng3 1.07          2644   48   47   148   65%  2538   25% 
  11 GNU Chess 5.07.173b  2642   26   26   500   47%  2666   27% 
  12 Arasan 13.4          2633   29   29   400   44%  2675   23% 
  13 Rodent 0.10          2624   29   28   400   55%  2589   25% 
  14 Pepito 1.59          2589   25   25   548   52%  2569   21% 
  15 Sloppy 0.2.2         2537   22   23   700   43%  2581   23% 
  16 Greko 9.0            2491   23   23   700   44%  2542   21% 
  17 Pawny 0.3.1          2469   26   26   500   50%  2469   19% 
  18 DoubleCheck 2.5      2420   30   30   400   48%  2436   15% 
  19 Olithink 5.3.0       2376   33   33   300   46%  2400   20% 
  20 EXchess 6.0.2        2352   31   32   350   41%  2423   19% 
  21 Sungorus 1.4         2342   29   30   400   37%  2445   22% 
  22 Jazz 501             2328   33   34   300   40%  2408   20% 

[lucasart]

Updated ratings after 223/400 games. Now Cheng is seriously competing with Crafty for the 9th place

Code: Select all

Rank Name                  Elo    +    - games score oppo. draws 
   1 Critter 1.4          3242   33   32   350   74%  3044   34% 
   2 IvanHoe 999946h      3185   31   31   350   64%  3061   37% 
   3 Stockfish 2.2.1      3166   31   30   400   66%  3014   32% 
   4 Protector 1.4        2913   34   34   350   46%  2949   22% 
   5 Umko 1.2             2859   28   28   500   50%  2870   24% 
   6 Toga 1.4.1           2836   26   26   600   55%  2813   22% 
   7 Daydreamer 1.75      2734   27   27   450   60%  2660   29% 
   8 Fruit 2.1            2700   25   25   550   52%  2683   27% 
   9 Cheng3 1.07          2659   39   38   223   63%  2568   23% 
  10 Crafty 23.4          2653   27   27   500   38%  2760   24% 
  11 GNU Chess 5.07.173b  2642   26   26   500   47%  2666   27% 
  12 Arasan 13.4          2631   28   29   423   44%  2674   23% 
  13 Rodent 0.10          2622   27   27   450   53%  2597   24% 
  14 Pepito 1.59          2590   25   25   550   52%  2571   21% 
  15 Sloppy 0.2.2         2538   23   23   700   43%  2582   23% 
  16 Greko 9.0            2492   23   23   700   44%  2544   21% 
  17 Pawny 0.3.1          2470   26   26   500   50%  2470   19% 
  18 DoubleCheck 2.5      2422   30   30   400   48%  2437   15% 
  19 Olithink 5.3.0       2377   33   33   300   46%  2402   20% 
  20 EXchess 6.0.2        2354   31   32   350   41%  2425   19% 
  21 Sungorus 1.4         2344   29   30   400   37%  2446   22% 
  22 Jazz 501             2329   33   34   300   40%  2410   20% 

[mar]

Updated ratings after 223/400 games. Now Cheng is seriously competing with Crafty for the 9th place

Thanks Lucas but I believe the score will still settle, cheng is nowhere near the strength of Crafty, I'm pretty sure of that

Martin

[lucasart]

Updated ratings after 223/400 games. Now Cheng is seriously competing with Crafty for the 9th place

Thanks Lucas but I believe the score will still settle, cheng is nowhere near the strength of Crafty, I'm pretty sure of that

Martin

Sorry to contradict you, but the more games I play the more Cheng's elo settles around 2650. Perhaps you're overestimating Crafty ? Crafty is only 50 elo weaker then Fruit 2.1. This is all using 1 thread, and at 1'+1" time control. Of course if you use a quad core, and allow Crafty to use 4 threads SMP while the others use 1 thread, it would gain some elo, but probably not more than 100 elo. So Crafty is not the unbeatable monster you imagine

Here's an unpdate after more games:

Code: Select all

Rank Name                  Elo    +    - games score oppo. draws 
   1 Critter 1.4          3244   33   32   350   74%  3046   34% 
   2 IvanHoe 999946h      3186   31   31   350   64%  3062   37% 
   3 Stockfish 2.2.1      3167   31   30   400   66%  3016   32% 
   4 Protector 1.4        2915   34   34   350   46%  2950   22% 
   5 Umko 1.2             2861   28   28   500   50%  2872   24% 
   6 Toga 1.4.1           2838   26   26   600   55%  2814   22% 
   7 Daydreamer 1.75      2736   27   27   450   60%  2661   29% 
   8 Fruit 2.1            2700   24   24   585   52%  2682   26% 
   9 Crafty 23.4          2656   26   26   547   39%  2752   22% 
  10 Cheng3 1.07          2655   32   31   340   58%  2601   21% 
  11 GNU Chess 5.07.173b  2641   25   25   508   47%  2667   28% 
  12 Arasan 13.4          2636   27   28   450   45%  2674   22% 
  13 Rodent 0.10          2623   27   27   450   53%  2598   24% 
  14 Pepito 1.59          2590   25   25   550   52%  2571   21% 
  15 Sloppy 0.2.2         2539   22   23   700   43%  2583   23% 
  16 Greko 9.0            2492   23   23   700   44%  2544   21% 
  17 Pawny 0.3.1          2471   26   26   500   50%  2471   19% 
  18 DoubleCheck 2.5      2422   30   30   400   48%  2437   15% 
  19 Olithink 5.3.0       2378   33   33   300   46%  2402   20% 
  20 EXchess 6.0.2        2354   31   32   350   41%  2425   19% 
  21 Sungorus 1.4         2344   29   30   400   37%  2447   22% 
  22 Jazz 501             2330   33   34   300   40%  2410   20% 

PS: Cheng crashed twice already, once against GNU Chess, and once against Crafty. I removed the games and will terminate these matches later.

[mar]

Updated ratings after 223/400 games. Now Cheng is seriously competing with Crafty for the 9th place

Thanks Lucas but I believe the score will still settle, cheng is nowhere near the strength of Crafty, I'm pretty sure of that

Martin

Sorry to contradict you, but the more games I play the more Cheng's elo settles around 2650. Perhaps you're overestimating Crafty ? Crafty is only 50 elo weaker then Fruit 2.1. This is all using 1 thread, and at 1'+1" time control. Of course if you use a quad core, and allow Crafty to use 4 threads SMP while the others use 1 thread, it would gain some elo, but probably not more than 100 elo. So Crafty is not the unbeatable monster you imagine

Here's an unpdate after more games:

Code: Select all

Rank Name                  Elo    +    - games score oppo. draws 
   1 Critter 1.4          3244   33   32   350   74%  3046   34% 
   2 IvanHoe 999946h      3186   31   31   350   64%  3062   37% 
   3 Stockfish 2.2.1      3167   31   30   400   66%  3016   32% 
   4 Protector 1.4        2915   34   34   350   46%  2950   22% 
   5 Umko 1.2             2861   28   28   500   50%  2872   24% 
   6 Toga 1.4.1           2838   26   26   600   55%  2814   22% 
   7 Daydreamer 1.75      2736   27   27   450   60%  2661   29% 
   8 Fruit 2.1            2700   24   24   585   52%  2682   26% 
   9 Crafty 23.4          2656   26   26   547   39%  2752   22% 
  10 Cheng3 1.07          2655   32   31   340   58%  2601   21% 
  11 GNU Chess 5.07.173b  2641   25   25   508   47%  2667   28% 
  12 Arasan 13.4          2636   27   28   450   45%  2674   22% 
  13 Rodent 0.10          2623   27   27   450   53%  2598   24% 
  14 Pepito 1.59          2590   25   25   550   52%  2571   21% 
  15 Sloppy 0.2.2         2539   22   23   700   43%  2583   23% 
  16 Greko 9.0            2492   23   23   700   44%  2544   21% 
  17 Pawny 0.3.1          2471   26   26   500   50%  2471   19% 
  18 DoubleCheck 2.5      2422   30   30   400   48%  2437   15% 
  19 Olithink 5.3.0       2378   33   33   300   46%  2402   20% 
  20 EXchess 6.0.2        2354   31   32   350   41%  2425   19% 
  21 Sungorus 1.4         2344   29   30   400   37%  2447   22% 
  22 Jazz 501             2330   33   34   300   40%  2410   20% 

PS: Cheng crashed twice already, once against GNU Chess, and once against Crafty. I removed the games and will terminate these matches later.

Well the fact is that cheng is better at blitz. Perhaps that might be the reason.
But I thought Crafty is already better than Fruit. Strange.
The crashes are a disturbing. 2 crashes in 300 games is a lot. I have to admit that I had some very rare crashes since 1.05 (about 1 crash in 1500 games), but i was unable to track them. So I guess I will have to look into that... Thanks again Lucas. 2650 would be very nice.

Martin

[lucasart]

Thanks again Lucas.

Thank you for sharing your work with the open source community

My only rant against Cheng is that the source code is still quite messy and hard to read. But I'm sure it's all work in progress and improving day by day!

[mar]

Thanks again Lucas.

Thank you for sharing your work with the open source community

My only rant against Cheng is that the source code is still quite messy and hard to read. But I'm sure it's all work in progress and improving day by day!

You're welcome
Yes the code is very messy, I prevent cloning that way and I get more LCCRL points as a bonus
No really it's getting harder to read even for myself.
But as you said it's work in progress, i'm certainly not a guy who prints his wonderful code and puts it on the wall (=i'm not obsessed with coding style nor design patterns, I hate the word "Factory" and m_ prefixes).
Anyway cleaning it up seems inevitable, sooner or later.

Martin

[lucasart]

Thanks again Lucas.

Thank you for sharing your work with the open source community

My only rant against Cheng is that the source code is still quite messy and hard to read. But I'm sure it's all work in progress and improving day by day!

You're welcome
Yes the code is very messy, I prevent cloning that way and I get more LCCRL points as a bonus
No really it's getting harder to read even for myself.
But as you said it's work in progress, i'm certainly not a guy who prints his wonderful code and puts it on the wall (=i'm not obsessed with coding style nor design patterns, I hate the word "Factory" and m_ prefixes).
Anyway cleaning it up seems inevitable, sooner or later.

Martin

As a bonus, I've already found bugs while cleaning up my code. At some point, I just didn't understand parts of code, so I read them again and again, in order to rewrite them in a cleaner way... Only to realize the code was actually buggy

[mar]

As a bonus, I've already found bugs while cleaning up my code. At some point, I just didn't understand parts of code, so I read them again and again, in order to rewrite them in a cleaner way... Only to realize the code was actually buggy

Sure I hope to find bugs that way. There's a lot of stuff i would like to get rid of, especially legacy board.cpp and search.h coming from cheng2 (never released). But I've also experienced the opposite in the past, "fixing" bugs where I didn't fully understand my own code and thought there's something wrong with it (usually too late and tired). So I think that I'll get rid of some and produce some new. Happens all the time

Martin

[Uri Blass]

You are not the only person who think Crafty 1 cpu is better than Fruit

Here is the CEGT 40/20 opinion:

398 Crafty 23.4 x64 1CPU 2821 20 20 743 51.1% 2813 34.7%
538 Fruit 2.1 2713 8 8 4435 56.1% 2670 34.6%

Maybe you use 32 bits but the difference between 32 bits and 64 bits should be clearly less than 100 elo.