A complete 2000 lines of code engine

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
User avatar
emadsen
Posts: 195
Joined: Wed Apr 25, 2012 11:51 pm
Location: Naperville, IL, USA
Contact:

Re: A complete 2000 lines of code engine

Post by emadsen » Fri Dec 28, 2018 4:47 pm

Yes, perhaps it’s a time management issue. I ran the match overnight and did not watch the games. I simply verified in the morning there were no abnormal terminations.

When I get home tonight I’ll test at 40/4 and update this thread with my results, Minic’s NPS, etc.
My C# chess engine: http://www.madchess.net

User avatar
xr_a_y
Posts: 704
Joined: Sat Nov 25, 2017 1:28 pm
Location: France

Re: A complete 2000 lines of code engine

Post by xr_a_y » Sat Dec 29, 2018 8:28 am

Ok, so here's last night results of Minic 0.28 (not really converged ... +/-60, ) at 40/0:20 :

Code: Select all

Rank Name                          Elo     +/-   Games   Score   Draws
   1 myrddin                       131      67     100   68.0%   16.0%
   2 sungorus64                     14      61     100   52.0%   22.0%
   3 zevra                         -14      60     100   48.0%   24.0%
Myrddin 0.87 is 2487, so 130 weaker is 2350. Sungorus is 2312 and zevra 1.8.6 is 2302.

The test at 40/1 against Isa 2.0.64 gives 137-113-69 for Isa so around +26elo for Isa that is 2329.

Minic seems to be between 2300 and 2400 (more 2300 than 2400). This is more or less coherent with Minic results versus Weini (or the stupid test against Fruit2.1).

I'll run an incremental TC test soon.

I guess Minic is weaker than Madchess. Madchess 3 has some good passer eval (taking king square, free, unstoppable into account). I often see Weini and Minic loss end game, I guess I should work on end game evaluation. Also Minic only see FIDE draws not "near" draw (like KRRK, KNKR, ...) so it might go to a drawish end-game thinking it can win...

User avatar
emadsen
Posts: 195
Joined: Wed Apr 25, 2012 11:51 pm
Location: Naperville, IL, USA
Contact:

Re: A complete 2000 lines of code engine

Post by emadsen » Sun Dec 30, 2018 5:34 am

Looks like Minic has time management issues for games with incremental time controls. I ran another match between MadChess 3.0 Beta and Minic 0.28 using a time control of 40 moves in 4 minutes. Minic won the match.

Code: Select all

# PLAYER          :  RATING  ERROR  CFS(%)  PLAYED    W    D    L   (%)  OppAvg
1 Minic 0.28      :  2407.0   19.7     100    1000  511  197  292    61  2329.0
2 MadChess 3.0    :  2329.0   ----     ---    1000  292  197  511    39  2407.0
The absolute ELO values are not relevant. I don't have a database of 40/4m games involving MadChess and Minic playing a pool of other engines (I test using a time control of 2m+1s). The relative ELO is what matters. Minic is 78 ELO stronger than MadChess 3.0 beta at this time control.
I guess Minic is weaker than Madchess.
Depends on the time control (until you improve Minic's time management with incremental time controls) and the version of MadChess. The 3.0 Beta version (a rewrite using bitboards still in early development) is weaker than the 2.2 release version (mailbox). So yes, Minic is weaker than MadChess 2.2 but likely stronger than 3.0 Beta.

Vivien, to answer your question from an earlier post: Minic on my PC (AMD Ryzen Threadripper 1950X) runs at ~1.1 million NPS in the middlegame.
My C# chess engine: http://www.madchess.net

User avatar
xr_a_y
Posts: 704
Joined: Sat Nov 25, 2017 1:28 pm
Location: France

Re: A complete 2000 lines of code engine

Post by xr_a_y » Sun Dec 30, 2018 8:03 am

Thanks lot for those tests.

User avatar
xr_a_y
Posts: 704
Joined: Sat Nov 25, 2017 1:28 pm
Location: France

Re: A complete 2000 lines of code engine

Post by xr_a_y » Sat Jan 05, 2019 3:44 pm

Minic 0.29 is released. Nearly +100elo.
Attachments
Capture du 2019-01-05 16-45-40.png
Capture du 2019-01-05 16-45-40.png (3.78 KiB) Viewed 1776 times

User avatar
CMCanavessi
Posts: 834
Joined: Thu Dec 28, 2017 3:06 pm
Location: Argentina

Re: A complete 2000 lines of code engine

Post by CMCanavessi » Sat Jan 05, 2019 3:56 pm

Wow, progress is so fast... "Etherealesque"
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls

User avatar
xr_a_y
Posts: 704
Joined: Sat Nov 25, 2017 1:28 pm
Location: France

Re: A complete 2000 lines of code engine

Post by xr_a_y » Sat Jan 05, 2019 4:37 pm

CMCanavessi wrote:
Sat Jan 05, 2019 3:56 pm
Wow, progress is so fast... "Etherealesque"
Thanks for the compliment, but Minic will probably never reach Ethereal strength ... and I am probably far less skilled than Andrew.

The improvement between 0.28 and 0.29 is mainly linked to a bug in TT (the previous stored score was total crap), and a better use of SEE I guess.
Evaluation is still very poor, but I'm working on it, maybe the next release will have a more complex eval.

Minic is now near 3000sloc, so my plan to stick near 2000sloc seems to vanish. Some part of the code needs quite some lines (SMP, material table, evaluation, ...). I'll try to compact things a little to get back to 2500sloc maybe ...

User avatar
xr_a_y
Posts: 704
Joined: Sat Nov 25, 2017 1:28 pm
Location: France

Re: A complete 2000 lines of code engine

Post by xr_a_y » Sun Jan 06, 2019 3:21 pm

Minic has a lichess bot now : https://lichess.org/@/Minic-chess_engine :D
It won't be playing 24/7.

MikeB
Posts: 3278
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: A complete 2000 lines of code engine

Post by MikeB » Mon Jan 07, 2019 2:51 pm

xr_a_y wrote:
Sun Jan 06, 2019 3:21 pm
Minic has a lichess bot now : https://lichess.org/@/Minic-chess_engine :D
It won't be playing 24/7.
Keep up the good work!

MikeB
Posts: 3278
Joined: Thu Mar 09, 2006 5:34 am
Location: Pen Argyl, Pennsylvania

Re: A complete 2000 lines of code engine

Post by MikeB » Mon Jan 07, 2019 3:39 pm

MikeB wrote:
Mon Jan 07, 2019 2:51 pm
xr_a_y wrote:
Sun Jan 06, 2019 3:21 pm
Minic has a lichess bot now : https://lichess.org/@/Minic-chess_engine :D
It won't be playing 24/7.
Keep up the good work!
I played a two quick knights odds games vs McCain 5 sec game with 5 sec increment. single core/thread 256 hash. They split the set.


Here's macOS Minic:
Attachments
minic_01072019-macOS.zip
(114.94 KiB) Downloaded 42 times

Post Reply