MEA is a tool (written by Ferdinand Mosca) that analyses an EPD position set in STS-style assigning bonus points pre-defined in each EPD record.
temere.epd (Latin for random) is a 4975 position set created from a much bigger random EPD collection in an intelligent way with as goal to produce a reasonable reliable ranking list of engines with an estimated error bar of -25/+25 elo at fast time controls like 100ms, 250ms, 500ms etc.
Examples
....
http://rebel13.nl/misc/mea.html
MEA and temere.epd
Moderators: hgm, Rebel, chrisw
-
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
MEA and temere.epd
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 1056
- Joined: Thu Mar 09, 2006 4:15 pm
- Location: Long Island, NY, USA
Re: MEA and temere.epd
Is this an error?
1r3rk1/3qbppp/p1npb3/1p1Np3/4P2P/2PBN3/PP3PP1/R2QK2R w KQ - bm a4; c0 "Nf5=10, a4=9, Qf3=9, Bc2=8";
1r3rk1/3qbppp/p1npb3/1p1Np3/4P2P/2PBN3/PP3PP1/R2QK2R w KQ - bm a4; c0 "Nf5=10, a4=3, Qf3=1, Bc2=0";
1r3rk1/3qbppp/p1npb3/1p1Np3/4P2P/2PBN3/PP3PP1/R2QK2R w KQ - bm a4; c0 "Nf5=10, a4=9, Qf3=9, Bc2=8";
1r3rk1/3qbppp/p1npb3/1p1Np3/4P2P/2PBN3/PP3PP1/R2QK2R w KQ - bm a4; c0 "Nf5=10, a4=3, Qf3=1, Bc2=0";
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: MEA and temere.epd
If you get the EPD position set big enough and the evaluation quality of the moves high enough, this could get really close to measuring playing strength. The results are already quite good.
One thing such an approach would require is to score more moves. An engine should lose some points compared to the maximum when playing an inaccuracy, but it should lose a lot when playing an outright blunder.
I could imagine that with enough refinements, such an approach could begin giving good insights on a patch quality.
EDIT : I think it would make more sense to compare with FastGM bullet ratings. Much lower error bars than CCRL.
One thing such an approach would require is to score more moves. An engine should lose some points compared to the maximum when playing an inaccuracy, but it should lose a lot when playing an outright blunder.
I could imagine that with enough refinements, such an approach could begin giving good insights on a patch quality.
EDIT : I think it would make more sense to compare with FastGM bullet ratings. Much lower error bars than CCRL.
-
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
Re: MEA and temere.epd
Ah, a double after all, odd...Norm Pollock wrote: ↑Tue Apr 07, 2020 12:53 am Is this an error?
1r3rk1/3qbppp/p1npb3/1p1Np3/4P2P/2PBN3/PP3PP1/R2QK2R w KQ - bm a4; c0 "Nf5=10, a4=9, Qf3=9, Bc2=8";
1r3rk1/3qbppp/p1npb3/1p1Np3/4P2P/2PBN3/PP3PP1/R2QK2R w KQ - bm a4; c0 "Nf5=10, a4=3, Qf3=1, Bc2=0";
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
Re: MEA and temere.epd
I am not so optimistic as you Doing this too long. But who knows? I am now creating creating a second temere set, we will see. Maybe this just was a lucky shot.Alayan wrote: ↑Tue Apr 07, 2020 2:10 am If you get the EPD position set big enough and the evaluation quality of the moves high enough, this could get really close to measuring playing strength. The results are already quite good.
One thing such an approach would require is to score more moves. An engine should lose some points compared to the maximum when playing an inaccuracy, but it should lose a lot when playing an outright blunder.
I could imagine that with enough refinements, such an approach could begin giving good insights on a patch quality.
The thing with FastGM is that contrary to CCRL FastGM only test top-engines. But there is an easy fix, use the FastGM elo's in the "set CCRL=" option, then open "new.html" with a text editor and replace "CCRL" into "FastGM", save the file.EDIT : I think it would make more sense to compare with FastGM bullet ratings. Much lower error bars than CCRL.
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 433
- Joined: Fri Dec 16, 2016 11:04 am
- Location: France
- Full name: Richard Delorme
Re: MEA and temere.epd
I guess many active chesss engine developers use linux instead of windows here. Is there a linux port of this software suite?
Richard Delorme
-
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
Re: MEA and temere.epd
Unfortunately my compiler doesn't support Linux.
90% of coding is debugging, the other 10% is writing bugs.
-
- Posts: 1871
- Joined: Sat Nov 25, 2017 2:28 pm
- Location: France
Re: MEA and temere.epd
As the .edp is given in the zip file, it is easy to run it by yourself in your own tool.
-
- Posts: 1871
- Joined: Sat Nov 25, 2017 2:28 pm
- Location: France
Re: MEA and temere.epd
Not using given scores for alternatives moves, Minic @1sec per position is finding 3147 best moves (the are 4975 fen in the file). Isn't that too much good results for Minic ?
-
- Posts: 6991
- Joined: Thu Aug 18, 2011 12:04 pm
Re: MEA and temere.epd
What I understood from a previous discussion is that MEA.exe (which is a Python application) won't run under Wine, the rest of the package (mrl.exe and csv.exe) does. Maybe one should install Python first?
https://www.google.nl/search?sourceid=n ... 6271258004
90% of coding is debugging, the other 10% is writing bugs.