What is the most important thing in an engine for you?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Ferdy
Posts: 4853
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: What is the most important thing in an engine for you?

Post by Ferdy »

fern wrote:..must lose to me from time to time.
[...]

Fern
I am working or thinking of ways how to do it. From a research of other engines with personality styles created, I got disappointed when the lowest level around 600 or 1000 elo is still able to mate me. I intentionally played a blunder move but this little elo creature was able to capitalize which in real life a 1000 elo guy is not able to see :D .

Try my attempt to improve from these supposedly fun personality. I created a personality where if you blunder, the engine will also pretend that it did not see it. Example "MyLevel" where it attempts to always equalize, most often it will lose to a player because what it thinks as equal is actually not after some deep analysis. Now if you go below that MyLevel (4, 3, 2, 1, 0, Min) your attacking capability will be tested because it hardly defends itself until its score is below 1000 or so depends on the level. Beware of level Min where that style will give you mate in 1, 2, 3, 4, or 5 depends on how you want it to end in number of moves :) - Losers chess. This is unfortunate, that engine is Sigla, capable of only playing s-chess or seirawan chess.
Last edited by Ferdy on Wed Apr 18, 2012 9:33 am, edited 1 time in total.
Ferdy
Posts: 4853
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: What is the most important thing in an engine for you?

Post by Ferdy »

pichy wrote:
fern wrote:..must lose to me from time to time. After that, a gui full of frills and bells.

Fern
What I want from an engine beside being over 3000+ is to be able to detect, impossible to find or time consuming for engines, sacrifices.
Unfortunately most engines have difficulties sacrificing and they don't have the right tool to make the correct analysis. Therefore, they should have the analystical and sacrifice capabilities of Sting SF 2.0 (beta):
Try convincing those 3000+ elo engine authors to create a personality where it will sacrifice material as long as the remaining material is still capable to win and the score of that sacrifice move will not be worse than a margin of say 80 centi pawns from the best score of the search found so far. Increasing that margin will be more fun :) .
Ferdy
Posts: 4853
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: What is the most important thing in an engine for you?

Post by Ferdy »

I go for it's style to look at different games through different eyes. I also am particular about the GUI that houses it. CB GUI is my baby, I am comfortable with it and visually it gives me all the info I need to know.

Being able to play with the parameters of the engine is a nice touch too.
I agree with this.
User avatar
Don
Posts: 5106
Joined: Tue Apr 29, 2008 4:27 pm

Re: What is the most important thing in an engine for you?

Post by Don »

pichy wrote:I find it hard to believe that most of the people who post here are only interested in getting the engines that that have the higher rating as if all that they want to do is to pit engine vs engine. I want more from an engine than just a high Elo, such as being able to solve simple positions that even a Human Master can solve.
That's a great question, I will pay attention to the answers as I am a chess author.

For me personally the holy grail of computer chess is getting program to play strong positional chess. Being able to see mate in 30 and being superb in tactics - well ... what program is not already superb in this area? So it's important to me (just from my own personal wish list point of view) to do something different than what every other program can do. Ironically, Komodo is one of the best tactical engines anyway (although not the best) which is just a side-effect of being very strong.

I'm going to leave out user-interface features, because I don't think that is what you are really asking about. But another thing that is important is to have a program that is just plain different. A lot of programs play very similar, in some ways all chess program do, and I think a lot of people want variety and you will see that many of us here are interested not just in a strong or the strongest program but have MANY programs in their collection and appreciate the differences.

Personally I'm not really big on problem solving but I know that is important to some people. Komodo was designed with the idea of playing games with people and other programs, not solving composed problems - I guess that goes back to may statement about tactics being only a minor consideration for me personally.

What I do HATE is a program with lot's of knowledge gaps. Unfortunately every single program has that! There is no general solution except to work harder. What is rather silly to see is a program like Komodo or Critter playing 3000+ ELO chess and then getting into some ending that it cannot understand but that a 1200 ELO player easily understands. Please note that I don't mean ridiculous composed positions designed specifically to throw off computers where a tempo or two changes everything such as counting pawn races and such, but serious evaluation issues that do not involve tactics.
Capital punishment would be more effective as a preventive measure if it were administered prior to the crime.
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: What is the most important thing in an engine for you?

Post by S.Taylor »

pichy wrote:I find it hard to believe that most of the people who post here are only interested in getting the engines that that have the higher rating as if all that they want to do is to pit engine vs engine. I want more from an engine than just a high Elo, such as being able to solve simple positions that even a Human Master can solve.
I would have thought that the higher the elo, the more it would do what a human can do. So by pitting them against each other, you will eventually get the one which does the best on all fronts.

I'm actually rather sure that already now, the top elo program can hardly be beaten by any human, and not much longer, ever.

[soon, with just a few more elo, it should also clear up its few remaining blind spots. But this too, will be seen in elo].
BubbaTough
Posts: 1154
Joined: Fri Jun 23, 2006 5:18 am

Re: What is the most important thing in an engine for you?

Post by BubbaTough »

S.Taylor wrote: soon, with just a few more elo, it should also clear up its few remaining blind spots.
Alas, I doubt this is true.

-Sam
S.Taylor
Posts: 8514
Joined: Thu Mar 09, 2006 3:25 am
Location: Jerusalem Israel

Re: What is the most important thing in an engine for you?

Post by S.Taylor »

BubbaTough wrote:
S.Taylor wrote: soon, with just a few more elo, it should also clear up its few remaining blind spots.
Alas, I doubt this is true.

-Sam
Why not? Won't clearing up present blind spots give it more elo, and not doing so, impede some future elo?
pichy
Posts: 2564
Joined: Thu Mar 09, 2006 3:04 am

Re: What is the most important thing in an engine for you?

Post by pichy »

S.Taylor wrote:
BubbaTough wrote:
S.Taylor wrote: soon, with just a few more elo, it should also clear up its few remaining blind spots.
Alas, I doubt this is true.

-Sam
Why not? Won't clearing up present blind spots give it more elo, and not doing so, impede some future elo?
I know what you are referring to, for instance in this position underneath Critter, Rybka, Stockfish and Komodo (3000 + engines) all play the wrong move leading into a draw, instead of chosing Bf8+ and with a few more moves forcing the exchance of Rook for Queen + the h pawn and winning the game.

[Event "?"]
[Site "?"]
[Date "2012.04.18"]
[Round "?"]
[White "Komodo3-32"]
[Black "Komodo3-32"]
[Result "1/2-1/2"]
[BlackElo "3040"]
[Time "22:57:13"]
[WhiteElo "3040"]
[TimeControl "0+20"]
[SetUp "1"]
[FEN "6R1/8/2pB3k/2P4p/5p1q/5P2/4P1K1/8 w - - 0 1"]
[Termination "normal"]
[PlyCount "71"]
[WhiteType "program"]
[BlackType "program"]

1. Rf8 (1. Re8 Qg3+ 2. Kf1 Qh3+ 3. Ke1 Qg2 4. Rh8+ Kg7 5. Rxh5 Kg6 6. Re5
Qg1+ 7. Kd2 Qa1 8. Re6+ Kf7 9. Re7+ Kg6 10. Re4 Qa5+ 11. Kd3 Qa3+ 12. Kc2
Qa2+ 13. Kc3 Qa3+ 14. Kc4 Qb2 15. Re6+ Kh5 16. Re8 Kg5 17. Re5+ Kh4 18. Re4
Kh3 19. Bxf4 Kg2 20. Be5 Qb5+ 21. Kd4 Kf2 22. Bd6 Qb2+ 23. Kd3 Ke1 24. Be5
Qb5+ 25. Rc4 Qb1+ 26. Ke3 Qd1 27. Rc3 Qxe2+ 28. Kf4 Qd2+ 29. Kf5 Qd7+ 30.
Kf6 Qd8+ 31. Kf5 Qc8+ 32. Kg5 Qg8+ 33. Kf5 Qf7+ 34. Kg5 Ke2 35. f4 Qe6 36.
Bg7 Qd7 37. Be5 Qe7+ 38. Kf5 Qf8+ 39. Kg4 Qe8 40. Kf5 Kd1 41. Rd3+ Kc2 42.
Ra3 Qd7+ 43. Kf6 Qd8+ 44. Kg6 Qd5 45. Bd6 Qe6+ 46. Kg5 Qg8+ 47. Kf6 Qd8+
48. Ke6 Qe8+ 49. Be7 Qg6+ 50. Kd7 Qf7 51. f5 Qxf5+ 52. Kxc6 Qe4+ 53. Kd6
Qf4+ 54. Kd7 Qb4 55. Ra7 Qe4 56. Kd8 Kc3 57. Ra3+ Kb4 58. Ra6 Qd5+ 59. Bd6
Kb5 60. Rb6+ Kc4 61. Kc7 Qf7+ 62. Kc6 Qf5 63. Rb8 Qe4+ 64. Kc7 Qh7+ 65. Kc6
Qf5 66. Re8 Qg4 67. Kb6 Qd4 68. Re2 Qd3 69. Re5 Qa3 70. Kc6 Qa4+ 71. Kb7
Qb5+ 72. Kc7 Qa5+ 73. Kd7 Qa7+ 74. Bc7 Qxc5 75. Rxc5+ Kxc5 {Insufficient
material}) 1. .. Qg3+ 2. Kf1 Qh3+ 3. Kf2 Qh2+ 4. Kf1 Qh1+ 5. Kf2 Qh4+ 6.
Kg2 Kg6 7. Rxf4 Qg5+ 8. Kf2 Qd5 9. e4 Qd2+ 10. Kg3 Qd4 11. Rf5 Qg1+ 12. Kh3
Qf2 13. Be7 Qf1+ 14. Kg3 Qg1+ 15. Kh3 Qf1+ 16. Kh4 Qe1+ 17. Kh3 Qc1 18.
Rf6+ Kg7 19. Rf5 Qh1+ 20. Kg3 Qe1+ 21. Kh3 Kg6 22. Kg2 Qb4 23. Kh3 Qe1 24.
Rf6+ Kg7 25. Rf5 Qd2 26. Kh4 Qh2+ 27. Kg5 h4 28. Bd6 Qf2 29. Kg4 Kg6 30.
Rg5+ Kf7 31. Rh5 Kg6 32. Rxh4 Qg1+ 33. Kh3 Qf1+ 34. Kg3 Qe1+ 35. Kg4 Qg1+
36. Kh3 1/2-1/2

[d]8/2BK4/8/2k5/8/8/8/8 w - - 0 76

Now take a look at Houdini which is in a class by itself, simply amazing

Jorge, interesting position. This is a zugzwang problem which may cause a problem to engines because of null moves.
Here's Houdini's take, using 3 threads on a Core i5-750:
Code:
6R1/8/2pB3k/2P4p/5p1q/5P2/4P1K1/8 w - -

Engine: Houdini DEV 3T (2048 MB)
by Robert Houdart

4/14 0:00 0.00 1.Be5 Kh7 2.Rg7+ Kh6 3.Rg8 Kh7 (1.369)
...
11/24 0:00 -0.14 1.Rf8 Qe1 2.Bxf4+ Kg6 3.Re8 Qc3
4.Bd6 Qc4 5.Re4 Qa2 6.Kf2 Kf5 7.Re5+ Kg6 (98.576) 3520
...
22/43 0:02 0.00 1.Rf8 Qe1 2.Bxf4+ Kg6 3.Re8 Qc3
4.Bd6 Qc4 5.e4 Qe2+ 6.Kg3 Qe1+ 7.Kg2 Qe3
8.Re6+ Kf7 9.Re7+ Kf6 10.Re5 Qe2+
11.Kg3 Qe1+ 12.Kg2 Qd2+ 13.Kg3 Kg6
14.Re6+ (14.155.617) 6553
...
32/59 0:39 0.00 1.Rf8 Qe1 2.Bxf4+ Kg6 3.Re8 Qc3
4.Bd6 Qc4 5.e4 Qe2+ 6.Kg3 Qe1+ 7.Kg2 Qe3
8.Re6+ Kf7 9.Re7+ Kf6 10.Re5 Qe2+
11.Kg3 Qe1+ 12.Kf4 Qc1+ 13.Kg3 Qg1+
14.Kf4 (275.723.867) 6897

32/60 0:52 +0.04++ 1.Bf8+ (364.867.951) 6992

32/60 0:54 +0.14++ 1.Bf8+ (380.915.045) 7013

32/64 0:56 +0.37++ 1.Bf8+ (399.304.568) 7033

32/66 0:59 +1.17++ 1.Bf8+ (422.345.062) 7056

32/66 1:04 +4.25++ 1.Bf8+ (455.314.294) 7102

32/79 1:49 +12.34++ 1.Bf8+ (858.348.298) 7844

32/81 1:50 +12.31 1.Bf8+ Kh7 2.Rg7+ Kh8 3.Be7 Qe1
4.Bf6 Qxe2+ 5.Kh1 Qc4 6.Ba1 h4 7.Bf6 Qe6
8.Bd4 Qc4 9.Ba1 h3 10.Bf6 Qe6 11.Bd4 Qh6
12.Rg6+ Kh7 13.Rxh6+ Kxh6 14.Kh2 (871.642.788) 7852

33/81 1:53 +12.31 1.Bf8+ Kh7 2.Rg7+ Kh8 3.Be7 Qe1
4.Bf6 Qxe2+ 5.Kh1 Qc4 6.Ba1 h4 7.Bf6 Qe6
8.Bd4 Qc4 9.Ba1 h3 10.Bf6 Qe6 11.Bd4 Qh6
12.Rg6+ Kh7 13.Rxh6+ Kxh6 14.Kh2 (895.335.546) 7862


How many human players would find a win in this position in less than a minute?


Houdini is in a class by itself, simply amazing
pichy
Posts: 2564
Joined: Thu Mar 09, 2006 3:04 am

Re: What is the most important thing in an engine for you?

Post by pichy »

pichy wrote:
S.Taylor wrote:
BubbaTough wrote:
S.Taylor wrote: soon, with just a few more elo, it should also clear up its few remaining blind spots.
Alas, I doubt this is true.

-Sam
Why not? Won't clearing up present blind spots give it more elo, and not doing so, impede some future elo?
I know what you are referring to, for instance in this position underneath Critter, Rybka, Stockfish and Komodo (3000 + engines) all play the wrong move leading into a draw, instead of chosing Bf8+ and with a few more moves forcing the exchance of Rook for Queen + the h pawn and winning the game.

[Event "?"]
[Site "?"]
[Date "2012.04.18"]
[Round "?"]
[White "Komodo3-32"]
[Black "Komodo3-32"]
[Result "1/2-1/2"]
[BlackElo "3040"]
[Time "22:57:13"]
[WhiteElo "3040"]
[TimeControl "0+20"]
[SetUp "1"]
[FEN "6R1/8/2pB3k/2P4p/5p1q/5P2/4P1K1/8 w - - 0 1"]
[Termination "normal"]
[PlyCount "71"]
[WhiteType "program"]
[BlackType "program"]

1. Rf8 (1. Re8 Qg3+ 2. Kf1 Qh3+ 3. Ke1 Qg2 4. Rh8+ Kg7 5. Rxh5 Kg6 6. Re5
Qg1+ 7. Kd2 Qa1 8. Re6+ Kf7 9. Re7+ Kg6 10. Re4 Qa5+ 11. Kd3 Qa3+ 12. Kc2
Qa2+ 13. Kc3 Qa3+ 14. Kc4 Qb2 15. Re6+ Kh5 16. Re8 Kg5 17. Re5+ Kh4 18. Re4
Kh3 19. Bxf4 Kg2 20. Be5 Qb5+ 21. Kd4 Kf2 22. Bd6 Qb2+ 23. Kd3 Ke1 24. Be5
Qb5+ 25. Rc4 Qb1+ 26. Ke3 Qd1 27. Rc3 Qxe2+ 28. Kf4 Qd2+ 29. Kf5 Qd7+ 30.
Kf6 Qd8+ 31. Kf5 Qc8+ 32. Kg5 Qg8+ 33. Kf5 Qf7+ 34. Kg5 Ke2 35. f4 Qe6 36.
Bg7 Qd7 37. Be5 Qe7+ 38. Kf5 Qf8+ 39. Kg4 Qe8 40. Kf5 Kd1 41. Rd3+ Kc2 42.
Ra3 Qd7+ 43. Kf6 Qd8+ 44. Kg6 Qd5 45. Bd6 Qe6+ 46. Kg5 Qg8+ 47. Kf6 Qd8+
48. Ke6 Qe8+ 49. Be7 Qg6+ 50. Kd7 Qf7 51. f5 Qxf5+ 52. Kxc6 Qe4+ 53. Kd6
Qf4+ 54. Kd7 Qb4 55. Ra7 Qe4 56. Kd8 Kc3 57. Ra3+ Kb4 58. Ra6 Qd5+ 59. Bd6
Kb5 60. Rb6+ Kc4 61. Kc7 Qf7+ 62. Kc6 Qf5 63. Rb8 Qe4+ 64. Kc7 Qh7+ 65. Kc6
Qf5 66. Re8 Qg4 67. Kb6 Qd4 68. Re2 Qd3 69. Re5 Qa3 70. Kc6 Qa4+ 71. Kb7
Qb5+ 72. Kc7 Qa5+ 73. Kd7 Qa7+ 74. Bc7 Qxc5 75. Rxc5+ Kxc5 {Insufficient
material}) 1/2-1/2

[d]8/2BK4/8/2k5/8/8/8/8 w - - 0 76

Now take a look at Houdini which is in a class by itself, simply amazing

Jorge, interesting position. This is a zugzwang problem which may cause a problem to engines because of null moves.
Here's Houdini's take, using 3 threads on a Core i5-750:
Code:
6R1/8/2pB3k/2P4p/5p1q/5P2/4P1K1/8 w - -

Engine: Houdini DEV 3T (2048 MB)
by Robert Houdart

4/14 0:00 0.00 1.Be5 Kh7 2.Rg7+ Kh6 3.Rg8 Kh7 (1.369)
...
11/24 0:00 -0.14 1.Rf8 Qe1 2.Bxf4+ Kg6 3.Re8 Qc3
4.Bd6 Qc4 5.Re4 Qa2 6.Kf2 Kf5 7.Re5+ Kg6 (98.576) 3520
...
22/43 0:02 0.00 1.Rf8 Qe1 2.Bxf4+ Kg6 3.Re8 Qc3
4.Bd6 Qc4 5.e4 Qe2+ 6.Kg3 Qe1+ 7.Kg2 Qe3
8.Re6+ Kf7 9.Re7+ Kf6 10.Re5 Qe2+
11.Kg3 Qe1+ 12.Kg2 Qd2+ 13.Kg3 Kg6
14.Re6+ (14.155.617) 6553
...
32/59 0:39 0.00 1.Rf8 Qe1 2.Bxf4+ Kg6 3.Re8 Qc3
4.Bd6 Qc4 5.e4 Qe2+ 6.Kg3 Qe1+ 7.Kg2 Qe3
8.Re6+ Kf7 9.Re7+ Kf6 10.Re5 Qe2+
11.Kg3 Qe1+ 12.Kf4 Qc1+ 13.Kg3 Qg1+
14.Kf4 (275.723.867) 6897

32/60 0:52 +0.04++ 1.Bf8+ (364.867.951) 6992

32/60 0:54 +0.14++ 1.Bf8+ (380.915.045) 7013

32/64 0:56 +0.37++ 1.Bf8+ (399.304.568) 7033

32/66 0:59 +1.17++ 1.Bf8+ (422.345.062) 7056

32/66 1:04 +4.25++ 1.Bf8+ (455.314.294) 7102

32/79 1:49 +12.34++ 1.Bf8+ (858.348.298) 7844

32/81 1:50 +12.31 1.Bf8+ Kh7 2.Rg7+ Kh8 3.Be7 Qe1
4.Bf6 Qxe2+ 5.Kh1 Qc4 6.Ba1 h4 7.Bf6 Qe6
8.Bd4 Qc4 9.Ba1 h3 10.Bf6 Qe6 11.Bd4 Qh6
12.Rg6+ Kh7 13.Rxh6+ Kxh6 14.Kh2 (871.642.788) 7852

33/81 1:53 +12.31 1.Bf8+ Kh7 2.Rg7+ Kh8 3.Be7 Qe1
4.Bf6 Qxe2+ 5.Kh1 Qc4 6.Ba1 h4 7.Bf6 Qe6
8.Bd4 Qc4 9.Ba1 h3 10.Bf6 Qe6 11.Bd4 Qh6
12.Rg6+ Kh7 13.Rxh6+ Kxh6 14.Kh2 (895.335.546) 7862


How many human players would find a win in this position in less than a minute?


Houdini is in a class by itself, simply amazing
Hood
Posts: 660
Joined: Mon Feb 08, 2010 12:52 pm
Location: Polska, Warszawa

Re: What is the most important thing in an engine for you?

Post by Hood »

Hi,

my 1 cent :) . Komodo plays similar to Critter ;-)

rgds
Hood