Komodo 10.4 vs Houdini 5

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Komodo 10.4 vs Houdini 5

Post by beram »

First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Komodo 10.4 vs Houdini 5

Post by JJJ »

Nice first result here.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Komodo 10.4 vs Houdini 5

Post by lkaufman »

beram wrote:First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
At 2' + 1" vs. Houdini 5 I got +13 elo on four threads in 3000 games but just + 1 elo in 13,700 single thread games. I think Komodo results vs. Houdini get better with more time and/or more threads.
Komodo rules!
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Komodo 10.4 vs Houdini 5

Post by beram »

lkaufman wrote:
beram wrote:First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
At 2' + 1" vs. Houdini 5 I got +13 elo on four threads in 3000 games but just + 1 elo in 13,700 single thread games. I think Komodo results vs. Houdini get better with more time and/or more threads.
I don't think so look at CCRL there it is the other way around
Houdini 5 is just doing better with more cores and with more time(on 4cpu) against Komodo 10.3

CCRL 40/40
H5 vs K103 4cpu 57,5% (+27-9=84)
H5 vs K103 1cpu 54,8% (+9-4=39)

CCRL 4/40:
H5 vs K103 4cpu 55% (+31-17=92)
H5 vs K103 1cpu 55,4% (+169-82=562)
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Komodo 10.4 vs Houdini 5

Post by JJJ »

Can't wait for your first result against Stockfish Bram
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Komodo 10.4 vs Houdini 5

Post by JJJ »

On fast.gm Komodo 10.3 on 1CPU is behind Houdini 5 by 40 ELO at 60 sec, 14 elo at 10 min and 7 elo à 1h.

Time controls seems to helps more Komodo than number of core.

But to be sure of that, you might want to test a match 1CPU vs 1CPU at reasonnable time control and then at the time control another match with 4CPU against 4CPU. Then you ll be sure.
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Komodo 10.4 vs Houdini 5

Post by beram »

beram wrote:First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
After 150 games on the AMD x6 1090T 52% for Houdini5 +25 -19 =106
On my i5 laptop after 100 games 51% for Houdini 5 +14 -12 =74

So Komodo 10.4 just a tiny bit behind Houdini 5 on both systems
Still a good improvement for Komodo 10.4

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s                         
1   Houdini 5 x64-popc  +25/=106/-19 52.00%   78.0/150
2   Komodo 10.4 64-bit  +19/=106/-25 48.00%   72.0/150
mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: Komodo 10.4 vs Houdini 5

Post by mjlef »

beram wrote:
lkaufman wrote:
beram wrote:First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
At 2' + 1" vs. Houdini 5 I got +13 elo on four threads in 3000 games but just + 1 elo in 13,700 single thread games. I think Komodo results vs. Houdini get better with more time and/or more threads.
I don't think so look at CCRL there it is the other way around
Houdini 5 is just doing better with more cores and with more time(on 4cpu) against Komodo 10.3

CCRL 40/40
H5 vs K103 4cpu 57,5% (+27-9=84)
H5 vs K103 1cpu 54,8% (+9-4=39)

CCRL 4/40:
H5 vs K103 4cpu 55% (+31-17=92)
H5 vs K103 1cpu 55,4% (+169-82=562)
Larry quoted 3000 games and 13,700 games. The CCRL game count is not enough to draw many conclusions. 3 of the 4 matches cited were less than 100 games, with huge error margins. Plus Larry was talking about Komodo 10.4 and not 10.3. Basically, you need a lot of games to draw many conclusions unless one program is massively stronger than another.
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Komodo 10.4 vs Houdini 5

Post by beram »

beram wrote:
beram wrote:First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
After 150 games on the AMD x6 1090T 52% for Houdini5 +25 -19 =106
On my i5 laptop after 100 games 51% for Houdini 5 +14 -12 =74

So Komodo 10.4 just a tiny bit behind Houdini 5 on both systems
Still a good improvement for Komodo 10.4

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s                         
1   Houdini 5 x64-popc  +25/=106/-19 52.00%   78.0/150
2   Komodo 10.4 64-bit  +19/=106/-25 48.00%   72.0/150
After 200 games on my i5 still a very small lead for Houdini 5 50,75%

Code: Select all

K10.4 - H5, Blitz 3m+2s                              
1   Houdini 5 x64-pext    +5  +29/=145/-26 50.75%  101.5/200
2   Komodo 10.4 64-bit    -5  +26/=145/-29 49.25%   98.5/200
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: Komodo 10.4 vs Houdini 5

Post by beram »

mjlef wrote:
beram wrote:
lkaufman wrote:
beram wrote:First match results 100games on my AMD x6 1090T
TC 3m2s,both 4cores, ponder off, privat book 25 lines
A small margin win for Komodo 10.4 +16 -14 =70
A next 100 games is running

On my i5 laptop 2cores same engines, same TC, I have after 75 games
+12 -8 =55 for Houdini 5

Conclusions sofar Komodo has improved its results, it looks on par with Houdini 5. Off course more results needed to confirm

Code: Select all

Komodo10.4 - Houdini5 4x Blitz 3m+2s
                        
1   Komodo 10.4 64-bit  +16/=70/-14 51.00%   51.0/100
2   Houdini 5 x64-popc  +14/=70/-16 49.00%   49.0/100
At 2' + 1" vs. Houdini 5 I got +13 elo on four threads in 3000 games but just + 1 elo in 13,700 single thread games. I think Komodo results vs. Houdini get better with more time and/or more threads.
I don't think so look at CCRL there it is the other way around
Houdini 5 is just doing better with more cores and with more time(on 4cpu) against Komodo 10.3

CCRL 40/40
H5 vs K103 4cpu 57,5% (+27-9=84) total games 120
H5 vs K103 1cpu 54,8% (+9-4=39) total games 52

CCRL 4/40:
H5 vs K103 4cpu 55% (+31-17=92) total games 140
H5 vs K103 1cpu 55,4% (+169-82=562) total games 813
Larry quoted 3000 games and 13,700 games. The CCRL game count is not enough to draw many conclusions. 3 of the 4 matches cited were less than 100 games, with huge error margins. Plus Larry was talking about Komodo 10.4 and not 10.3. Basically, you need a lot of games to draw many conclusions unless one program is massively stronger than another.
Again I need to correct 3 of the 4 matches CCRL quoted where more than 100 games
There is no proof for better performance with more cores for earlier Komodo version 10.3. In fact it is the other way around.
There is no reason it will be the other way around for this new 10.4 version