Chess analysis project

Discussion of chess software programming and technical issues.

Moderators: hgm, Dann Corbit, Harvey Williamson

jdart
Posts: 4361
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Chess analysis project

Post by jdart »

I found this on Github:

https://github.com/ChessAnalysis/chess-analysis.

They are using a giant cluster to analyze all the FENs from 5 million or so historical games.

--Jon
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Chess analysis project

Post by bob »

jdart wrote:I found this on Github:

https://github.com/ChessAnalysis/chess-analysis.

They are using a giant cluster to analyze all the FENs from 5 million or so historical games.

--Jon
I assume there is no mathematician among them? That is such a tiny faction of the total chess positions one might actually reach...
mar
Posts: 2552
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: Chess analysis project

Post by mar »

bob wrote:I assume there is no mathematician among them? That is such a tiny faction of the total chess positions one might actually reach...
Where did they claim they're trying to solve chess? :shock:
AlvaroBegue
Posts: 931
Joined: Tue Mar 09, 2010 3:46 pm
Location: New York
Full name: Álvaro Begué (RuyDos)

Re: Chess analysis project

Post by AlvaroBegue »

mar wrote:
bob wrote:I assume there is no mathematician among them? That is such a tiny faction of the total chess positions one might actually reach...
Where did they claim they're trying to solve chess? :shock:
"We are writing a technical report on various statistics of the chessgame database (e.g., number of unique positions);"

I have no idea what a database of games can contribute to computing the number of positions.
Dann Corbit
Posts: 12482
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Chess analysis project

Post by Dann Corbit »

AlvaroBegue wrote:
mar wrote:
bob wrote:I assume there is no mathematician among them? That is such a tiny faction of the total chess positions one might actually reach...
Where did they claim they're trying to solve chess? :shock:
"We are writing a technical report on various statistics of the chessgame database (e.g., number of unique positions);"

I have no idea what a database of games can contribute to computing the number of positions.
Their goal is to analyze every single unique position from every high level game ever played.

It is a big effort.

It is also worthwhile.

Games from sources like TCEC, CCRL and CEGT used a small fixed set of openings. Games from all the games ever played will exercise all the openings.

They are not idiots who imagine that they are analyzing all possibilities.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
jdart
Posts: 4361
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Chess analysis project

Post by jdart »

Still, the objectives are a bit unclear. There are a lot of things you could do with such a database. But which ones they are actually doing .. I don't know.

--Jon
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Chess analysis project

Post by bob »

mar wrote:
bob wrote:I assume there is no mathematician among them? That is such a tiny faction of the total chess positions one might actually reach...
Where did they claim they're trying to solve chess? :shock:
I assume they believe this will be significant. But how, I don't follow.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Chess analysis project

Post by Ferdy »

Depth 20 may not be enough.

Code: Select all

Objectives

We hope to gather various interesting insights on the skills, ratings, or styles of (famous) chess players. In fact numerous applications can be and have been considered such as cheat detection, computation of an intrinsic, "universal" rating, or the determination of key moments chess players blunder. For instance we would like to answer a question like "Who are the best chess players in history?"

[...]

In average, Stockfish calculates 7 millions combinaisons at depth 20. So, we can think Igrida has, at total, calculates more than 2e15 nodes (~2 000 000 000 000 000).
Dann Corbit
Posts: 12482
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Chess analysis project

Post by Dann Corbit »

Ferdy wrote:Depth 20 may not be enough.

Code: Select all

Objectives

We hope to gather various interesting insights on the skills, ratings, or styles of (famous) chess players. In fact numerous applications can be and have been considered such as cheat detection, computation of an intrinsic, "universal" rating, or the determination of key moments chess players blunder. For instance we would like to answer a question like "Who are the best chess players in history?"

[...]

In average, Stockfish calculates 7 millions combinaisons at depth 20. So, we can think Igrida has, at total, calculates more than 2e15 nodes (~2 000 000 000 000 000).
Actually, depth 20 is pretty useless unless you mini-max the whole mess when you are done.

On high end hardware, SF gets to 20 in a sneeze. So what did we gain?
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Chess analysis project

Post by bob »

Ferdy wrote:Depth 20 may not be enough.

Code: Select all

Objectives

We hope to gather various interesting insights on the skills, ratings, or styles of (famous) chess players. In fact numerous applications can be and have been considered such as cheat detection, computation of an intrinsic, "universal" rating, or the determination of key moments chess players blunder. For instance we would like to answer a question like "Who are the best chess players in history?"

[...]

In average, Stockfish calculates 7 millions combinaisons at depth 20. So, we can think Igrida has, at total, calculates more than 2e15 nodes (~2 000 000 000 000 000).
:)

I have posted more than one 1-2 trillion node searches here. at 100M, that only needs 2 hours are so. so 2,000 trillion will need about 2000 * 2 hours = 4000 hours or 23 days, using just one 20 core box...