Lichess games with both players at 2500+

[Dann Corbit]

Here are all of the Lichess games, filtered for both players at or above 2500 Elo.
I stripped out all the timer marks, because my parser wants either time + eval or no annotations.
If you want the time marks, you will have to do your own filtering of the Lichess games.
It is the whole set from 2014. Unfortunately, there are a lot of bullet games, so there will be plenty of mistake moves.
You don't have to keep it secret, anyone can have it. But I won't keep it there forever. So if you want it, come and get it.

[Graham Banks]

Thanks, Dann.

[Graham Banks]

I'm creating a 2600+ opening book for ChessGUI, using this.
After 2 hours, it's 14% complete. LOL

[Graham Banks]

After 4 days, close to 50% complete.

[Dann Corbit]

Let's hope there is no power failure.
Imagine how long it took to create them.
After all my filtering, I turned the whole database into Epd records, together with what player made the move and what the outcome was and stored it into a SQL Server table called Lichess.
I had 60 processes running simultaneously to load it, and the database is stored on super fast PCIe 4.0 SSD.
But the value is there is the accumulated effort of many thousands of experts, trying everything they could think of over nine years.
Lots of computer engine ideas in there too, of course.

[Graham Banks]

Now 75% complete.
Having a power outage on Thursday, so fingers crossed.

[Dann Corbit]

Who knew there could be this much drama creating an opening book!?
Seems like it will go right down to the wire.

[Graham Banks]

Finished overnight.

[Dann Corbit]

I am very interested about this book.
What parameters did you use to create it?

[Graham Banks]

I am very interested about this book.
What parameters did you use to create it?

Players 2600+.
Ignore result.

Subsequently had another go on my 5950x with ignore result unchecked.
Took less than 12 hours to complete, and a lot smaller (roughly 3mb as opposed to 32mb).