Stockfish Level Settings on LiChess

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

BrendanJNorman
Posts: 2584
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Stockfish Level Settings on LiChess

Post by BrendanJNorman »

I currently have a small competition among all of the stronger kids I coach where they are to compete who can beat Stockfish with BOTH colors at the highest level setting.

See image.

Image

You will see that I have also included myself as a reference for them, having beat all versions of Stockfish up to level 6.

But level 7 seems very strong. I have only managed a draw thus far, but have had very promising positions (my liChess rating drifts between late 2300s- nearly 2500).

At the same time, I have students who are literally little kids who have beaten level 5.

My question is this:

Does anyone know anything about this weakened version of SF they're using and how strong the settings are?

How do they relate to the downloadable SF's levels? The same?

Thanks guys. :wink:
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: Stockfish Level Settings on LiChess

Post by Chessqueen »

BrendanJNorman wrote: Fri Jun 17, 2022 12:51 pm I currently have a small competition among all of the stronger kids I coach where they are to compete who can beat Stockfish with BOTH colors at the highest level setting.

See image.

Image

You will see that I have also included myself as a reference for them, having beat all versions of Stockfish up to level 6.

But level 7 seems very strong. I have only managed a draw thus far, but have had very promising positions (my liChess rating drifts between late 2300s- nearly 2500).

At the same time, I have students who are literally little kids who have beaten level 5.

My question is this:

Does anyone know anything about this weakened version of SF they're using and how strong the settings are?

How do they relate to the downloadable SF's levels? The same?

Thanks guys. :wink:
Those students of your that have beaten level 5, have they tried beating Stockfish with Rook Odds ? which should be almost equivalent.
BrendanJNorman
Posts: 2584
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: Stockfish Level Settings on LiChess

Post by BrendanJNorman »

Chessqueen wrote: Fri Jun 17, 2022 1:28 pm
BrendanJNorman wrote: Fri Jun 17, 2022 12:51 pm I currently have a small competition among all of the stronger kids I coach where they are to compete who can beat Stockfish with BOTH colors at the highest level setting.

See image.

Image

You will see that I have also included myself as a reference for them, having beat all versions of Stockfish up to level 6.

But level 7 seems very strong. I have only managed a draw thus far, but have had very promising positions (my liChess rating drifts between late 2300s- nearly 2500).

At the same time, I have students who are literally little kids who have beaten level 5.

My question is this:

Does anyone know anything about this weakened version of SF they're using and how strong the settings are?

How do they relate to the downloadable SF's levels? The same?

Thanks guys. :wink:
Those students of your that have beaten level 5, have they tried beating Stockfish with Rook Odds ? which should be almost equivalent.
Nope. The idea is to play training games that are similar to REAL CHESS.

Not some exhibition match. Rook odds is just a spectacle IMHO.

Also, the idea of all of them playing the same Stockfish (LiChess's version) on the same platform, is to keep variables constant.

A good way to compare the strength and relative improvement of each kid.

Winning is hardly the point, although it makes them happy! :D

Here is one of my kids sending me the winning position vs level 5 today. 8-)

Image

Lots of fun.
Chessqueen
Posts: 5685
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: Stockfish Level Settings on LiChess

Post by Chessqueen »

BrendanJNorman wrote: Fri Jun 17, 2022 1:40 pm
Chessqueen wrote: Fri Jun 17, 2022 1:28 pm
BrendanJNorman wrote: Fri Jun 17, 2022 12:51 pm I currently have a small competition among all of the stronger kids I coach where they are to compete who can beat Stockfish with BOTH colors at the highest level setting.

See image.

Image

You will see that I have also included myself as a reference for them, having beat all versions of Stockfish up to level 6.

But level 7 seems very strong. I have only managed a draw thus far, but have had very promising positions (my liChess rating drifts between late 2300s- nearly 2500).

At the same time, I have students who are literally little kids who have beaten level 5.

My question is this:

Does anyone know anything about this weakened version of SF they're using and how strong the settings are?

How do they relate to the downloadable SF's levels? The same?

Thanks guys. :wink:
Those students of your that have beaten level 5, have they tried beating Stockfish with Rook Odds ? which should be almost equivalent.
Nope. The idea is to play training games that are similar to REAL CHESS.

Not some exhibition match. Rook odds is just a spectacle IMHO.

Also, the idea of all of them playing the same Stockfish (LiChess's version) on the same platform, is to keep variables constant.

A good way to compare the strength and relative improvement of each kid.

Winning is hardly the point, although it makes them happy! :D

Here is one of my kids sending me the winning position vs level 5 today. 8-)

Image

Lots of fun.
How long have you trained this Kid that sent you the winning game at level 5 ?
BrendanJNorman
Posts: 2584
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: Stockfish Level Settings on LiChess

Post by BrendanJNorman »

Chessqueen wrote: Fri Jun 17, 2022 1:54 pm
BrendanJNorman wrote: Fri Jun 17, 2022 1:40 pm
Chessqueen wrote: Fri Jun 17, 2022 1:28 pm
BrendanJNorman wrote: Fri Jun 17, 2022 12:51 pm I currently have a small competition among all of the stronger kids I coach where they are to compete who can beat Stockfish with BOTH colors at the highest level setting.

See image.

Image

You will see that I have also included myself as a reference for them, having beat all versions of Stockfish up to level 6.

But level 7 seems very strong. I have only managed a draw thus far, but have had very promising positions (my liChess rating drifts between late 2300s- nearly 2500).

At the same time, I have students who are literally little kids who have beaten level 5.

My question is this:

Does anyone know anything about this weakened version of SF they're using and how strong the settings are?

How do they relate to the downloadable SF's levels? The same?

Thanks guys. :wink:
Those students of your that have beaten level 5, have they tried beating Stockfish with Rook Odds ? which should be almost equivalent.
Nope. The idea is to play training games that are similar to REAL CHESS.

Not some exhibition match. Rook odds is just a spectacle IMHO.

Also, the idea of all of them playing the same Stockfish (LiChess's version) on the same platform, is to keep variables constant.

A good way to compare the strength and relative improvement of each kid.

Winning is hardly the point, although it makes them happy! :D

Here is one of my kids sending me the winning position vs level 5 today. 8-)

Image

Lots of fun.
How long have you trained this Kid that sent you the winning game at level 5 ?
Just over a month.
Fritz 0
Posts: 150
Joined: Fri Mar 11, 2022 12:10 pm
Full name: Branislav Đošić

Re: Stockfish Level Settings on LiChess

Post by Fritz 0 »

Stockfish levels don't work in my Fritz GUI at all. If they did, I could compare them with Komodo/Dragon levels.
MonteCarlo
Posts: 188
Joined: Sun Dec 25, 2016 4:59 pm

Re: Stockfish Level Settings on LiChess

Post by MonteCarlo »

See https://lichess.org/forum/game-analysis ... ?page=3#26 for an explanation of the levels.

Cheers!
BrendanJNorman
Posts: 2584
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: Stockfish Level Settings on LiChess

Post by BrendanJNorman »

MonteCarlo wrote: Fri Jun 17, 2022 11:40 pm See https://lichess.org/forum/game-analysis ... ?page=3#26 for an explanation of the levels.

Cheers!
This is EXACTLY what I was looking for! Thanks!
BrendanJNorman
Posts: 2584
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: Stockfish Level Settings on LiChess

Post by BrendanJNorman »

I believe that is currently correct. Lichess seems to be using the UCI option 'Skill Level' and other means to weaken Stockfish.
See these and further down in that code where the variables LVL_MOVETIMES and LVL_DEPTHS are used to set things up for the "go" command.
github.com/niklasf/fishnet/blob/53e218bd184554265748513f85d19e601f18c310/fishnet.py#L117-L119
github.com/niklasf/fishnet/blob/53e218bd184554265748513f85d19e601f18c310/fishnet.py#L818

So I think the 1-8 'level' is used to index into these:
LVL_SKILL = [0, 3, 6, 10, 14, 16, 18, 20]
LVL_MOVETIMES = [50, 100, 150, 200, 300, 400, 500, 1000]
LVL_DEPTHS = [1, 1, 2, 3, 5, 8, 13, 22]

Edit: This is an old blob. Looking for the current code.
The new code seems to work in similar fashion, though now the SF range of levels extends to negative values!
github.com/niklasf/fishnet/blob/master/src/api.rs#L221-L270
The move times remain the same as above. The skill is mapped as [-9, -5, -1, 3, 7, 11, 16, 20].
The depth is now mapped as [5, 5, 5, 5, 5, 8, 13, 22].
https://lichess.org/forum/general-chess ... ?page=4#33

Very interesting.
User avatar
Ovyron
Posts: 4562
Joined: Tue Jul 03, 2007 4:30 am

Re: Stockfish Level Settings on LiChess

Post by Ovyron »

Excuse the language, but this seems like a half-assed implementation. At the lower levels luck is going to be the main factor of how often it blunders and how bad the blunder is, so that by pure luck level 5 could play weaker than level 4, just completely inconsistent.

Stockfish naturally comes with a curve of strength, Depth 1 is weaker than Depth 2 which is weaker than Depth 3, which is weaker than Depth 4, which is weaker than Depth 5. It is a shame that they don't take advantage of this and instead set it to 5 and throw dice to decide how it plays.

A student could lose to level 1 and beat level 5, there's no progression if you're unlucky. Blegh.
Your beliefs create your reality, so be careful what you wish for.