patricia devlog
Moderators: hgm, chrisw, Rebel
-
- Posts: 177
- Joined: Thu May 27, 2010 3:32 am
Re: patricia devlog
If it was just one vendor, I wouldn't care. But five?
-
- Posts: 838
- Joined: Sun Jul 25, 2010 10:07 pm
- Location: the Netherlands
- Full name: Jef Kaan
Re: patricia devlog
you make a valid point, ofcourse,
not being a cyber security expert, but for github sources it depends i guess on who cq
the person (*) is making the compile (if it's not a certain J.A). and if they got some malware
maybe without even knowing themselves,e well there you go (contamination)
PS obviously not accusing here anyone of course but then some programmers may
focused so much on their engine that they forget about comp security
(and not everyone has linux btw)
(*) usually i also -try to- look at the origin, who's the programmer, eg.
the guy who made combichess looks ok but then nevertheless he
may have malware on his comp. my 2 cnts(not
(most chess exe's i''ve downloaded usually make it without warning,
so it's imo a valid thing to look at the security aspects)
not being a cyber security expert, but for github sources it depends i guess on who cq
the person (*) is making the compile (if it's not a certain J.A). and if they got some malware
maybe without even knowing themselves,e well there you go (contamination)
PS obviously not accusing here anyone of course but then some programmers may
focused so much on their engine that they forget about comp security
(and not everyone has linux btw)
(*) usually i also -try to- look at the origin, who's the programmer, eg.
the guy who made combichess looks ok but then nevertheless he
may have malware on his comp. my 2 cnts(not
(most chess exe's i''ve downloaded usually make it without warning,
so it's imo a valid thing to look at the security aspects)
-
- Posts: 227
- Joined: Tue Jan 31, 2023 4:34 pm
- Full name: Adam Kulju
Re: patricia devlog
Hi there, if you're worried about viruses you can build her from source by following the instructions in the release notes, or just contact me if make isn't working for you.
go and star https://github.com/Adam-Kulju/Patricia!
-
- Posts: 227
- Joined: Tue Jan 31, 2023 4:34 pm
- Full name: Adam Kulju
Re: patricia devlog
MultiPV is added and with that it's time to take another whack at the Skill Level/UCI_Elo option stuff.
My new impl I'm testing: each search, I do a multiPV search that gives me the 5 best lines instead of just 1. No matter what the skill level is set to, if one of these lines is a sacrifice, it's not much worse (80 cps) than the best move, and Patricia isn't already nearly lost, she will immediately play it if it's early in the game. This is to address concerns that Patricia doesn't sacrifice enough right out of the gate and will make for a more engaging experience against human opponents.
For weakening her, my first attempt is going to be a centipawn loss function; I've got a variable keeping track of the total expected "centipawn loss" of the game so far, which increments each search by a number dependent on the skill level. Patricia will play the worst move (out of the five best found) that still keeps the total "centipawn loss" of the game so far under the expected centipawn loss. For example, if Patricia's expected centipawn loss is 40 cps, and she hasn't played a suboptimal move yet, she will play the worst move that isn't more than 40 cps worse than the best move. I hope that will be a good way to make her play suboptimal moves without them being absolutely obvious howlers.
I'm currently testing out different values of centipawn loss per search; a value of 0 (meaning she always plays the best move out of the 5) corresponds to about 3000 CCRL, which is a good maximum strength for a human opponent. Dropping 15 centipawns each search, on the other hand, crashes her strength to 2450 CCRL. I hope to get a bunch of data points and fit a formula to it. (And then I have to play it myself at different skill settings to ensure it's realistic!)
My new impl I'm testing: each search, I do a multiPV search that gives me the 5 best lines instead of just 1. No matter what the skill level is set to, if one of these lines is a sacrifice, it's not much worse (80 cps) than the best move, and Patricia isn't already nearly lost, she will immediately play it if it's early in the game. This is to address concerns that Patricia doesn't sacrifice enough right out of the gate and will make for a more engaging experience against human opponents.
For weakening her, my first attempt is going to be a centipawn loss function; I've got a variable keeping track of the total expected "centipawn loss" of the game so far, which increments each search by a number dependent on the skill level. Patricia will play the worst move (out of the five best found) that still keeps the total "centipawn loss" of the game so far under the expected centipawn loss. For example, if Patricia's expected centipawn loss is 40 cps, and she hasn't played a suboptimal move yet, she will play the worst move that isn't more than 40 cps worse than the best move. I hope that will be a good way to make her play suboptimal moves without them being absolutely obvious howlers.
I'm currently testing out different values of centipawn loss per search; a value of 0 (meaning she always plays the best move out of the 5) corresponds to about 3000 CCRL, which is a good maximum strength for a human opponent. Dropping 15 centipawns each search, on the other hand, crashes her strength to 2450 CCRL. I hope to get a bunch of data points and fit a formula to it. (And then I have to play it myself at different skill settings to ensure it's realistic!)
go and star https://github.com/Adam-Kulju/Patricia!
-
- Posts: 227
- Joined: Tue Jan 31, 2023 4:34 pm
- Full name: Adam Kulju
-
- Posts: 119
- Joined: Sat Aug 01, 2015 6:16 pm
- Location: France
- Full name: Eric Bonneau
Re: patricia devlog
Looks promising! AFAIK, the DGT Centaur leverages Stockfish's multiPV search for adaptive play; I think you are on a right path... Thanks a lot for the good job, Patricia is definitely a refreshing project, much appreciated.
Warm regards
-
- Posts: 227
- Joined: Tue Jan 31, 2023 4:34 pm
- Full name: Adam Kulju
Re: patricia devlog
I got the human mode working, which I think puts Patricia in a good spot for use as an analysis tool. Thus: https://github.com/Adam-Kulju/Patricia/releases/tag/3.1
I wanted to get this out of the way now because I will be headed to the datagen mines for a long time and don't want to leave the analysis/gameplay incomplete for months. Have fun playing against her!
I wanted to get this out of the way now because I will be headed to the datagen mines for a long time and don't want to leave the analysis/gameplay incomplete for months. Have fun playing against her!
go and star https://github.com/Adam-Kulju/Patricia!
-
- Posts: 227
- Joined: Tue Jan 31, 2023 4:34 pm
- Full name: Adam Kulju
Re: patricia devlog
A couple more datagen ideas didn’t work, so I’m going straight to 2b data to train a new main net on Patricia data. Once that is done I will retrain the same way as before and we’ll see how that goes!
go and star https://github.com/Adam-Kulju/Patricia!
-
- Posts: 227
- Joined: Tue Jan 31, 2023 4:34 pm
- Full name: Adam Kulju
Re: patricia devlog
Great and happy news: I'm now collaborating with Gabe, the Obsidian dev, on Patricia. He is working on helping to improve the strength of the engine so that (a) she will be able to compete with top engines, and (b) I can redouble my efforts on the style side to push the bounds of aggression even further. I am very grateful for his help and support and I am excited to see where this partnership leads. We already gained 15 elo in two days
Datagen update: I have 350m positions generated now, I need about 2 billion for the Patricia net. So I guess update on that front will be forthcoming in about a week.
Datagen update: I have 350m positions generated now, I need about 2 billion for the Patricia net. So I guess update on that front will be forthcoming in about a week.
go and star https://github.com/Adam-Kulju/Patricia!
-
- Posts: 18839
- Joined: Thu Mar 09, 2006 6:40 pm
- Location: US of Europe, germany
- Full name: Thorsten Czub
Re: patricia devlog
Where can i download a version 3.1 for pc ? I see a version for android.
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....
Here we have a fairy tale of the day after tomorrow....