Search found 31 matches

by grahamj
Thu Oct 18, 2018 12:04 pm
Forum: Computer Chess Club: General Topics
Topic: Lc0 speedup on 2 GPUs
Replies: 7
Views: 1253

Re: Lc0 speedup on 2 GPUs

As I understand it, LC0 sends a batch of positions to the GPU for NN evaluation. The default "Minibatch size for NN inference" is 256. If this is too small, the GPU will not be fully utilised. More powerful GPUs need bigger batches to keep them busy. If the batch size is too big, search becomes less...