Take control of any of your guys directly and walk over to the book, then hit enter. You then have to read it from there inventory by clicking on it while your controlling them.
I actually did this as well, slightly less score though lol. It's interesting how its possible, but It's a bit of a luck based thing (You need bandits/gnomes to level up to begin with, otherwise most everything can kill you 1v1.).
