The Horse's Tale

There is a town up ahead with a real castle. An actual one. Stone walls, a moat, the works. My knight has declared it “obviously a peasant’s barn” and ridden past. I do not understand the rules of his world.