Dean, your spot on.

On a handbrake with a big energy store, the height of the handbrake is a good visual indicator of the state of the brakes. The higher it comes - the more cable is being pulled in before the shoes hit the drums. Always adjust at the drum and never mess with the linkage.