The way I understood it, Varamyr was more "in command" of his animals, rather than "in control" of them (the way Bran is with Summer).
One of the cool aspects that come with warging, I would imagine, is being able to create a close relationship with the animal, so that it trusts and listens to...