Remember what Paolini has said about distance and size being a factor in telekinetic spells, they get progressively weaker the further away you are and the larger the object you are levitating is.

If that holds true, Galby probably has enough raw power to turn the entire Varden into ashes, Thanos style, without really straining himself.