Arrows flying fast enough shatter glass panes and keep flying, losing most of their speed. A full-power bow or crossbow shot breaks a pane over a long distance; a weak shot, a skeleton arrow or a dispenser arrow does not.
Shooting arrows with a bow will break glass panes only if they were shot with enough velocity.