They do, indeed, elect to shoot after him and press against the perceived retreat while they can. The Batter is implacable, apparently counting on being able to tank the hits as they come. That manner of strategy would never function where the Drifter is concerned, but others of their world could implement it with great success. The Hierophant, the Hanged Man, the Hermit - all had been capable of enduring hit after hit without faltering.

The primary indication of when they were growing close to cutting them down for good was the increase of the risk; how fiercely their attacks would redouble in power and speed.

This is not the case, yet. The Drifter's blows are light taps, flurrying, intended to build to something untenable over time.