The home side created half of dozen openings in the ten minutes. Stevenage top scorer Anthony Elding and strike partner Darryn Stamp were just two of the home players who failed to hit the targets.
The Bulls gradually found their feet and a surer touch from Danny Carey-Bertram after he had got the wrong side of Michael Warner, could easier have seen them go ahead.
Carey-Bertram was the beneficiary of a Matt Hocking slip just before the break. Boro keeper Alan Julian held him up and Warner got back to clear the danger of the line.
If Boro have dominated the opening stages of the first half then it was the visitors who controlled the early second-half proceedings. Stevenage old boy Jon Brady and then Craig Stanley stung the palms of Julian as Hereford's passing game began to click into gear.
After a lull in the action it really kicked of in the last 15 minutes. Dean Beckwith was off target was fierce drive for Hereford, whilst Stamp could not lift the ball over Wayne Brown after a deflected shot from substitute from Simon Weatherstone fell into his path.
Julian performed further heroics to keep out Rob Purdie's shot with his knees, before Boro centre-back Ronnie Henry was red-carded in added time for two bookings, the second for bringing down Carey-Bertram.