Pools found themselves behind inside five minutes when Rushian Hepburn-Murphy drilled in a fine goal from distance to open the scoring.
The Robins looked the side likely to add to the scoreboard with Pools out of sorts in comparison to what we have seen under Askey so far since his arrival at the Suit Direct Stadium.
But Hartlepool were able to hang in the game which would ultimately provide them with the platform to secure all three points.
Connor Jennings swept home his third goal in four games at the Suit Direct Stadium to level things two minutes from time.
The referee confirmed eight minutes of stoppage time which gave Pools incentive to seek a winner which they would find through Oliver Finney when he found the bottom corner in the 94th minute to spark wild celebrations.
And here is how Pools were rated:
5. Edon Pruti - 6
Like his fellow centre-backs he struggled to contain Swindon’s front three at times. A little careless in possession early in the second half when gifting them an opportunity. Close with a header. Booked. (Photo: Michael Driver | MI News) Photo: Michael Driver
6. David Ferguson - 6
Was one of few in the first half looking to make things happen. Couple of good deliveries into the box. Didn’t seem as involved in the second half. Needed Sterry to bail him out after being robbed on halfway by Hepburn-Murphy. (Photo: Michael Driver | MI News) Photo: Michael Driver
7. Mo Sylla - 7
Struggled in the first half. Was unable to contain Williams who found space all over in the No.10 role. Huge improvement after the break. Helped his centre-backs out well, won back possession and played a role in both goals. Booked. (Photo: Mark Fletcher | MI News) Photo: Mark Fletcher
8. Callum Cooke - 6
Was Hartlepool’s best player in the first half. With Swindon dominating he was the only one getting on the ball, starting attacks and trying to get Pools forward. Got frustrated and became a little wasteful in the second half and tired late on before being subbed. (Credit: Mark Fletcher | MI News) Photo: Mark Fletcher