Former Rotherham United striker Lewis Grabban saw red at AESSEAL New York Stadium as the first half between the Millers and high-flying Norwich City finished goalless.
Trailing to a 59th-minute Gary Hooper screamer, they went for the high-flying Canaries and were rewarded with an equaliser in the 86th minute when substitute Jordan Bowery gloriously headed home in front of the kop.
With Millwall drawing with Derby, Rotherham remain a point above the drop zone after their three-point deduction and have a game in hand - Tuesday’s home clash with Reading.
In a feisty first half, former Millers striker Lewis Grabban was sent off after 26 minutes for punching centre-half Craig Morgan.
Hooper’s moment of pure quality set Millers hearts pounding as Millwall were leading against Derby, but from then on it was all Rotherham.
Matt Derbyshire should have made it 1-1 in the 73rd minute after superb work down the right by Bowery but when the pull-back game he somehow put it wide when stood in front of an open goal.
If the Millers win on Tuesday their Championship safety would be guaranteed.
Rotherham United (4-4-2): Martinez; Hunt, Broadfoot, Morgan, Lafferty; Frecklington, Smallwood, Arnason, Pringle; Derbyshire, Ward. Subs: Collin, Wood, Bowery, Green, Hammill, Wilson, Clarke-Harris.
Norwich City: Ruddy; Johnson, Martin, Howson, Hoolahan, Redmond, Olsson, R Bennett, Bassong, Dorrans, Grabban. Subs: Rudd, Cuellar, Jerome, Hooper, E Bennett, O’Neil, Odjidja-Ofoe.
Referee: Mark Brown (East Yorkshire).