NEW YORK - Milan Michalek capped Ottawa's three-goal comeback in the third period and then scored the only goal in the shootout as the Senators stormed back to beat the New York Rangers 5-4 and stretch their winning streak to five.

Jason Spezza started the rally from a 4-1 hole by scoring twice, and Michalek tied it with Ottawa's third goal in a 7:52 span when he put in his seventh with 2:50 remaining.

That wiped out a big day by Rangers top forwards Brad Richards and Marian Gaborik, who were split up as linemates but produced three points each -- with Richards scoring twice.

The Senators are making a habit of heart-pounding comebacks. They won two straight home games with goals in the final minute of regulation.

Spezza scored an even-strength goal at 9:18 to make it 4-2 and then added a power-play tally 2:31 later.

It may have been a costly win for Ottawa after captain Daniel Alfredsson left the game in the third period. Alfredsson took an elbow to the head from Wojtek Wolski on a hit that will likely be noticed by NHL disciplinarian Brendan Shanahan.

Michalek squeezed the puck, off a rebound of his shot, in between Henrik Lundqvist's pad and the left post in the closing minutes. He then beat the goalie in the shootout with an unstoppable move as he deked to his backhand and lifted a perfect shot over Lundqvist's glove and under the crossbar.

Craig Anderson, who made 24 saves through overtime, turned aside Erik Christensen, Richards, and Wolski in the shootout.

Richards and Gaborik did some of their damage apart as New York erased a 1-0 deficit, scoring twice in the second and third periods. The duo connected for the Rangers' second and fourth goals -- both netted by Richards. The first was during a long power play and the second was shortly after the Rangers killed a penalty.

Ryan Callahan had the other goal for the Rangers, who fell to 3-3-3. Lundqvist made 36 saves but couldn't secure New York's fourth win in six games. The Rangers were the only NHL team last season not to lose when leading after two periods (29-0).

Chris Neil had the other goal for the Senators (6-5), who are over .500 for the first time this season.

The game first turned in the second period when Ottawa's Zenon Konopka caught Artem Anisimov from the side and sent the Rangers forward into the glass face first 4:05 into the second.

Anisimov remained down and motionless for nearly a minute before slowly getting up on his skates. Anisimov resumed a regular shift just a few minutes later.

Konopka was given a major penalty for boarding and was ejected, giving the Rangers a five-minute man advantage.

The Senators held a 20-9 edge in shots when Richards fired a drive from the middle of the ice, just inside the blue-line, that Anderson knocked away. Callahan got to the rebound and snapped in his third goal at 6:24.

Gaborik then kept a clearing attempt in the zone and found Richards in front for the goal at 7:44, still during Konopka's penalty.

The usually reserved Richards, made an emphatic thrust with his arm and then launched himself shoulder-first into the glass to celebrate his first Madison Square Garden goal since signing with the Rangers this summer.

It was a long-awaited happy moment for Richards, who was brought in with the idea that he would centre a line alongside Gaborik. After the duo generated five points each in the first eight games, coach John Tortorella split them up during a 4-2 loss to Toronto in the home opener on Thursday.

The Rangers' lead grew to 3-1 when Derek Stepan found Gaborik in front with a pass from behind the net in the third, and Richards made it a three-goal edge at 8:05.

NOTES: Rangers C Mike Rupp (knee) missed his second straight game. ... Ottawa recalled G Robin Lehner from Binghamton of the AHL to back up Anderson in place of the injured Alex Auld. ... The Senators have scored 20 of their 33 goals in the third period, but have allowed 17 in the frame. Ottawa has only four first-period goals. ... The Rangers have been outshot in all nine games. ... Ottawa D Filip Kuba had three assists.