Nylander scored on a deflection off his lower back at the left post while on the power play at 3:20 of the second period to give the Maple Leafs a 2-1 lead.
"I like playing in this building," said Stolarz, who was born in Edison, New Jersey. "They knew from the beginning that they were just going to throw pucks at the net so I had to stay loose, stay ready, control the rebounds and do my best to fight them off."
Gritsyuk tied it 2-2 with his second goal in as many games with a one-timer just after a Devils penalty had expired at 6:06 of the second.
"We have the mentality that anything can happen right now and we can still jump back into it," Knies said. "That should be our focus. We won't hang our heads low."
Knies gave the Maple Leafs a 3-2 lead when he batted the puck into the net from the right post at 13:50 of the third period.
"There was a lot of chatter on the bench when they went ahead," New Jersey coach Sheldon Keefe said. "The overriding feeling was that we're fine. We've been dominating the third period so just stay with it and that was really good to see. Then we backed it up by going out, tying the game. So, I was really happy with how we just stayed with it in that moment."
NOTES: The Devils ended a nine-game losing streak against the Maple Leafs at Prudential Center. ... Luke Hughes assisted on Brown's goal to earn his 99th NHL assist in his 207th game. He's on pace to become the second-fastest defenseman in Devils/Colorado Rockies/Kansas City Scouts history to record 100 NHL assists, after Brian Rafalski (204 games). ... Forward John Tavares had an assist to become the eighth-fastest player in Maple Leafs history to record 300 assists with the franchise (577 games), and the second-fastest in the past 25 years, after Mitch Marner (411 games). He also became the 10th player in NHL history to record 300 assists with multiple franchises (also with New York Islanders).