Sunday night’s Super Bowl provided a fairytale ending to the first chapter of Travis Kelce and Taylor Swift’s love story.

With a record-breaking audience looking on, Kelce helped the Kansas City Chiefs win a second-consecutive Super Bowl while an elated Swift watched the game’s dramatic overtime in the crowd. Kelce and Swift, both 34, embraced on the field after the game and later stayed out on the Las Vegas strip until 5 a.m. celebrating with teammates, friends, family and thousands of fans hoping to catch a glimpse of the couple.

“It was the most thrilling experience,” an insider tells PEOPLE, of their Super Bowl night.

“She’s loved attending all the games, but this was of course on another level,” the source adds. “They partied and celebrated all night. It’s been the best few months for them.”

Swift and Kelce’s romance became the NFL season’s biggest story after the 14-time Grammy Award winner started showing up at the three-time Super Bowl champion’s games in Kansas City. Rumors about their budding romance began early on in the year after Kelce, 34, joked on his New Heights podcast that he tried to give Swift, also 34, a friendship bracelet with his phone number on it at her show in Kansas City last July.

“We started hanging out right after that,” Swift told Time Magazine last year.  “So we actually had a significant amount of time that no one knew, which I’m grateful for, because we got to get to know each other.”

Soon, Swift began attending Kelce’s games, sitting alongside her boyfriend’s family and friends in the team’s luxury box. Television cameras would often bounce back-and-forth between the play on the field and the “Blank Space” singer’s reactions alongside Kelce’s parents Ed and Donna Kelce, as well as other players’ wives and girlfriends like Brittany Mahomes.