The Kansas City Chiefs tight end stepped out wearing a button-down featuring a horse and a series of people engaging in eyebrow-raising activities

Jason Kelce (left); Taylor Swift and Travis Kelce. Photo:  Lisa Lake/Getty Images, XNY/Star Max/GC Images

No one trolls quite as hard as a big brother.

On the Wednesday, Oct. 16 episode of Jason and Travis Kelce’s New Heights podcast, Jason, 36, caught his little brother off guard when he roasted the blue, Jacquemus button-down that Travis, 35, wore on his N.Y.C. double date night with girlfriend Taylor Swift and their friends Ryan Reynolds and Blake Lively.

The shirt in question, which retails for $495, features a large horse rearing up on its hind legs and several face-less people scattered around the scene — at least two of which appear to be caught in an intimate position, according to Jason.

Taylor Swift (left) and Travis Kelce. TheStewartofNY/GC Images

After reading from GQ‘s breakdown of Travis’ outfit, Jason joked, “It’s a fancy way of saying it’s a button down with horses and people f—— on it.”

For his part, Travis appeared to be genuinely surprised by his brother’s declaration, insisting that he bought the shirt because he “liked the color and the patterns and stuff.” He also defended his sartorial choices by saying it was “just art.”

“People f——? That’s what you got out of that?” Travis asked.

Jason pointed out that there appears to be a woman straddling a man just to the left of the horse. “That woman is riding that man,” the retired NFL player insisted as his brother called him “ridiculous.”

Travis tried to defend his outfit, saying that the seemingly amorous pair were just “sitting next to each other.”

“No, no, no, he’s underneath,” Jason replied. He added, “What are her tits out for if they’re not having sex, Travis?”

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories.

Travis ultimately appeared to give in, as he said, “You’re ridiculous. The fact that that got you fired up is ridiculous.”

Jacquemus shirt worn by Travis Kelce. bergdorfgoodman.com

The now infamous blue shirt was just one of the fashion moments Travis had over his weekend with Swift, 34. The couple made the most of a break in her Eras Tour schedule and his bye week as they hit the town in N.Y.C. for their double date, before heading to Yankees Stadium for the first game of the MLB American League Championship between the New York Yankees and Cleveland Guardians on Monday, Oct. 14.

Travis opted for a more casual look for the couple’s baseball outing. He sported a cap that read “Midnight Rodeo” paired with a black button-down over a white shirt. The tight end accessorized his simple ensemble with Louis Vuitton’s silver Monogram Craggy Necklace, which retails for $975.

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!

As for Swift, she kept things simple as well. The “Fortnight” singer wore a basic black cap and jacket, which she elevated with her signature red lip — no horses in sight.