Stephen Colbert was the last featured guest at the annual PaleyFest TV on Sunday, according to The Hollywood Reporter.

The Late Show host spoke with comedian Ben Schwartz about his show and his career.

Colbert spoke about the beginnings of his career in Chicago's improv scene at Second Street to his turn as a Sunday school teacher. He also talked about how much he loves fantasy movies. Using that as a springboard, Schwartz asked him if he still wants to act. Colbert completed the acting program in Northwestern University.

“I was purely acting up until I had The Late Show,” he said, referring to his character on The Daily Show and then on his own The Colbert Report.

“One of the weirdest things about taking the job is my manager, James ‘Babydoll' Dixon, when he said, ‘Hey, it's you.' And I went, ‘Me?' And he said, ‘Yeah, do you want to do it?' And I'm like, ‘James, I'm an actor,'” Colbert recounted.

“Like, if I do the show, it's the first time in my life I wasn't inhabiting a character all the time. And, he goes, ‘Yeah, you can be an actor any time, no one's ever going to offer you this job again.' And I went, ‘Oh, that's kind of true,' then it seemed like an adventure to me,” he added.

Colbert has been in the late night show business for almost nine years. He calls it “an amazing adventure,” and that he would never trade it for anything.

“But I was always an actor,” he insisted.

“And so in the back of my head, I'm like, ‘Wonder if I'm ever going to do that again,' because I did that for 30 years,” Colbert continued.

While he's mostly in the late night adventures now, he still has a dream role he's been keeping close to his heart.

“I'm too old for the role that I've always wanted to play. I'm not like fishing for anybody to cast me, I can't do it … I've always kind of wanted to play Richard Rich, who is like a protégé of Thomas Moore in A Man for All Seasons,” The Late Show host explained.

Colbert made allowances for his age since he's turning 60 next month, and said that he could play another character, The Common Man. The character is in the play, but not in the film.

He also spoke about who he discusses his ideas with: his old boss and long-time business partner Jon Stewart and his wife Evie. Colbert also talked about his preshow ritual: telling the same four jokes to his The Late Show audience so he can gauge their response.

The host also DJs once the show is written and rehearsed.

“We turn a little speaker on and I go, ‘All right, what does everyone want to hear?' We listen to music before I go on, because I have to make the turn from the writer-producer to performer … I've got to turn into that person who's just there to embody it, and just be really much more in my body and not in my head. We're doing a lot of Isley Brothers recently,” he said.

Schwartz also asked about how the late night hosts seem close, especially with their podcast Strike Force Five.

“Everybody has their own reasons for how they feel about their job and competition, stuff like that,” Colbert responded.

The network and cable late night show host club has very few members and The Late Show host said that he'd much rather meet [Jimmy] Fallon for a drink.

“I'm lucky enough to have that with Jon Stewart, but I have that with any of them,” he stated.

“Except [John] Oliver,” he jokingly added, referring to his former Daily Show co-correspondent and current Last Week Tonight host.