O’Leary was also replaced on the show as part of a wider shake-up in a bid by show bosses to reverse the ratings losses of recent years and put X Factor back on top of rival Strictly Come Dancing.
“I haven’t seen Louis for ages but I got a text from him last week saying, ‘They are missing us, Dermot – have you seen the ratings?’ He was loving that,” Dermot told The Sun.
The show had a slight revival in the ratings last week with them rising slightly with the absence of Strictly on BBC One, but the episode was still down by around a million
Dermot also revealed that he doesn’t watch the X Factor now that he has his weekends free after years of having to work them.
He added: “I don’t watch it religiously now because I was on it for so long and I have got my weekends back.”
However, despite Louis’ subtle swipe at the show’s slump in ratings, the former judge recently revealed he’s been watching the new series and is feeling a bit nostalgic.
He confessed: “I do miss it a little bit actually. I actually do. I was watching it and I kind of missed being on it.”