09/19/2011 04:24 pm ET | Updated Nov 19, 2011

Simon Cowell Explains Cheryl Cole On 'X Factor' Controversy (VIDEO)

With the "X Factor" making its debut on US soil this Wednesday, show creator Simon Cowell explains away one controversy already hitched to the hit UK show. Appearing on "Piers Morgan Tonight," Cowell told the CNN host that the decision to swap out outrageously telegenic judge Cheryl Cole for (the equally as telegenic) Nicole Scherzinger last-minute was "made in the moment" which he takes "full responsibility" for.

"I was talking to somebody about this who was at the screening the other night, and they put it very well. She looked a bit bewildered," Cowell said of Cole, who sat firmly planted by Cowell's side for three years of "X Factor UK" judging and left the show to join its sibling production stateside. Cole can be seen in the first taped episode of the show before being replaced by the Pussycat Dolls star.

"Not everyone is like you, Piers. You come to a country like America, it's a big deal, takes a while to adjust. And I took the view along with a few other peep that she would have been more comfortable back in the UK," Cowell elaborated.

Morgan himself has been a judge on the Cowell-produced show, "America's Got Talent," since its 2006 premiere, lending him the exposure to a previously-unfamiliar American public that many estimate earned him his current coveted CNN gig. It's something that new judge Scherzinger, who appears on the talk show with Cowell, seems to know well.

"It's an honor. I'm not going to lie, I cried when Simon told me," she told Morgan.

Watch Cowell's full interview with Piers Morgan Tuesday night on CNN at 9pm ET.