02/17/2012 04:15 pm ET Updated Feb 17, 2012

Rosie O'Donnell's Little People Comments Prompt Response From Amy And Matt Roloff

Chelsea Handler recently appeared on Rosie O'Donnell's new show on the Oprah Winfrey Network, and both ladies made some very surprising remarks about little people.

"I'm a little ashamed about it ... [but] I have a mild fear or anxiety around little people," Rosie said before asking Chelsea if she would ever sleep with a little person.

Now, Amy and Matt Roloff, stars of TLC's "Little People, Big World," are fighting back.

"I thought that was a little over the edge," Amy told me. "I was sad and disappointed that someone like Rosie would say that. For me it's okay to have those personal feelings, but to air it as she did, I think, was inappropriate. I'm a person, I'm an adult."

Although Amy's husband felt a bit more understanding when it comes to Rosie's comments, he did make it clear that her words are offensive.

"I want to give Rosie a big hug and have a big cry with her," Matt said. "Amy wants to to kick her in the shins. She objectified us -- that's where I draw the line. If she wants to call us a name out of ignorance, that's one thing, but talking about us as objects is a disturbing conversation in many ways."

Though Amy and Matt are ready to move on, they realize just how much more work there is to do when it comes to changing attitudes and educating people about little people.

"It's very hurtful, especially for our children," Amy said.

Check out an all new "Little People Big World" special, which airs Sunday at 8 p.m. Eastern on TLC.