06/27/2012 11:40 am ET | Updated Jun 27, 2012

Charlie Sheen, Denise Richards Return To New York: 'Everything Started To Go Wrong,' Source Says

After an ugly incident that occurred the last time Charlie Sheen was visiting New York City with ex-wife Denise Richards and their daughters, Sheen was barred from the Plaza Hotel. The family returned to New York together this past week, for the first time since October 2010, but once again it seems something happened to ruin their trip.

"Charlie and Denise and the kids flew into NYC on a private jet Friday," a friend of Charlie's tells me. "This was the first time they had all been together as a family since the horrid incident at the Plaza. Everything started out so great. The family went to a Yankee game and even went sightseeing with the girls. But then everything started to go wrong."

Sheen and Richards were scheduled to visit New York at the same time to promote his new TV show, "Anger Management," and her new movie, "Madea's Witness Protection." This time, they stayed at the Ritz-Carlton.

A representative for the Ritz-Carlton Hotel Company told TMZ, "The hotel room was in pristine condition on Friday, June 22, and remains so today, Tuesday, June 26." But Sheen's friend maintains that the family's visit went awry.

"I'm not sure if he is banned, but things are not good," the friend tells me. "Charlie left today, but Denise is still staying at the hotel."