07/09/2012 03:57 pm ET

Charlie Sheen, Denise Richards Not Speaking, Says Source

Although Charlie Sheen insists that nothing bad happened on his recent trip to New York with his ex-wife Denise Richards and their daughters, Sam and Lola, others tell a different story, saying Sheen and Richards are still not talking.

“New York was a nightmare,” a friend of the troubled actor told me. “They have not spoken since then.”

The family's first visit to the city since an infamous 2010 incident (when Sheen trashed a Plaza Hotel room) fell apart shortly after the group arrived.

“He didn’t see the kids in New York, except for the game that they all attended," the friend said. “It’s very, very sad. Everyone around him tries so hard to keep the peace for the kids. But at times you have to step away. There is so much that people don’t know. Denise would have nothing to do with him if they didn’t have kids together. Don’t get involved with him -- it’s like the mafia.”

Follow Naughty But Nice Rob on Twitter.