Jason Alexander, the man who was married to Britney Spears for 55-hours in January 2004, is assuring the world that he is no friend of Kevin Federline, 28, who took over his husbanding duties in September of the same year.

"I don't hate the guy but I'm not a big fan of his," he tells Inside Edition in an exclusive interview airing Friday.

The Spears-Federline split does not surprise Alexander. "Kevin hasn't really held up his end of the deal, just like he didn't in his first relationship with Shar [Jackson]. Now, he's got four kids out there."

"It just seems like he's been focused on the wrong things," he adds, referring to Federline's penchant for club-hopping and partying.

"If I had a wife who was one of the richest women out there, I would be at home with my kids taking care of them, letting her do her thing," he says.

Alexander and Spears, 24, who knew each from childhood, married in an extemporaneous Las Vegas ceremony, which was annulled several days later. He says he's spoken with Spears a few times since their annulment and welcomes the chance to get reacquainted.

"I think I'm a lot more respectful than Kevin is. I put my priorities first," he says, adding, "I still love her a lot."