Earlier in the interview, host Chuck Todd asked what was "going on" between him and Bannon.
Like many others, Scaramucci told host George Stephanopoulos that he disagreed with Trump's weak and freakish statement on the outbreak of white supremacist violence over the weekend in Charlottesville, Virginia.
National security adviser H.R. McMaster on Sunday dodged a question about whether he could work together with chief strategist Stephen Bannon.
"I believe that everyone who works in the White House - who has the privilege, the great privilege every day of serving their nation - should be motivated by that goal", he said. But you've also got this sort of Bannonbart influence in there which I think is a snag on the president.
"I believe that everyone who works in the White House who has the privilege, the great privilege every day of serving their nation should be motivated by that goal", he said.
Bannon's ouster has been rumored in the past, with tension in the White House spilling out in public on an nearly weekly basis.
Anthony Scaramucci did not go gentle into that good night as he initially promised, and instead treated the world to a dose of his signature tri-state antics during an interview this morning on ABC. Bannon was formerly with the alt-right Breitbart News.
He continued: "He's got to move more into the mainstream, he's got to be more into where the moderates are and the independents are that love the president".
When pressed further, McMaster said he ready to work with anybody who will "help advance the president's agenda and advance the security, prosperity of the American people". If he does that, he'll have a successful legislative agenda that he can execute.
"What happens in Washington.is the president is not a representative of the political establishment class, so for whatever reason the people have made a decision that they want to eject him", Mr Scaramucci said.
A second source told CNN on Saturday that it's not only Kelly and Bannon whose relationship is on the rocks, it is also Bannon and the president.
Scaramucci, whose turn on the communications team lasted for less than two weeks, said in an interview with ABC News' This Week the president needed to get "more loyalists in" to protect his position.
STEPHANOPOULOS: You've been tough on Steve Bannon.
He called Lizza's decision to record the call " a very deceitful thing that he did".
But he added that he wanted to take accountability for his actions and that what he did "was wrong".