To be fair, he does keep all his generals at a distance. Toudou has huge sway with the members and he treats the guy like shit, despite him being like some military genius. Tamaki I can see since that guys a loser, but how he treats most of the "named" members is retarded.
He also left the middle of the battle that he was the main coordiantor of with the druid system and told the frontline guys to handle the rest while he and kallen, with the two best knightmares that can take out fucking armies alone, fuck off and then he disappears for a year.
Ya, the ungrateful bastards that spent a year being tortured and nearly killed after being abandoned and whom all are being treated like shit pawns now have nothing to be disloyal about.