Unlike the wielders of N101-N104 (Nasch, Durbe, Merag, and Vector), who don't wear masks, their other comrades, Alito, Girag, and Mizael do. This was most definitely intentional because it lines up with how not a single member of this trinity had anything to do with any other Barian Emperor in their past lives.
Nasch, Durbe, Merag, and Vector's lives were all intertwined with another while the other three had their own thing going on. Alito was simply being a gladiator and fought with his hands instead of needing to use weapons, and he was great friends with the prince of his land, but then got framed for somethung he didn't do. His friend was initially against his execution, but then the very same friend bascally said go ahead with the execution later on, so yeah, Alito was basically betrayed by his friend, even though it was beyond the king's control, since Don Thousand possessed the king.
And when Mizael was young, raiders destroyed his home and killed his parents, forcing him to wander the desert on the verge of death until Dragluon rescued him, forging a powerful, lifelong bond. Since then, Mizael basically became a mighty dragon tamer who protected his land. However, his life turned upside-down when a wandering shaman blamed the dragon for causing a flood, but Mizael did his best to defend his dragon from the rioting villagers and even offered his own life so the villagers would believe him. Howevee, they were killed anyway by a neighboring army, and it was later revealed that the wandering shaman was Don Thousand all along, he approached Mizael during his dying moments, and embedded Tachyon's card into Mizael's heart, later converting him into a Barian.
And then there was Girag, or Souhachi Kiraku as he was known in his past life. A great and benevolent warrior who befriended a tanuki named Ponta, who aided him in battles and won many conquests. Girag/Kiraku's vassals were displeased with his policy of distrubiting the wealth among the peasants (something he often did during his conquests), and rebelled against him. But then Girag, already knowing that he wouldn't be able to win this battle, forced himself to part way with Ponta, making the latter feel betrayed. And just like with Mizael, it was Don Thousand who brainwashed the vassals to turn against Girag.