Ensuring Trustworthiness in Decentralized Systems through Federated Distillation and Feature Mixing