Utilitarians don't just focus on their friends or family, or their fellow-citizens. They are concerned about distant strangers. They are concerned about future generations (so utilitarianism tells us why climate change matters, for example, even if its most severe effects won't be felt for another century). And "all affected" includes all sentient beings, so the suffering of animals matters too.
That's a clear