If your fellow-believer is hurt by you over matters of food, then you're no longer behaving in a loving way. Don't destroy someone for whom Christ died by the food you choose to eat.