Is it safe for babies to drink goat milk? If you want to give babies goats milk instead of formula, you should learn carefully about the ingredients and safety of this food.