Using milk in a baked good recipe, like offering yogurt and cheese, will not risk weaning your baby to milk from formula and/or breast milk. Milk in a baked good, . Find out when baby will be ready to eat finger foods, plus get info on the best Cheese. If baby has shown no signs of a dairy allergy, then it's perfectly safe to. But if your baby has chronic eczema or a food allergy, talk to the doctor first before giving your baby cheese. Cheese isn't one of the top allergenic foods, but it. Swiss cheese in particular has a slightly sweet taste that appeals to babies. Since cheese can be a choking hazard, cut it into small diced pieces. It's best for. Jan 24, blocks of cheese, best finger foods for babies. Thinkstock. Kid-friendly, protein- packed, loaded with calcium and other bone-building minerals. Dec 15, So, when can baby eat cheese? The best thing to do is talk to your pediatrician. And if your have a family history of dairy allergy, you can wait till.