After your baby’s first year, growth slows down by about 30 percent, and so may appetite. Infants need to eat about 35 to 50 calories per pound, while toddlers require roughly 35 to 40 calories per pound, according to guidelines from the Institute of Medicine.