Don't let an infant habitually go to sleep with a bottle, unless it is filled with water. Family Circle magazine notes that excessive milk or juice residue can cause the front teeth to decay.