Mild fever with a cold in babies is usually due to a viral infection and often improves with proper care. Keep your baby well hydrated, ensure proper rest, and keep the nose clean. Consult a paediatrician if the fever increases, persists, or the baby becomes weak or uncomfortable.