Actually, depending on the time frame of symptoms. If your baby is rubbing ears and he has a congested/runny nose for a week with fever; if baby is eating less or less playful; you should consult a doctor.
If the delay is less than 7 days, you can relieve his symptoms with saline water. Talk to a pharmacist for advice on an appropriate product. An application of a warm water/tide compress may provide relief.