Better not to risk getting soapy water in the eyes of your newborn ... rinse before wrapping baby in a hooded towel to pat dry. Jennifer Shu, MD (cont.) A relaxing bath helps babies sleep.