Every campagin I play children die constantly. I know "infant deaths" is time period accurate. But in my Rome campaign my dudes had 5 children, all died. And his adopted daughter is on child death number 5 as well.
When I was playing the scots for a bit as well I had 4 child deaths back to back instantly ending the dudes bloodline.