Abnormal, epithelial-lined connection between an artery and vein that is present at the time of birth.