Women’s vs men’s sizing

I found a great deal for the down sweater on REI but it’s only in men’s sizing! I typically wear a women’s small and was thinking of getting a men’s xs.

Does anyone have any experience with men’s vs. women’s sizing specifically with the down sweater? Thanks in advance!