The Reds were the last name out of the hat in Monday’s draw and must travel south to face Emma Hayes’ side at their home ground of Kingsmeadow.
Tickets are available to buy now from the Chelsea website and will cost £9 for adults and £1 for under 20s and over 65s. Reds fans wishing to sit together at the match are recommended to choose the North Stand.
Vicky Jepson’s team booked their place in the fifth round with an impressive 8-1 victory over Blackburn Rovers Ladies last Sunday.