Because Mary really loves Matthew, and Richard's behavior is becoming more and more unbearable for Mary, and her relatives around her think that Mary should be with Matthew. Mary's father also knew about the scandal and told her that if the scandal was exposed, she would go to America to hide for a while.
I guess you may not have seen the Christmas special in the second season, which is also a continuation of the plot ~ ~ ~