It must be that different brands of emulsion and lotion are mixed together, and different formulas have reactions. It has nothing to do with skin quality. The more you apply, the more you rub the mud. A pat can improve the mud rubbing phenomenon than a brush, but there is no guarantee that it will disappear.
For example, my Clinique cream is used together with Lancome small black bottle (which may be a multiple of SKII) to wipe the mud.