If you have done nothing wrong, work with peace of mind, leave evidence when threatened, and call the police for help if necessary.
If it is the fault of the laborer, the employer will not use such abusive means, and you can unilaterally terminate your labor contract.