He's accused of affairs with a Chinese spy and a worker at his company.