Basically, if he decides he likes you (which seemingly has no pattern of criteria) you're safe. If he doesn't like you, you'll be targeted and bullied until you leave.

To be totally frank, the issue you have just addressed here is endemic within the management or middle management of even the best public colleges/high/middle schools and/or universities within China.