It does not usually happen with reputable hakwons. Why is this teacher leaving? Are there any other foreign teachers at the school who could enlighten you on this?
There is no need to rush in finding a position in Korea. There are plenty of great opportunities for applicants who are qualified and free of criminal conviction.
Good Luck.