I'm really sorry to hear about your predicament. Did you apply for the job directly with the college or did you come through an organisation, or through a recruiter? It's always good to have other people backing you up.
It seems to me that someone higher up at the university wants you and your partner on campus full-time in order to communicate with the students more, either that or someone just wants your apartment. I guess you could offer to do an English corner for an hour each week to help students as a way to give your boss some face and still keep your apartment. If that fails move to South Korea for 6 months, save cash, then backpack around South East Asia until the money runs out.