"Having no brief" is a valid English expression. It comes out of the British legal system, where a lawyer accepts money to represent the interests (i.e. "holds a brief") of a client before the Bar (= in Court).

So, if one "holds no brief", then one is not being paid by either side and has no special interest in how any particular matter comes out. One is neutral about the matter at hand.