Yeah, I don’t know about what is included in the bilateral agreement with Switzerland. But at least in EEA (which is EU + EFTA - Switzerland) you are free to work in any of the member states.