Your safest bet would probably be to ask the Network Admin to block incoming to your boxes at the border router / firewall. I don't know if you want to block incoming and outgoing, but either way should be a relatively simple excercise for him (or her).

You may want to do that post-haste if you have not properly secured your boxes (and X isn't too terribly secure to have open, let alone floating around...).