Not sure if I understand your question correctly. You will need all those packages for ssh to work. If you had installed Openssh packages, they you can safely remove these packages, as openssh will be under /usr/local.