Fixed the problem! A close look at the sshd_config file showed that Use_PAM wasn't set at all. Set that to yes. Also set ChallengeResponseAuthentication to no.
Code:
UsePAM yes
ChallengeResponseAuthentication no
After this a restart of sshd is all that it takes to fix it.
