The permissions on your .ssh directory and the files below that should be like these:
# ls -ld .ssh
drwx------ 2 xxxx xxxx 96 xxxxx .ssh

# cd .ssh
# ls -l
total 64
-rw------- 1 xxxx xxxx 887 xxxxx id_rsa
-rw------- 1 xxxx xxxx 1024 xxxxx prng_seed

As you can see, only the owner should have read/write permissions on the directory and the files. In fact, ssh wont work if you are more permissive than this.