Shell Programming and Scripting

Hi,
I need to delete an empty directory in a temp directory except "dir5" (keep everything that is not empty).
Plese advise.

Here is an example of my directory.

/dir/temp/
dir1 - delete if this is empty
dir2 - delete if this is empty
dir3 - delete if this is empty
dir4 - delete if this is empty
dir5 - I don't want to delete this folder at all.

Here is what I got so far

Code:

if [ "$(ls -1 /dir/temp |grep -v "dir5")" ]
then
        echo "directory is Not Empty"
        rmdir $(ls -1 /dir/temp |grep -v "dir5")
else
        echo "this directory is Empty"
        rmdir $(ls -1 /dir/temp |grep -v "dir5")
fi