Code:
find . -type d |
grep -v '[0-9][^/*]$' |
xargs rm
The grep removes any line containing a number in the last component of the path name. Maybe you should run it with "xargs echo rm" first just to see that it does what you want.
You could also play around with
find -type d \! -name '*[0-9]*'
