I think the command need to be like this:
find . -name 'ftp_server*' | grep 2006

This particular command is having the over head of pulling the
file information from all the folders and then it greps for only 2006.

The overhead here is searching all the files rather I want to narrow
the search to search only in the 2006* folders.

Can we achieve this?