Also it might help if you said what exactly you need to do in the preprocessing, it's quite possible that there is a better tool than awk for what you need.