Shell Programming and Scripting

Hi,
I want to merging all MMDD* files into one file say today_file_dumb.csv and today_file_test.csv
Files format is below.

Thanks

file looks like

AAK_201104191802340972_dumb.csv
AAK_201104191802355572_dumb.csv
LLK_201104191702354722_dumb.csv

KKR_201104191802340972_test.csv
BBB_201104191802355572_test.csv
LLK_201104191802354722_test.csv




so i want

AAK_201104191802340972_dumb.csv
AAK_201104191802355572_dumb.csv
> today_file_dumb.csv

and

KKR_201104191802340972_test.csv
BBB_201104191802355572_test.csv
LLK_201104191802354722_test.csv
>today_file_test.csv

what do you really mean by MMDD* and where is this in your filename?

with the given example you can also do it like :

Code:

cat *dumb.csv >today_file_dumb.csv

and

Code:

cat *test.csv >today_file_test.csv

Hi,
This will not help as i need to pick just 0419 records when i say mmdd*
i am referring to 0419 so basic idea is lets says on april 24 we get 5 files
2 files for 0419 and two files for 0418 and 1 file for 0417 we need to pick
up two files for 0419 and append them.

AAK_201104191802340972_dumb.csv
AAK_201104191802355572_dumb.csv
LLK_201104191702354722_dumb.csv

so, in that case:

Code:

 
cat *0419*dumb.csv > today_file_dumb.csv

We can't hard code it we need dynmaic code for it

todays_date=`date +%m%d`

Code:

cat *$todays_date*_dumb.csv >>today_file_dumb.csv

cat *$todays_date*_test.csv >>today_file_test.csv

This is perhaps overkill, but this will handle files of different dates...

In the directory with your files:

Code:

ls *csv | awk -f matcher.awk

where matcher.awk contains:

Code:

BEGIN{FS="_"}
{
    date=substr($2,5,4);
}
/dumb/ {
    system("cat " $0 " >> " date "_dumb.csv")
}
/test/ {
    system("cat " $0 " >> " date "_test.csv")
}