Visit The New, Modern Unix Linux Community

substrings from all files incl subdirs into csv with dir names

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting substrings from all files incl subdirs into csv with dir names
# 1  
substrings from all files incl subdirs into csv with dir names


I have multiple files, one per subdirectory, all with the same file name. All subdirectories are one level deep from the main directory.

The data in the files is tab delimited between fields and record delimited with a newline.

The subdirectory names have the date in the name, i.e directory xxxx050109.

I would like to get the second and fifth tab delimited fields and directory name for all records from every file in all subdirectories and put them into a single comma delimited file i.e. field1,field2,directoryname.


# 2  
what have you tried?
# 3  
nawk -F"\t" -v OFS=, 'FNR==1{split(FILENAME,a,"/")}{print $2,$5,a[1]}' *@(0[1-9]|1[012])@(0[1-9]|[12][0-9]|3[01])[0-9][0-9]/*

# 4  
thanks, I'll try this tomorrow, have a nice Memorial day.
# 5  
still working on the nawk script....the sys admins are making me use gnuwin32 as they won't give me a solaris logon...Smilie
# 6  
Finally got it to work with Gnuwin32 and not using the regular expression for the filename.

Thanks for the help.

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #376
Difficulty: Medium
HP-UX was UNIX V7 compliant.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Retrieving names of files in a dir without overlapping

Hi, I have been trying to retrieve the names of files present in a directory one by one but the names of files are getting overlapped on one another. I tried the below command. ls -1 > filename please help me in getting the file names line by line without overlapping. I am using korn... (6 Replies)
Discussion started by: Pradhikshan
6 Replies

2. Shell Programming and Scripting

Parse csv files by their names

HI all I have multiple csv files with the names VAR1_VAR2_VAR3_VAR4.csv All the files have the same structure inside just values change. I am trying to retrieve data from those files by fixing at each time one or more VAR. I tried to write a script but I have 2 problems: 2-... (1 Reply)
Discussion started by: Jhon.c
1 Replies

3. Shell Programming and Scripting

Renaming File Names in a folder/Dir

Hi Team, I'm new to Unix shell scripting . I've the following requirement A folder contains the list of files with the following format ---------- I have to rename the above file to like below ... (6 Replies)
Discussion started by: smile689
6 Replies

4. UNIX for Dummies Questions & Answers

List files older that 7 days in a dir, excluding all subdirs

Hi, I would like to list all files, older than 7 days, in a directory, but exclude all subdirectories in the find command. If I use find . -type f -mtime +7 all files in the subdirs are also included. How can I exclude them? Regards, JW (6 Replies)
Discussion started by: jwbijl
6 Replies

5. Emergency UNIX and Linux Support

Command to calculate space for all subdirs under a dir

du -hs command calculates the space for all the subdirs under a dir ...but it is very slow if the dir is there any quick way ...I am using Sun OS. Thanks, Ajay (19 Replies)
Discussion started by: ajaypatil_am
19 Replies

6. Shell Programming and Scripting

Copy files and subdirs from dir to a new dir

Hello Comunity I am trying to make a bash shell script that it copies files and subdirs(with files) to a new dir. I would like the dest_dir to contain only subdirectories with files not other subdirs inside. it called : cpflatdir src_dir dest_dir Pleaze help me! Thank you in... (2 Replies)
Discussion started by: BTKBaaMMM
2 Replies

7. Shell Programming and Scripting

Get dir names.

Hi, i have a directory and sub directory`s inside. i want to take all the files name and add them into array. for example : $ ls Debug script.c src typescript $ Array = Debug Array= scripts.c Array = src Array = typescript. Thanks for the help. Or. (2 Replies)
Discussion started by: orushw
2 Replies

8. Shell Programming and Scripting

create dir in main &subdirs,perform action

Hi, I have one dir which has N subdirs.For ex: /home/user/Project_Src /home/user/Project_Src/Dir_A /home/user/Project_Src/Dir_A/subdir/sub_dir2 /home/user/Project_Src/Dir_A/subdir/sub_dir3 /home/user/Project_Src/Dir_B /home/user/Project_Src/Dir_B/Build i want to create a folder with... (2 Replies)
Discussion started by: dragon.1431
2 Replies

9. UNIX for Dummies Questions & Answers

Copying dir (and sub dir) file names from ftp server to txt file in diff server

Hey all, i want to copy only the file names from an ftp server (directory and all sub directory) to a text file in another server (non ftp), i.e. i want to recursively move through directories and copy only the names to a text file. any help is appreciated...thank you in advance (1 Reply)
Discussion started by: deking
1 Replies

10. UNIX for Dummies Questions & Answers

Special meaning characters in dir names

Hello, I've had a daemon go a little bit mental and create directories using somments from a config file. The end result is I've ended up with directories with names such as #, 5625), (5725 etc etc etc... However, when I try and delete them I get syntax errors, ( not expected, rmdir #... (2 Replies)
Discussion started by: JWilliams
2 Replies

Featured Tech Videos