Reading files of different type and same basename


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Reading files of different type and same basename
# 1  
Old 03-24-2013
Reading files of different type and same basename

Hi ! all

I have need of accessing multiple files of different type same base name, and I want to compare base name if matching then I want to send those 2 files of different type to some program, for further processing

my files are like this
Code:
file_1.txt
file_2.txt
file_3.txt
file_4.txt
file_6.txt
file_8.txt

Code:
file_1.asc
file_2.asc
file_3.asc
file_4.asc
file_7.asc

First I want to save file names in some array like this

Code:
file_type1 array
file_type2 array

Code:
now compare file_type1 array and file_type2 array

first send base name matched files as a variable to sub program say
Code:
variable name txt for .txt file

and
Code:
variable name asc for .asc file

program is something like this

Code:
awk .................'{}' $txt 
awk ..................'{}' $asc

once matched file ends, then send only one variable from unmatched file array, to sub program one by one

expected output

if I do echo $txt $asc should result like below

Code:
file_1.txt file_1.asc
file_2.txt file_2.asc
file_3.txt file_3.asc
file_4.txt file_4.asc
file_6.txt
file_7.asc
file_8.txt

Hope this will be possible with your help

Last edited by Akshay Hegde; 03-24-2013 at 06:49 AM..
# 2  
Old 03-24-2013
Not sure I understood your sophisticated specification, but as a starting point you could evaluate this one:
Code:
ls *.txt *.asc |
  cut -d\. -f1 |
  uniq -c -w7  |
  while read CNT FILE
    do [ "$CNT" -eq 2 ] && { ufct1 "${FILE}.asc"; ufct1 "${FILE}.txt"; } || ufct2 "$FILE*"
    done
file_1.asc
file_1.txt
file_2.txt
file_3.asc
file_3.txt
file_4.asc
file_4.txt
file_6.txt
file_7.asc
file_8.txt

having defined user shell functions ufctn to just echo the parameter.
This User Gave Thanks to RudiC For This Post:
# 3  
Old 03-24-2013
Sir
Code:
ufctn

function not working with my OS(Ubuntu 12.04 LTS) but I could is info page

following is error msg
Code:
ufct1: command not found
ufct1: command not found
ufct2: command not found
ufct1: command not found
ufct1: command not found
ufct2: command not found
ufct2: command not found
ufct2: command not found

any alternate solution is possible ?
# 4  
Old 03-24-2013
Quote:
Originally Posted by RudiC
. . . having defined user shell functions ufctn to just echo the parameter.
Did you ever hear about shell functions? You may call them subroutines as well... man bash:
Quote:
Shell Function Definitions
A shell function is an object that is called like a simple command and executes a compound command with a new set of positional
parameters. Shell functions are declared as follows:

name () compound-command [redirection]
function name [()] compound-command [redirection]
This defines a function named name. The reserved word function is optional.
I'm not sure what else you need? Want it spoon fed?
Code:
$ ufct1() { echo $1 double; }
$ ufct2() { echo $1 single; }

Put your processing into those functions.
# 5  
Old 03-24-2013
Sir I need $1 as separate variable here what happens is first txt file will come then asc file

suppose if I use
Code:
$1

in my awk script that is

Code:
# 1st script
awk .....'{}' $1

#2nd script
awk ...'{gsub(" ","\t");print}' $1

then both script will work with same input

I want like this

Code:
# 1st iteration 

some computation using file_1.txt
# 1st script
awk .....'{}' file_1.txt

#2nd script
some computation using file_1.asc
awk ...'{gsub(" ","\t");print}' file_1.asc

I did following mistake(like subroutine) sorry Sir
and thank you so much for solution


Code:
if statements
abc;


abc()
{
xyz code 
}


Last edited by Akshay Hegde; 03-24-2013 at 09:08 AM..
# 6  
Old 03-24-2013
Not sure I understand. Why don't you simply call functionA with the .txt file, and then functionB with the .asc file as a parameter?
# 7  
Old 03-24-2013
Sir there are only 2 ways left to me as there are many comparison inside script

one is use txt and asc as separate variable

2nd one is merge base name matching file and write id number to file

assume file_1.txt looks like this

Code:
15-12-1996   21-2-2024 12 34,000 888 976  1
15-12-1994   21-2-2026 12 35,000 885 977  2
15-12-1993   21-2-2025 12 37,000 887 976  3
15-12-1995   21-2-2029 12 39,000 878 976  4

and file_1.asc looks like this
Code:
15-12-1996   21-2-2024 12 34,000 888 976  1
15-12-1995   21-2-2029 12 39,000 878 976  4
15-12-1994   21-2-2026 12 35,000 885 977  2
15-12-1993   21-2-2025 12 37,000 887 976  3
15-12-1994   21-2-2026 12 35,000 885 977  2
15-12-1993   21-2-2025 12 37,000 887 976  3

then merged file should look like this
Code:
15-12-1996   21-2-2024 12 34,000 888 976  1 id1
15-12-1994   21-2-2026 12 35,000 885 977  2 id1
15-12-1993   21-2-2025 12 37,000 887 976  3 id1
15-12-1995   21-2-2029 12 39,000 878 976  4 id1
15-12-1996   21-2-2024 12 34,000 888 976  1 id2
15-12-1995   21-2-2029 12 39,000 878 976  4 id2
15-12-1994   21-2-2026 12 35,000 885 977  2 id2
15-12-1993   21-2-2025 12 37,000 887 976  3 id2
15-12-1994   21-2-2026 12 35,000 885 977  2 id2
15-12-1993   21-2-2025 12 37,000 887 976  3 id2

out of 2 any one solution can complete my task
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Latest list of files of each type

find /tmp/testlog/kSR*"_"2018* -type f -printf '%T@ %p\n' | sort -n | tail -3 | cut -f2- -d" " /tmp/testlog/log/KSR04_2018-07-05.log /tmp/testlog/log/KSR04_2018-07-06.log /tmp/testlog/log/KSR01_2018-07-06.log But, I would see the following output(latest files for each KSR tuype) ... (3 Replies)
Discussion started by: jhonnyrip
3 Replies

2. Shell Programming and Scripting

Errors trying to use all files of a type

I am trying to create a code that will use all the bam files stored on a separate drive (/media/cmccabe/C2F8EFBFF8EFAFB9/pool_I_090215), run them in a program that I have changed the directory to, and the output gets re-directed to (/home/cmccabe/Desktop/NGS/pool_I_090215). I have tried the... (11 Replies)
Discussion started by: cmccabe
11 Replies

3. UNIX for Dummies Questions & Answers

Search in one type of files and replace

I am not sure how to search and replace the word in the few specific files. I need to search and replace word in only the name containing pepsi in the filename. (12 Replies)
Discussion started by: ramkumar15
12 Replies

4. Shell Programming and Scripting

Delete files of the same type if there are more than 3

hi, I would like to delete files in a folder starting with letters ab and fe and so on. It should only delete if there are more than 3 files of that type in that folder. Please suggest me how to write a script. i am new to this scripting. (4 Replies)
Discussion started by: Sneddy
4 Replies

5. UNIX for Advanced & Expert Users

find -type d returning files as well as directories

Can anyone see why the following command returns all files and not just the directories as specified? find . -type d -exec ls -F {} \; Also tried find . -type d -name "*" -exec ls -F {} \; find . -type d -name "*" -exec ls -F '{}' \; -print Always returns all files :-\ OS is... (2 Replies)
Discussion started by: tuns99
2 Replies

6. UNIX for Advanced & Expert Users

Deleting older files of a particular type

hi This should be easy but i'm obviously missing something obvious. :) I'm looking to delete files from yesterday and older of extension .txt and there a range of subfolders with these files in them. The command runs but doesn't delete anything. SUSE 10. find /testfolder -maxdepth 2 -type f... (6 Replies)
Discussion started by: cmap
6 Replies

7. Shell Programming and Scripting

[php] ftp get all files from a certain file type

Hi all, I googled for this kind of function but didn't find anything. I have an FTP connection with a server, went to the dir. In this dir there are several TXT files. I would like to have function that downloads all this files, based on their .txt extension. In bash, for example, simply:... (10 Replies)
Discussion started by: laurens
10 Replies

8. UNIX for Advanced & Expert Users

Type v for generated files

Hi All, I was checking some of the files and I got the following entries:- =============== v, 664, serv, serv, version.txt, exe L, 775, serv, serv, start.sh, eventserv ================ Could someone please tell me what does the type"v" and "L" represent to. I have not... (2 Replies)
Discussion started by: shubhranshu
2 Replies
Login or Register to Ask a Question