Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

How to read a file, line by line in UNIX script?

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to read a file, line by line in UNIX script?
# 1  
Old 12-19-2013
How to read a file, line by line in UNIX script?
Code:
#!/bin/bash
file1="yxd"
for file in `cat file3.txt`;
do
cat $file1 | awk '{split($1,dp,"."); lend=length(dp); if(lend>2) { dom=dp[lend-2]"."dp[lend-1]; split($2,ipl,","); for(i=1; i<=length(ipl); i++) { if(ipl[i]~/:/) { if(ipl[i+1]~/:/) i++; rip=ipl[i]; i++; raq=ipl[i]; rtq=0; si=i+4; for(;i<si;i++) rtq+=ipl[i]; rsub=""; r32ip=""; if(rip ~ /^::FFFF:/) { r32ip=rip; rsub=substr(rip,8,7); } print tolower(dom)"|"rip"|"r32ip"|"rsub"|"raq"|"rtq; i--}} } }'   |
awk -F "|" '{if($1=="$file" && $4 != "") { cnt[$4]=1; cnt2[$3]++; qc+=$6; }}
END{ print length(cnt)"|"qc; }'
done

input:
file3.txt contains
Code:
abc 
abd
abe
abf

..... its not reading that file
Last edited by bartus11; 12-19-2013 at 12:19 PM.. Reason: Please use code tags
# 2  
Old 12-19-2013
It is definitely reading that file, but you cannot reference a shell variable inside an awk code by using dollar sign. So below statement in awk code is wrong:
Code:
if($1=="$file" && $4 != "")

You should assign a shell variable to awk variable using -v option and use it instead.

Also that for loop syntax is not recommended

I would suggest you to post your input and expected output and someone in this forum can suggest you a better approach.
# 3  
Old 12-20-2013
Input are file and file1
file contains
store.bal
product.bal
category.bal
admin.bal
--------
file1 contains
Code:
flip.store.bal ::FFFF:BADC:CD28,::FFFF:558E:11C5,6,8,2,1,::FFFF:81C8:CA8B,::FFFF:BADC:CD28,1,0,0,0,::FFFF:81C8:11C5,2,1,0,0,::FFFF:81DC:3111,1,0,1,0
store.bal. ::FFFF:F9CC:C5B9,::FFFF:356F:73C3,4,8,7,6,::FFFF:93CC:C9CF,::FFFF:F9CC:C5B9,1,0,0,0,::FFFF:93CC:73C3,2,1,0,0,::FFFF:93CC:3371,1,0,1,0
es.product.bal. ::FFFF:F9CC:C5B9,::FFFF:356F:73C3,4,8,7,6,::FFFF:93CC:C9CF,::FFFF:F9CC:C5B9,1,0,0,0,::FFFF:93CC:73C3,2,1,0,0,::FFFF:93CC:3371,1,0,1,0
many.category.bal. ::FFFF:F9CC:C5B9,::FFFF:356F:73C3,4,8,7,6,::FFFF:93CC:C9CF,::FFFF:F9CC:C5B9,1,0,0,0,::FFFF:93CC:73C3,2,1,0,0,::FFFF:93CC:3371,1,0,1,0
comp.admin.bal. ::FFFF:732B:649F,::FFFF:23EB:6EB2,2,3,8,7,::FFFF:FE66:6367,::FFFF:732B:649F,1,0,0,0,::FFFF:FE66:6EB2,2,1,0,0,::FFFF:FE2B:FE61,1,0,1,0
admin.bal. ::FFFF:FB85:A1BE,::FFFF:BC64:B35B,9,1,5,9,::FFFF:E3A2:AB2F,::FFFF:FB85:A1BE,1,0,0,0,::FFFF:E3A2:B35B,2,1,0,0,::FFFF:E385:13B1,1,0,1,0

---------
output
Code:
store.bal|8|54
product.bal|4|31
category.bal|4|31
admin.bal|8|56

in above code insted of each field replace with file ... presently code is reading only one filed for ex: store.bal
Code:
cat file1|awk '{split($1,dp,"."); lend=length(dp); if(lend>2) { dom=dp[lend-2]"."dp[lend-1]; 
split($2,ipl,","); for(i=1; i<=length(ipl); i++) 
{ if(ipl[i]~/:/) { 
if(ipl[i+1]~/:/) i++; rip=ipl[i]; i++; raq=ipl[i]; rtq=0; si=i+4; 
for(;i<si;i++) rtq+=ipl[i]; rsub=""; r32ip=""; 
if(rip ~ /^::FFFF:/) { r32ip=rip; rsub=substr(rip,8,7);
 } 
print tolower(dom)"|"rip"|"r32ip"|"rsub"|"raq"|"rtq; i--}} }
 }' |awk -F "|" '{if($1=="store.bal" && $4 != "") { cnt[$4]=1; cnt2[$3]++; qc+=$6; }}

................
if($1=="store.bal" && $4 != "") { cnt[$4]=1; cnt2[$3]++; qc+=$6; }} in this line, instead of store.bal ,need to call file having all 4 data i.e store.bal,procut.bal,caterogy.bal and admin.bal
Last edited by Franklin52; 12-20-2013 at 07:29 AM.. Reason: Please use code tags
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script UNIX to read text file line by line

i have a text file as belows, it includes 2 columns, 1st is the column name, 2nd is the file_name data_file.txt column_name file_name col1 file1 col2 file2 col3 file1 col4 file1 col5 file2 now, i would like to... (4 Replies)
Discussion started by: tester111
4 Replies

2. Shell Programming and Scripting

With script bash, read file line per line starting at the end

Hello, I'm works on Ubuntu server My goal : I would like to read file line per line, but i want to started at the end of file. Currently, I use instructions : while read line; do COMMAND done < /var/log/apache2/access.log But, the first line, i don't want this. The file is long... (5 Replies)
Discussion started by: Fuziion
5 Replies

3. Shell Programming and Scripting

Bash script to read a file from particular line till required line and process

Hi All, Am trying to write wrapper shell/bash script on a utility tool for which i need to pass 2 files as arugment to execute utility tool. Wraper script am trying is to do with above metion 2 files. utility tool accepts : a. userinfo file : which contains username b. item file : which... (2 Replies)
Discussion started by: Optimus81
2 Replies

4. Shell Programming and Scripting

How to read a two files, line by line in UNIX script and how to assign shell variable to awk ..?

Input are file and file1 file contains store.bal product.bal category.bal admin.bal file1 contains flip.store.bal ::FFFF:BADC:CD28,::FFFF:558E:11C5,6,8,2,1,::FFFF:81C8:CA8B,::FFFF:BADC:CD28,1,0,0,0,::FFFF:81C8:11C5,2,1,0,0,::FFFF:81DC:3111,1,0,1,0 store.bal.... (2 Replies)
Discussion started by: veeruasu
2 Replies

5. Shell Programming and Scripting

HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching

I have a LOG file which looks like this Import started at: Mon Jul 23 02:13:01 EDT 2012 Initialization completed in 2.146 seconds. -------------------------------------------------------------------------------- -- Import summary for Import item: PolicyInformation... (8 Replies)
Discussion started by: biztank
8 Replies

6. Shell Programming and Scripting

Shell script to read multiple options from file, line by line

Hi all I have spent half a day trying to create a shell script which reads a configuration file on a line by line basis. The idea of the file is that each will contain server information, such as IP address and various port numbers. The line could also be blank (The file is user created). Here... (1 Reply)
Discussion started by: haggismn
1 Replies

7. Shell Programming and Scripting

Shell script to read a text file line by line & process it...

Hi , I am trying to write an shell, which reads a text file (from a location) having a list of numbers of strictly 5 digits only ex: 33144 Now my script will check : 1) that each entry is only 5 digits & numeric only, no alphabets, & its not empty. 2)then it executes a shell script called... (8 Replies)
Discussion started by: new_to_shell
8 Replies

8. Shell Programming and Scripting

Read a File line by Line in unix

Hi , I have few files in a directory . I need to read all the files in that direcory and search for certain criteria in each file and write into a outputfile. I am also writing the each file name to the outputfile . For the above criteria , i have written the script.... (1 Reply)
Discussion started by: burwood
1 Replies

9. Shell Programming and Scripting

bash: read file line by line (lines have '\0') - not full line has read???

I am using the while-loop to read a file. The file has lines with null-terminated strings (words, actually.) What I have by that reading - just a first word up to '\0'! I need to have whole string up to 'new line' - (LF, 10#10, 16#A) What I am doing wrong? #make file 'grb' with... (6 Replies)
Discussion started by: alex_5161
6 Replies

10. Shell Programming and Scripting

shell script to read a line in gps receiver log file and append that line to new file

Hi, I have gps receiver log..its giving readings .like below Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. GPSD,R=1 $GPGSV,3,1,11,08,16,328,40,11,36,127,00,28,33,283,39,20,11,165,00*71... (3 Replies)
Discussion started by: gudivada213
3 Replies
Login or Register to Ask a Question