modify file using awk


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting modify file using awk
# 8  
Old 04-19-2002
Thanx Hugo and Jimbo. I think I will have to use and a.ascNEW approach here.
# 9  
Old 04-19-2002
grep, grep, grep -v

grep is what you are looking for.

First use ^$ to remove any blank lines, then grep -v to remove unique lines in the file. Then redirect to a new filename.


cat filename |grep -v ^$ |grep -v "unique header" |grep -v "unique footer" > new.filename

Remember the -v option for grep will remove/ignore lines and send the rest to standard out.

Smilie Smilie
# 10  
Old 04-19-2002
I think the one awk process is a far superior solution than four processes piped together.
Jimbo
# 11  
Old 04-19-2002
Is superior, in all the ways. If somebody doubts it, use the time command.
# 12  
Old 04-19-2002
yea, yea, yea...Smilie Smilie

I know that it wastes some amount of time and is firing off multiple processes...

I was going for simplicity. However, for single use items like removing blank lines grep -v ^$ is easy to remember.

I enjoy using awk as well, it is very cool. I am making my way through "The AWK Programming Language by Aho, Kerningan, Weinberger". Great book.


Smilie
# 13  
Old 04-19-2002
Thanks, Kelum_Magnus, for the awk book reference. To me, awk and vi were both very frustrating until I got the hang of them, now I love them.

And I definitely am not bashing grep. Every day you can see me using 4-5 piped greps.

But I strive for best practice. and I have improved my unix a huge amount, thanks to this forum and all the contributors, yourself included.
Jimbo
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Sed, awk or another bash command to modify string with the content of another file

Hello everybody, I would like modify some strings using sed or another command line with the content file. For example: - {fqdn: "server-01" , ip: "server-01"} - {fqdn: "server-02" , ip: "server-02"} - {fqdn: "server-03" , ip: "server-03"} - {fqdn: "server-04" , ip: "server-04"} My... (4 Replies)
Discussion started by: dco
4 Replies

2. Shell Programming and Scripting

Modify csv-files with awk

Hello everyone! I have thousands of csv files I have to import into a Database table. As usually the files aren't perfect. For example they have a different number of columns and some weird columns. The second problem is, that I have to add 3 parts of the filename into 3 rows in the... (6 Replies)
Discussion started by: elRonaldo
6 Replies

3. Shell Programming and Scripting

awk modify string

Hi Guys, i world like to do the following with awk, i have the the complete username example in a file a have some names Mario Rossi John Doe i would like to convert this name in this format from file with awk Mario,Rossi,"Mario Rossi ",m.rossi_ext@mydomain.com,$TRUE, John,Doe,"John... (7 Replies)
Discussion started by: charli1
7 Replies

4. Shell Programming and Scripting

Modify text file using awk

I have text file with lines as shown here. Each row has 11 columns separated by tab. In each row, i want to split the 8th column such that the output should look like shown below. Here value in the 9th column is DP value and in the 10th column is MQ value followed by the values after resource.EFF=.... (15 Replies)
Discussion started by: mehar
15 Replies

5. Shell Programming and Scripting

Modify awk statement

how do i modify the following: echo "jaba law welcome no jaba law sorry now jaba law" | awk '{s+=gsub(/jaba law/,"jaba law")} END {print s}' so that it shows me the actual phrase it found matching the strings i specified? something like: jaba law jaba law jaba law (4 Replies)
Discussion started by: SkySmart
4 Replies

6. Shell Programming and Scripting

modify awk

awk "BEGIN {if($PERCENT<$WARNING) {print \"OK\" ; exit 0} else if(($PERCENT>=$WARNING) && ($PERCENT<$CRITICAL)) {print \"WARNING\" ; exit 1} else if($PERCENT>=$CRITICAL) {print \"CRITICAL\" ; exit 2} }" how can i... (1 Reply)
Discussion started by: SkySmart
1 Replies

7. Shell Programming and Scripting

Modify the file with awk,sed or perl

Hi All, I need help from any of you.Would be so thankful for your help. I/P DDDD,1045,161,1557,429,1694,800,1911,1113,2460,1457,2917> 1609,3113,1869,3317,2732,3701,3727,4132,5857,5107> 9004,6496 DDDD,1125,157,1558,429,1694,800,1911,1117,2432,1444,2906>... (2 Replies)
Discussion started by: Indra2011
2 Replies

8. Shell Programming and Scripting

Modify an XLS file with Awk

Hello, I have 2 files. One has a list of serial numbers: 12345_7 2345_9 35454 4759:1 PEP8794 The other is an excel file, with multiple columns, separated by tab: 12345_7 ... ... .. .. .. .. .. 2345_9 ... ... .. .. .. .. .. 35454 ... ... .. .. .. .. .. 4759:1 ...... (4 Replies)
Discussion started by: ad23
4 Replies

9. Shell Programming and Scripting

awk can't modify the input file ??

Hi * I've just wanted to ask you if it's possible to modify the input file by using awk. Let me explain what I need: I need to change the value $4 from "defaults" to "nodev" in my text file. I've tried to use a string function called "sub" and it works. But I can't figure it out how to... (6 Replies)
Discussion started by: martinp111
6 Replies

10. Shell Programming and Scripting

Modify shell variables with AWK

Dear Folks, I have a command output something like: And I want to store PIN0 and SIG0 in two shell variables, now I do a double awk: PIN=`gsmctl -d /dev/ttyS0 pin sig | awk '/PIN0/ { print $2}'` SIG=`gsmctl -d /dev/ttyS0 pin sig | awk '/SIG0/ { print $2}'` It's possible to... (4 Replies)
Discussion started by: Santi
4 Replies
Login or Register to Ask a Question