The UNIX and Linux Forums  

Go Back   The UNIX and Linux Forums > Top Forums > Shell Programming and Scripting
Google UNIX.COM


Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts here.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
while loop inside while loop panknil Shell Programming and Scripting 0 01-07-2008 09:49 AM
For loop xramm HP-UX 3 10-10-2007 11:20 AM
While Loop hemangjani Shell Programming and Scripting 2 11-02-2006 08:01 AM
for loop munnabhai1 Shell Programming and Scripting 3 04-06-2006 11:30 AM
how to get the similar function in while loop or for loop trynew Shell Programming and Scripting 3 06-17-2002 08:09 AM

Reply
 
Submit Tools LinkBack Thread Tools Search this Thread Display Modes
  #1  
Old 06-27-2006
Registered User
 

Join Date: Jun 2006
Posts: 3
Loop help

I am trying to pull information out of a file based on one column. I want the records that meet a certain criteria to be places in a bad file and removed from the main file. I have them going in to the bad file but since there are more than one record I am not getting them all removed from the good file. What is the best way to read in the information and have each piece removed without overwriting the file and not removing all the bad data.

The CODE:
nawk '{if (length($0) > 106) print $1}' reads | sort -u > bad
cat bad | while read METER
do
cat reads | grep $METER >> bad.daily
cat reads | grep -v $METER > daily
done

I know the problem is the second grep -v is overwriting the file but I need to find the best way to be able to delete multiple ones with out overwriting.

Thanks
Cliff

Last edited by cjeffers; 06-27-2006 at 09:16 AM.
Reply With Quote
Forum Sponsor
  #2  
Old 06-27-2006
Ygor's Avatar
Moderator
 

Join Date: Oct 2003
Location: -31.96,115.84
Posts: 1,249
Not tested:
Code:
nawk '{if (length>106) print > "bad.daily" ; else print > "daily"}' reads
This section of the awk manual may help: Redirecting Output to Files and Pipes
Reply With Quote
  #3  
Old 06-27-2006
...@...
 

Join Date: Feb 2004
Location: NM
Posts: 4,297
Your requirements are not clear.

My take:
You want two files:
one with all the good data
another file with just unique bad data
Criterion for good/bad:
good data = record length less than equal to 106.

Code:
awk 'length($0)>106' reads | sort -u > bad.daily
awk 'length($0)<=106' reads > good.daily
Reply With Quote
  #4  
Old 06-27-2006
Registered User
 

Join Date: Jun 2006
Posts: 3
Yes I want two files one with bad data and one with good. The problem is the files with bad data could have other records that are good but would need to be pulled out also based on a unique column. The column could contain multiple records with only some of them being bad but all needing to be removed.

Sorry I should have been more clear.
Reply With Quote
  #5  
Old 06-27-2006
Registered User
 

Join Date: Jun 2006
Posts: 3
I have used egrep to solve the problem. Thanks for the assistance.
Reply With Quote
Google The UNIX and Linux Forums
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes




All times are GMT -7. The time now is 11:27 PM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited.
The UNIX and Linux Forums Content Copyright ©1993-2008. All Rights Reserved.Ad Management by RedTyger Visit The Complex Event Processing Blog

Content Relevant URLs by vBSEO 3.2.0