Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Need help to eliminate the records

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need help to eliminate the records
# 1  
Old 03-18-2013
Need help to eliminate the records
Hi All,

Please help me how to remove the records from the file if it is having more number of fields than the required one, before loading into stage

Here is the sample records. File is space delimited one

HTML Code:
chandu 1121324 CC ( 2 spaces)
chandu balu 434657 DD (3 spaces)  -- failing due to extra space between firstname and last name, its treating it as 4 attributes
Staging table having only 3 attributes.

Thanks,
Chandu
# 2  
Old 03-18-2013
Code:
awk 'FNR==3' myFile

# 3  
Old 03-18-2013
Hi,

I tried the above command, But its not working

Code:
awk 'FNR==3' test1.dat > test1.dat

After executing above code, I didnt get any records into the test1.dat file
# 4  
Old 03-18-2013
Quote:
Originally Posted by bbc17484
Hi,

I tried the above command, But its not working

Code:
awk 'FNR==3' test1.dat > test1.dat

After executing above code, I didnt get any records into the test1.dat file
sorry...
Code:
awk 'NF==3' test1.dat

This User Gave Thanks to vgersh99 For This Post:
bbc17484
# 5  
Old 03-18-2013
Quote:
Originally Posted by bbc17484
Hi,

I tried the above command, But its not working

Code:
awk 'FNR==3' test1.dat > test1.dat

After executing above code, I didnt get any records into the test1.dat file
You cannot redirect to the same file you're reading from.

That will truncate the file before awk runs and ruin your input as well as your output.
This User Gave Thanks to Corona688 For This Post:
bbc17484
# 6  
Old 03-18-2013
Thanks Corona688.. I re-directed to another file and finally renamed to file to old file name.
# 7  
Old 03-18-2013
Quote:
Originally Posted by bbc17484
Thanks Corona688.. I re-directed to another file and finally renamed to file to old file name.
Code:
{rm myFile; awk 'NF==3' > myFile; } < myFile
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Separate records of a file on 2 types of records

Hi I am new to shell programming in unix Please if I can provide help. I have a file structure of a header record and "N" detail records. The header record will be the total number of detail records I need to split the file in 2: One for the header Another for all detail records Could... (1 Reply)
Discussion started by: jamcogar
1 Replies

2. Shell Programming and Scripting

Compare two files with different number of records and output only the Extra records from file1

Hi Freinds , I have 2 files . File 1 |nag|HYd|1|Che |esw|Gun|2|hyd |pra|bhe|3|hyd |omu|hei|4|bnsj |uer|oeri|5|uery File 2 |nag|HYd|1|Che |esw|Gun|2|hyd |uer|oi|3|uery output : (9 Replies)
Discussion started by: i150371485
9 Replies

3. Shell Programming and Scripting

How to eliminate ^L

Hi, I am trying to create a text file from data retrieved from a query.The data retrieved is having this character '^L' at regular intervals of the data. How can i eliminate this, Please find below the sample data. I tried sed -e "s/\^L//g" to convert it, but with no luck ^LCODE*SERIAL... (11 Replies)
Discussion started by: ramkiran77
11 Replies

4. Shell Programming and Scripting

Compare and eliminate

Could any one help me to compare the date value say at 10th column with sysdate (i.e current date) and if diffrence is more than 50 days then filter them out from the file. The file contain 10000 records. head file 00971502657744 A671FAHP2EW8BG1369172011HRWS contact information ... (6 Replies)
Discussion started by: zooby
6 Replies

5. UNIX for Dummies Questions & Answers

Grep specific records from a file of records that are separated by an empty line

Hi everyone. I am a newbie to Linux stuff. I have this kind of problem which couldn't solve alone. I have a text file with records separated by empty lines like this: ID: 20 Name: X Age: 19 ID: 21 Name: Z ID: 22 Email: xxx@yahoo.com Name: Y Age: 19 I want to grep records that... (4 Replies)
Discussion started by: Atrisa
4 Replies

6. Shell Programming and Scripting

How to eliminate < > sign meaning

Hi I would like to replace one of our script, and add some pre-checking for the input file before running the command, but I bumped into the following issue: Original command: use < input.txt I cannot modify the original command, but I created the useit script which would be called as... (2 Replies)
Discussion started by: apapp
2 Replies

7. Shell Programming and Scripting

Based on num of records in file1 need to check records in file2 to set some condns

Hi All, I have two files say file1 and file2. I want to check the number of records in file1 and if its atleast 2 (i.e., 2 or greater than 2 ) then I have to check records in file2 .If records in file2 is atleast 1 (i.e. if its not empty ) i have to set some conditions . Could you pls... (3 Replies)
Discussion started by: mavesum
3 Replies

8. Shell Programming and Scripting

How to eliminate inf value in AWK

Hi, I have the calculations which return me infinity (inf), -inf, other very larger number when I printed them out. I did try to insert some control condition not to print these out if the above condition is met. The code I implemented is something like:- for (i=0;i<=1000;i++){ ... (3 Replies)
Discussion started by: ahjiefreak
3 Replies

9. Shell Programming and Scripting

Count No of Records in File without counting Header and Trailer Records

I have a flat file and need to count no of records in the file less the header and the trailer record. I would appreciate any and all asistance Thanks Hadi Lalani (2 Replies)
Discussion started by: guiguy
2 Replies

10. Shell Programming and Scripting

How to eliminate extra char?

I was trying to grep a variable with one space in my file: questionlabel=Q1 more job.tex Q1 pear Q1A applie grep -i "$questionlabel\ " job.tex > tmp But I keep getting : Q1 and Q1A both in my tmp Thanks!!!! (4 Replies)
Discussion started by: whatisthis
4 Replies
Login or Register to Ask a Question