Sponsored Content
Top Forums Shell Programming and Scripting To remove a particular record from File Post 302384868 by SatishW on Wednesday 6th of January 2010 01:50:53 PM
Old 01-06-2010
Bug To remove a particular record from File

Dear Friends,
Need your help to fix the issue we are facing.
We have a requirement - Need to remove specific records from a comma separated file and create new file. It should check "filter.csv" file and then accordingly remove records from the input file and generate the output file.(not case sensitive removal of records)

Please see below example -
Please see below Model/Plant combinations, we want to remove records which contains below combinations and create file.

filter.csv
Code:
TC-P42C1,c231
TC-P50C1.c231
TC-P42X1,C231

Original File -File/Directory: /interfaces/inputfile.csv
Code:
TC-P42C1,C131,0,0,0,0,0,0,0,0,0
TC-P42C1,C201,4261,4261,4261,4261,4261,4261,4261,4261,4261
TC-P42C1,C231,0,0,0,0,0,0,0,0,0
TC-P42C1,C271,0,0,0,0,0,0,0,0,0
TC-P42C1,C311,0,0,0,0,0,0,0,0,0
TC-P42C1,C321,0,0,0,0,0,0,0,0,0
TC-P50C1,C201,1450,4072,4072,4072,4072,4072,4072,4072,4072
TC-P50C1,C231,0,0,0,2,2,2,2,2,2
TC-P50C1,C271,0,0,0,0,0,0,0,0,0
TC-P50C1,C341,0,0,0,0,0,0,0,0,0
TC-P50C1,C501,0,0,0,7,7,7,7,7,7
TC-P50C1,C601,0,0,0,0,0,0,0,0,0
TC-P50C1,C941,0,0,0,0,0,0,0,0,0
TC-P42X1,C141,0,0,0,0,0,0,0,0,0
TC-P42X1,C231,0,0,0,7,7,7,7,7,7
TC-P42X1,C611,0,0,0,0,0,0,0,0,0
TC-P42X1,C621,0,0,0,0,0,0,0,0,0
TC-P42X1,C921,300,300,300,300,300,300,300,300,0
SR-MS102,C141,0,0,0,0,0,0,0,0,0
SR-MS182,C231,0,0,0,0,0,0,0,0,0
SR-TEG18,C322,0,0,0,0,0,0,0,0,0
TC-32LX14,C141,0,0,0,0,0,0,0,0,0
TC-32LX14,C921,0,0,0,0,0,0,0,0,0
TC-32LX14,C231,0,0,0,0,0,0,0,0,0

OutPut File - File/Directory: /interfaces/outputfile.csv
Code:
TC-P42C1,C131,0,0,0,0,0,0,0,0,0
TC-P42C1,C201,4261,4261,4261,4261,4261,4261,4261,4261,4261
TC-P42C1,C271,0,0,0,0,0,0,0,0,0
TC-P42C1,C311,0,0,0,0,0,0,0,0,0
TC-P42C1,C321,0,0,0,0,0,0,0,0,0
TC-P50C1,C201,1450,4072,4072,4072,4072,4072,4072,4072,4072
TC-P50C1,C271,0,0,0,0,0,0,0,0,0
TC-P50C1,C341,0,0,0,0,0,0,0,0,0
TC-P50C1,C501,0,0,0,7,7,7,7,7,7
TC-P50C1,C601,0,0,0,0,0,0,0,0,0
TC-P50C1,C941,0,0,0,0,0,0,0,0,0
TC-P42X1,C141,0,0,0,0,0,0,0,0,0
TC-P42X1,C611,0,0,0,0,0,0,0,0,0
TC-P42X1,C621,0,0,0,0,0,0,0,0,0
TC-P42X1,C921,300,300,300,300,300,300,300,300,0
SR-MS102,C141,0,0,0,0,0,0,0,0,0
SR-MS182,C231,0,0,0,0,0,0,0,0,0
SR-TEG18,C322,0,0,0,0,0,0,0,0,0
TC-32LX14,C141,0,0,0,0,0,0,0,0,0
TC-32LX14,C921,0,0,0,0,0,0,0,0,0
TC-32LX14,C231,0,0,0,0,0,0,0,0,0

We have Unix commands like sed, cut, awk which can help us.
Thanks a lot. Happy New Year to all Unix World Smilie
Satish

Last edited by Scott; 01-06-2010 at 03:06 PM.. Reason: Please use code tags
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove duplicated xml record in a file under unix

Hi, If i have a file with xml format, i would like to remove duplicated records and save to a new file. Is it possible...to write script to do it? (8 Replies)
Discussion started by: happyv
8 Replies

2. UNIX for Dummies Questions & Answers

command to remove last record on file

Hi, First time on the forum. I have converted some files using the Unix to DOS command but need to strip off the last record that is generated from this conversion that contains just a ^Z. Is there any command that would accomplish this without having to do stream editing? (4 Replies)
Discussion started by: mheinen
4 Replies

3. UNIX for Dummies Questions & Answers

Remove First and Last Record from a file

Hi All, Could some one help me how to delete first & last record from a file Thanks in Advance....... Regards Cherrry (1 Reply)
Discussion started by: ravikuc
1 Replies

4. Shell Programming and Scripting

How to remove a particular record from a file?

Please tell me the command(s) to remove a particular record from the file and placing the rest of the record in a seperate file. (9 Replies)
Discussion started by: kanu_pathak
9 Replies

5. UNIX for Advanced & Expert Users

To remove the record from a file

Hi , In need to remove the record marked in red My input is as below : 1|ETG|63121387883|Alternate|Y 2||| 3|79.58|||GBP|| 4|001137001 4|0011372 5|1021701 5|1021901 1|ETG|63121387884|Alternate|Y 2||| 3|79.58|||GBP|| 4|001137001 5|1021702 5|1021802 1|ETG|63128363077|Alternate|Y 2|||... (1 Reply)
Discussion started by: laxmi131
1 Replies

6. Shell Programming and Scripting

remove newline chars in each record of file

Hi, I have a fixed width file with record length 10. I need to remove multiple newline characters present in each record. EX: af\n72/7\n s\n3\nad\n 2\n\n33r\n In the above file I want to remove new lines in red color(\n) but not (\n) Please provide me a solution. Thanks, Sri (1 Reply)
Discussion started by: srilaxmi
1 Replies

7. Shell Programming and Scripting

Remove particular record from a file

Hi:), I am having 110 records in a file and I want to delete particular record (say 63rd) . Which command can be use to achieve this ? (4 Replies)
Discussion started by: devmns
4 Replies

8. Shell Programming and Scripting

How to remove space from each record in file?

Hi , I want to remove space from each record in one file My file is like BUD, BDL ABC, DDD, ABC ABC, DDD, DDD, KKK The o/p should be BUD,BDL ABC,DDD,ABC ABC,DDD,DDD,KKK Can any one help me regarding this? (9 Replies)
Discussion started by: jagdishrout
9 Replies

9. Shell Programming and Scripting

Extract timestamp from first record in xml file and it checks if not it will replace first record

I have test.xml <emp><id>101</id><name>AAA</name><date>06/06/14 1811</date></emp> <Join><id>101</id><city>london</city><date>06/06/14 2011</date></join> <Join><id>101</id><city>new york</city><date>06/06/14 1811</date></join> <Join><id>101</id><city>sydney</city><date>06/06/14... (2 Replies)
Discussion started by: vsraju
2 Replies

10. Shell Programming and Scripting

Getting error not able remove the record

export PATH=$PATH:/opt/IBM/db2/V9.5/95fp4/bin DB2INSTANCE=bancbcb1 export DB2INSTANCE db2 "connect to dyaxprpt user xyz using byx" echo "Load lastest data start" Row=$(db2 –x “delete from xyz.ROL_yxpwhere axl_ING_ID in(50127,50455,503458,175748)”) If ; then echo “no data deleted” elif ;... (2 Replies)
Discussion started by: jagu
2 Replies
ppmshift(1)						      General Commands Manual						       ppmshift(1)

NAME
ppmshift - shift lines of a portable pixmap left or right by a random amount SYNOPSIS
ppmshift shift [ppmfile] DESCRIPTION
Reads a portable pixmap as input. Shifts every row of image data to the left or right by a certain amount. The 'shift' parameter determines by how many pixels a row is to be shifted at most. Another one of those effects I intended to use for MPEG tests. Unfortunately, this program will not help me here - it creates too random patterns to be used for animations. Still, it might give interesting results on still images. EXAMPLE
Check this out: Save your favourite model's picture from something like alt.binaries.pictures.supermodels (ok, or from any other picture source), convert it to ppm, and process it e.g. like this, assuming the picture is 800x600 pixels: # take the upper half, and leave it like it is pnmcut 0 0 800 300 cs.ppm >upper.ppm # take the lower half, flip it upside down, dim it and distort it a little pnmcut 0 300 800 300 cs.ppm | pnmflip -tb | ppmdim 0.7 | ppmshift 10 >lower.ppm # and concatenate the two pieces pnmcat -tb upper.ppm lower.ppm >newpic.ppm The resulting picture looks like the image being reflected on a water surface with slight ripples. SEE ALSO
ppm(5), pnmcut(1), pnmflip(1), ppmdim(1), pnmcat(1) AUTHOR
Copyright (C) 1993 by Frank Neumann 16 November 1993 ppmshift(1)
All times are GMT -4. The time now is 01:11 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy