|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Shell script for searching a record,copy to a file and then delete it
Post 302413980 by kumara2010 on Monday 19th of April 2010 12:40:48 AM
04-19-2010
Shell script for searching a record,copy to a file and then delete it
Hi,
I have a requirement in hand:
I have a file with millions of records say file 1.I have another file, say file 2 which has 2000 records in it. The requirement is to read file2 , and remove the read record from file 1 and move i to a seperate file, file 3.
For eg: Read file 2, get the first record (eg: record id as 200) , read file 1, search for record id 200 and copy it to file 3, remove 200 from file 1.
Can some one help me with a flexible shell script which acheives the same faster. I tried using compare command but its taking a lot of time.
Any help would be much appreciated..
I have a requirement in hand:
I have a file with millions of records say file 1.I have another file, say file 2 which has 2000 records in it. The requirement is to read file2 , and remove the read record from file 1 and move i to a seperate file, file 3.
For eg: Read file 2, get the first record (eg: record id as 200) , read file 1, search for record id 200 and copy it to file 3, remove 200 from file 1.
Can some one help me with a flexible shell script which acheives the same faster. I tried using compare command but its taking a lot of time.
Any help would be much appreciated..
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi
Guys
I have downloaded a table from oracle database in .csv format. it has many fields as Title, First Name, Last Name etc. I have to download distinct titles from database and now i have to check all those titles from data of First Name one by one. and then i have to delete matched record.... (1 Reply)
Discussion started by: Rajeev Agrawal
1 Replies
2. Shell Programming and Scripting
Hi,
I want to copy some files from a Folder say, /usr/X at random intervals to another location.
Basically, new files will be dumped at random intervals to location /usr/X and I have to copy those new files to some other location (after copying, I cannot delete those files from source... (2 Replies)
Discussion started by: angshuman_ag
2 Replies
3. Shell Programming and Scripting
Hi,
I am looking for an answer for following senario:
I have a text file (base.txt) which consist list of files to be searched like:
base.txt
abc.txt
def.txt
fgh.txt
Now i am going to search all the listed files in another directory after reading them one by one, once i found the... (10 Replies)
Discussion started by: apjneeraj
10 Replies
4. Shell Programming and Scripting
hi All,
need help...!!
I want to delete header record from all the files in current directory.
using sed command i can delete first record from a file but i want to delete first record from all the files so can anybosy help me how can i do this?
I will appreciate your help. (3 Replies)
Discussion started by: NirajThakar
3 Replies
5. Shell Programming and Scripting
Dear all,
I have a database with thousands of files with the structure of name is:
Filename_hour_year.abc
Filename_hour_year_1.abc
..............
So what I need is how to write a script that all file with contain the character "_1" will copy to "_2"
For example: file name:... (7 Replies)
Discussion started by: hainguyen1402
7 Replies
6. Shell Programming and Scripting
Hi All,
I'm a newbie here, I'm just wondering on how to delete a single record in a large file in unix.
ex.
file1.txt is 1000 records
nikki1
nikki2
nikki3
what i want to do is delete the nikki2 record in file1.txt. is it possible?
Please advise,
Thanks, (3 Replies)
Discussion started by: nikki1200
3 Replies
7. UNIX for Dummies Questions & Answers
:EDIT:
I think my post name should have been labeled: how to copy files and record original file location. not "retain".
Hello, this is my first post! I searched the forums a lot before posting, but was unable to answer my question.
Here's my problem:
There are several hundred text files... (4 Replies)
Discussion started by: willie8605
4 Replies
8. UNIX for Dummies Questions & Answers
find pattern, delete line with pattern and 3 lines above and 8 lines below the pattern. The pattern is "isup". The entire record with starting tag <record> and ending tag </record> containing the pattern is to be deleted and the rest to be retained.
<record>
... (4 Replies)
Discussion started by: sdesstp
4 Replies
9. Shell Programming and Scripting
HI,
I need to print the record count of a file using shell script.
If the record count of a file excluding header and trailer record if greater than zero then print 'Record count of a file is xxxx records'.
If the record count is zero print 'zero records'
Thanks
Mahendra (1 Reply)
Discussion started by: mmeda
1 Replies
10. Shell Programming and Scripting
Sample file record :
"20130617003","2013-06-18T07:00:03","OUTWARD","01001011","TEST PLC","","HFX834346364364","20130617","10","DUM87534758","","1.28","826","020201","65879278","","","","","","010101","56789","DUMMY... (3 Replies)
Discussion started by: bigbuk
3 Replies
LEARN ABOUT OSF1
usync
usync(8) System Manager's Manual usync(8) NAME
usync - synchronize two setld inventory files to reflect current system status SYNOPSIS
/usr/lbin/usync [-d] file1 file2 OPTIONS
Enables debugging. This will print the pairs of pathnames being synchronized on the standard output. DESCRIPTION
The usync command is used to achieve inventory synchronization by merging two inventory files according to the pathname field of the inven- tory records. The result is directed to standard output. If the two inventory files contain records with the same pathname, the record in file2 is written and the record in file1 is ignored. If either inventory file contains a pathname not present in the other file, the record containing that pathname is written to standard output. To reflect the current system inventory, file2 should represent a later installation than file1. RESTRICTIONS
The two inventory files must be sorted in ascending ASCII sequence on the pathname field. ERRORS
usync: file is corrupt Explanation: Records in one of the inventory files are not sorted properly. EXAMPLES
The following command produces a synchronized inventory for two versions of the OATDCB subset: /usr/lbin/usync OATDCB100.inv OATDCB120.inv FILES
Subset inventory files SEE ALSO
stl_inv(4) Programming Support Tools usync(8)