Sponsored Content
Top Forums Shell Programming and Scripting perl script file manipulation Post 302228050 by redoubtable on Friday 22nd of August 2008 04:09:42 PM
Old 08-22-2008
Code:
Tsunami file_manipulation # cat file1 
var1 <correct description>
var2 <correct description>
abc1 <correct description>
bcd3 <correct description>
Tsunami file_manipulation # cat file2 
var1 cl1 cl2 cl3 <wrong description1>
var1 b1 b3 b4 <wrong description3>
abc1 1 2 3 <wrong description1>
abc2 1 2 3 <wrong description7>
unknon m n po <wrong description7>
unknon sf dvd dvd <wrong description7>
bcd3 p q r <wrong description7
bcd3 n mb c <wrong description1>
Tsunami file_manipulation # perl -ane 'if (/^((.*?)\s(?:.*?\s){3})(.*?)$/) { print "$1".(defined $h{$2}?$h{$2}:$3)."\n"; } else { /^(.*?)\s(.*?)$/; $h{$1} = $2; }' file1 file2 
var1 cl1 cl2 cl3 <correct description>
var1 b1 b3 b4 <correct description>
abc1 1 2 3 <correct description>
abc2 1 2 3 <wrong description7>
unknon m n po <wrong description7>
unknon sf dvd dvd <wrong description7>
bcd3 p q r <correct description>
bcd3 n mb c <correct description>
Tsunami file_manipulation #

My solution stores every description of file1 in memory so if you have a really big file1 or file2 a line-by-line solution would fit best. Anyway, hope it helps.
PS: if an entry in file2 is not found in file1 I just keep file2's description "wrong description".
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Data manipulation in perl

Hello guys.. I have the following question. lets have that i have the following variable: $field=werfiurd383nd93bc93 c93 d93 d9e3 ddd or array=werfiurd383nd93bc93 c93 d93 d9e3 ddd what i would like to do is to store the first 4 characters of gthe aboce variable in variable... (1 Reply)
Discussion started by: chriss_58
1 Replies

2. Shell Programming and Scripting

Perl, string manipulation

Hi all, Supposing the following string: XXXXXXXXXXNEAXXXXXX How can I check if this string has the substring NEA? Best regards Chris (3 Replies)
Discussion started by: chriss_58
3 Replies

3. Shell Programming and Scripting

Perl to perfrom string manipulation

Hi, Please advise me how to perform checking in perl on the following input below. The output criteria will be 1. field 1 will begin as 913354744 for each as example 2. field 4 must be unique. 3. field 7 is showing dd/mm/yyyy, but it require checking if unixtime should covert to... (5 Replies)
Discussion started by: rauphelhunter
5 Replies

4. Shell Programming and Scripting

Array manipulation in perl

hi all, i am trying to append the output of a find command (for different paths)in an array as below... my $res_array; $i=0; $dir="/orn/ops/regs"; foreach $block("am","xb"){ $bdir="$dir/$block"; $res_array=`find $bdir ! -user mainuser -printf \"\%u \%h\\n\"`; $i++; } i... (6 Replies)
Discussion started by: saapa
6 Replies

5. Shell Programming and Scripting

Perl Text manipulation

Hello All, I have been working on a great script to remotely gather server info and store it in a .txt that can be imported to .xls I have been reading the hostnames that are in the /.shh/known_hosts file so I don't have to mess with passing a password - via ssh (not easy to do , by the... (1 Reply)
Discussion started by: dfezz1
1 Replies

6. Shell Programming and Scripting

Perl Text Manipulation

I'm in need of help for a project that I'm working on. I believe Perl would be the best way of handling the string manipulation, however, I've barely used perl, and I'm used to BASH scripting. Another note is, this project is in a Windows environment, so I can use Perl, but I do not have shell... (1 Reply)
Discussion started by: drewrockshard
1 Replies

7. Shell Programming and Scripting

Shell script text file manipulation.

Hello, I have mysql binary file which logs all the database queries and i to insert all queries log in to database. First i coverted binary file to text file. and start playing with it. Text file contains following queries, some samples are, SET INSERT_ID=1; INSERT INTO test... (0 Replies)
Discussion started by: mirfan
0 Replies

8. Shell Programming and Scripting

Difficult problem: Complex text file manipulation in bash script.

I don't know if this is a big issue or not, but I'm having difficulties. I apoligize for the upcoming essay :o. I'm writing a script, similar to a paint program that edits images, but in the form of ANSI block characters. The program so far is working. I managed to save the image into a file,... (14 Replies)
Discussion started by: tinman47
14 Replies

9. UNIX for Dummies Questions & Answers

Help with file manipulation script

I am a UNIX newbee . I have been doing some reading lately but really need help with an an urgent requirement.After almost two days of googling I end up with 0 luck. Hopefully a guru on here will be able to help me out. Here is my requirement: I have 20 files in a directory with detail records... (6 Replies)
Discussion started by: jeyd
6 Replies

10. Shell Programming and Scripting

File Manipulation - UNIX script

Hi, I have a file about 100 lines. Each line is about 2000 characters (each line is fixed length). In middle of each line is following constant value 0000040029892586 Now, I want to go through each line and increment by 1. So, line 1 will have 586 line 2 will have 587, line 3 will have... (4 Replies)
Discussion started by: jakSun8
4 Replies
CAT(1)							    BSD General Commands Manual 						    CAT(1)

NAME
cat -- concatenate and print files SYNOPSIS
cat [-benstuv] [file ...] DESCRIPTION
The cat utility reads files sequentially, writing them to the standard output. The file operands are processed in command-line order. If file is a single dash ('-') or absent, cat reads from the standard input. If file is a UNIX domain socket, cat connects to it and then reads it until EOF. This complements the UNIX domain binding capability available in inetd(8). The options are as follows: -b Number the non-blank output lines, starting at 1. -e Display non-printing characters (see the -v option), and display a dollar sign ('$') at the end of each line. -n Number the output lines, starting at 1. -s Squeeze multiple adjacent empty lines, causing the output to be single spaced. -t Display non-printing characters (see the -v option), and display tab characters as '^I'. -u Disable output buffering. -v Display non-printing characters so they are visible. Control characters print as '^X' for control-X; the delete character (octal 0177) prints as '^?'. Non-ASCII characters (with the high bit set) are printed as 'M-' (for meta) followed by the character for the low 7 bits. EXIT STATUS
The cat utility exits 0 on success, and >0 if an error occurs. EXAMPLES
The command: cat file1 will print the contents of file1 to the standard output. The command: cat file1 file2 > file3 will sequentially print the contents of file1 and file2 to the file file3, truncating file3 if it already exists. See the manual page for your shell (i.e., sh(1)) for more information on redirection. The command: cat file1 - file2 - file3 will print the contents of file1, print data it receives from the standard input until it receives an EOF ('^D') character, print the con- tents of file2, read and output contents of the standard input again, then finally output the contents of file3. Note that if the standard input referred to a file, the second dash on the command-line would have no effect, since the entire contents of the file would have already been read and printed by cat when it encountered the first '-' operand. SEE ALSO
head(1), more(1), pr(1), sh(1), tail(1), vis(1), zcat(1), setbuf(3) Rob Pike, "UNIX Style, or cat -v Considered Harmful", USENIX Summer Conference Proceedings, 1983. STANDARDS
The cat utility is compliant with the IEEE Std 1003.2-1992 (``POSIX.2'') specification. The flags [-benstv] are extensions to the specification. HISTORY
A cat utility appeared in Version 1 AT&T UNIX. Dennis Ritchie designed and wrote the first man page. It appears to have been cat(1). BUGS
Because of the shell language mechanism used to perform output redirection, the command ``cat file1 file2 > file1'' will cause the original data in file1 to be destroyed! The cat utility does not recognize multibyte characters when the -t or -v option is in effect. BSD
March 21, 2004 BSD
All times are GMT -4. The time now is 04:04 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy