Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Reading and writing in same file
Top Forums Shell Programming and Scripting Reading and writing in same file Post 302697581 by kmajumder on Friday 7th of September 2012 04:19:31 AM
Old 09-07-2012
Hi Don,

I am trying my best.
This is my first grep command.
Code:
grep -e linkId=1ddoic abc-2012-10-01_000* | cut -f 2,5,14 | sort| uniq

1. yes. Though the initial fields(upto 10th column) are constant across all type of log entries but others will vary. The 2 example log I have given are two different type of log generated for 2 different events. So you will not get the linkId attribute in 2nd log entry. Even you do not need to bother about that because you just need to pick 5th column from 2nd log and replace 1st log after checking the id field if that matches. But in real scenario you have to grep through the entire log file to look for the id value found in 1st log.

Quote:
In some places you say there are two log files, in other places you say there is one log file but you grep it twice. Which is it?
If there is a single log file, both greps and the conversion to the desired output can be done by reading the log file just once with awk if the output order doesn't matter.
i) I have multiple log files where I need to grep(like abc-2012-10-01_00000,abc-2012-10-01_00001.... etc.) and output 2nd, 5th and 14th column.
ii) While grepping through all the log files those invalid 2nd column will appear which is not intended.In the same file from where invalid 2nd columns were found valid 2nd columns can be found from there only by looking through the matching 'id' attribute value. It is upto you if you can achieve my goal in single grep.


My algorithm:-
i) for each file run above grep
for each row got from above grep if 2nd column is invalid(none11111)
run another grep on same file and replace invalid 2nd column with new one.
 

10 More Discussions You Might Find Interesting

1. Programming

Reading and Writing file on LAN

Hi gurus I am not a C programmer but I need to read and write files on a computer on LAN using IP address. Suppose on a computer that has an IP 192.168.0.2 Any help or code example. I did in JAVA using URL, but do not know how to do in ANSI-C. In java: ------- URL url = new... (3 Replies)
Discussion started by: lucky001
3 Replies

2. UNIX for Advanced & Expert Users

Reading a file and writing the file name to a param file.

Hi All, Not sure if this would be in a dummies sectiin or advanced. I'm looking for a script if someone has doen something like this. I have list of files - adc_earnedpoints.20070630.txt adc_earnedpoints.20070707.txt adc_earnedpoints.20070714.txt adc_earnedpoints.20070721.txt... (1 Reply)
Discussion started by: thebeginer
1 Replies

3. UNIX for Dummies Questions & Answers

reading ,writing,appending ,manipulating a file.

Hi my prob statement is to create a new file or to append to the 1tst file the followign chages. File 1: txt file. portfolio No a b c d abc 1 Any Any Any charString cds 2 values values values charString efd 3 can can can charString fdg 4 come come come charString... (4 Replies)
Discussion started by: szchmaltz
4 Replies

4. UNIX for Dummies Questions & Answers

Log File Writing and Reading

Hi all, I have the following shell script code which tries to sftp and writes the log into the log file. TestConnection () { echo 'Connection to ' $DESTUSERNAME@$DESTHOSTNAME $SETDEBUG if ]; then rm $SCRIPT ; fi touch $SCRIPT echo "cd" $REMOTEDIR >> $SCRIPT echo "quit" >>... (10 Replies)
Discussion started by: valluvan
10 Replies

5. Programming

I need help with file reading/writing in C

Hello everybody, I'm trying to code a program which makes the following: It sends an ARP request frame and when it gets the reply, extracts the IP address of source and writes it to a .txt file. This is gonna be done with many hosts (with a for() loop), so, the text file would look like... (2 Replies)
Discussion started by: Zykl0n-B
2 Replies

6. Shell Programming and Scripting

Reading data from DataBase and Writing to a file

Hi All, Please help me in writing data to a file in one row. In database there is a column which contains large data which does not fit in the file in one row. The column contains list of paths. I want to write these paths to a file in one row. Please find the code below writes : ... (2 Replies)
Discussion started by: rajeshorpu
2 Replies

7. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies

8. Programming

unexpected values received when writing and reading from file

In the code below i try to write and read from a file, but i get unexpected results, like after writing i cannot open the file, and when reading the file the value entered earlier is not shown bool creat_fragments(int nFragment) { int fd, rand_value; char frag_path, buf; for(int... (8 Replies)
Discussion started by: saman_glorious
8 Replies

9. Shell Programming and Scripting

reading a file extracting information writing to a file

Hi I am trying to extract information out of a file but keep getting grep cant open errors the code is below: #bash #extract orders with blank address details # # obtain the current date # set today to the current date ccyymmdd format today=`date +%c%m%d | cut -c24-31` echo... (8 Replies)
Discussion started by: Bruble
8 Replies

10. Shell Programming and Scripting

Reading and Writing a conf file - Suggestions and improvements?

Hello all As part of my TUI - (line based) Text User Interface, i do have 2 commands to assist working with conf files. Now, for me they work, but since i wrote them, i automaticly use them they way they should be used... you know what i mean. ;) Anyway, they are designed to read 'simple'... (3 Replies)
Discussion started by: sea
3 Replies

LEARN ABOUT DEBIAN

numsum

NUMSUM(1)						User Contributed Perl Documentation						 NUMSUM(1)

NAME

       numsum - numsum program file

SYNOPSIS

       numsum [-iIcdhrsvxy] <FILE>

       | numsum [-iIcdhrsvxy]	(Input on STDIN from pipeline.)

       numsum [-iIcdhrsvxy]	(Input on STDIN.  Use Ctrl-D to stop.)

DESCRIPTION

       numsum will take all the numbers on stdin and return the sum of those numbers.  Currently it only processes the first number on each line.
       Besides positive numbers, it also handles negative numbers and numbers with decimals.

OPTIONS

	   -i  Only return the integer portion of the final sum.
	   -I  Only return the decimal portion of the final sum.

	   -c	   Print out the sum of each column.
	   -r	   Print out the sum of each row.

	   -x <n>  Specify a comma seperated list of columns to print.
	   -y <n>  Specify a comma seperated list of rows to print.

	   -s <string> Specify a string to use as a seperator for columns.
		       This defaults to be consecutive whitespace (s+).

	   -h  Help: You're looking at it.
	   -V  Increase verbosity.
	   -d  Debug mode.  For developers
	   -q  Quiet mode, don't print any warnings.

EXAMPLES

       Simply add up the numbers in a file.
	   $ numsum numbers.txt
	   4315

       Enter your own numbers on STDIN. The last number is the answer.
	   $ numsum
	   4
	   21
	   98
	   100
	   223

       Use it in a command pipeline.
	   $ ls -1s | grep .mp3 | numsum -c -x 5
	   72288

       Add up the total byte count in a http log file.
	   $ cat access_log | awk {'print $10'} numsum

	   or

	   numsum -c -x 10 access_log

       Add up the columns of numbers of a file.

	   $ cat columns
	   1 6 11 16 21
	   2 7 12 17 22
	   3 8 13 18 23
	   4 9 14 19 24
	   5 10 15 20 25
	   $ numsum -c columns
	   15 40 65 90 115

       Add up the 1st, 2nd and 5th columns only.

	   $ numsum -c -x 1,2,5 columns
	   15 40 115

       Add up the rows of numbers of a file.

	    $ numsum -r columns
	    55
	    60
	    65
	    70
	    75

       Add up the 2nd and 4th rows.

	    $ numsum -r -y 2,4 columns
	    60
	    70

SEE ALSO

       numaverage(1), numbound(1), numinterval(1), numnormalize(1), numgrep(1), numprocess(1), numrandom(1), numrange(1), numround(1)

COPYRIGHT

       numsum is part of the num-utils package, which is copyrighted by Suso Banderas and released under the GPL license.  Please read the COPYING
       and LICENSE files that came with the num-utils package

	 Developers can read the GOALS file and contact me about providing
       submitions or help for the project.

MORE INFO

       More info on numsum can be found at:

       http://suso.suso.org/programs/num-utils/

perl v5.10.1							    2009-10-31								 NUMSUM(1)
All times are GMT -4. The time now is 01:23 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy