Sponsored Content
Top Forums Shell Programming and Scripting Reading and writing in same file Post 302697083 by Don Cragun on Thursday 6th of September 2012 05:03:00 AM
Old 09-06-2012
Quote:
Originally Posted by kmajumder
Hi tyler,

1. 'abcde' and 'efghi' wont be there in original data. That is what I tried to explain.
The original data is not having the expected value. 'none1111' is the default value if no proper data is found after the 1st grep command.
2. So we have to run a 2nd grep command to replace those default value with expected value with the help of 4th column.
3. 4th column is the only connector b/w the two different log to get the actual 2nd column. So from the first set of data we need to pick up the 4th column (whose 2nd column is 'none1111') and we need to look for other log where we have the same 4th column to pick up the right 2nd column from next log.

Example:- First set of data

1. Consider some grep command gave below result.

12345,none1111,55,link1
56789,dsadsad,66,ewqrrwe
23456,none1111,77,link2
65655,yuytuytds,88,ertywd

2. In second column we get 'none1111' that means we have to run another grep command to pick up right 2nd column value.
Consider we ran another different grep command which takes 'link1' as input and return expected 2nd column i.e 'abcde'.
3. Then we have to replace all the 'none1111' value by iterating the first set of data and following the same procedure.

Hope it makes a bit clear to you.
What is clear to me is:
  1. You have a log file. We don't know what this log file looks like.
  2. You have run grep on the this log file and manipulated the lines that came back to produce a CSV file containing four columns.
  3. You won't tell us how you manipulated the data you grepped to produce the CSV file.
  4. You have another log file. We don't know what this log file looks like either.
  5. You want to match the 4th field in the CSV file you created against something in this second log file and replacenone1111with something else in the second log file.
  6. You aren't giving us enough data to help you.
Show us the names and contents of both log files. Explain the procedures you use to create your CSV file from the first log file. Show us the data in the 2nd log file that we are to match and show us how we determine the replacement fornone1111when we find the correct line in the 2nd log file. Then we may be able to help you.

Note that ryandegreat25 gave you a script that does what you have requested, for the values you've shown us, but almost certainly is not a general solution to the problem you're trying to solve.

Please give us enough information to be able to help you.Smilie
 

10 More Discussions You Might Find Interesting

1. Programming

Reading and Writing file on LAN

Hi gurus I am not a C programmer but I need to read and write files on a computer on LAN using IP address. Suppose on a computer that has an IP 192.168.0.2 Any help or code example. I did in JAVA using URL, but do not know how to do in ANSI-C. In java: ------- URL url = new... (3 Replies)
Discussion started by: lucky001
3 Replies

2. UNIX for Advanced & Expert Users

Reading a file and writing the file name to a param file.

Hi All, Not sure if this would be in a dummies sectiin or advanced. I'm looking for a script if someone has doen something like this. I have list of files - adc_earnedpoints.20070630.txt adc_earnedpoints.20070707.txt adc_earnedpoints.20070714.txt adc_earnedpoints.20070721.txt... (1 Reply)
Discussion started by: thebeginer
1 Replies

3. UNIX for Dummies Questions & Answers

reading ,writing,appending ,manipulating a file.

Hi my prob statement is to create a new file or to append to the 1tst file the followign chages. File 1: txt file. portfolio No a b c d abc 1 Any Any Any charString cds 2 values values values charString efd 3 can can can charString fdg 4 come come come charString... (4 Replies)
Discussion started by: szchmaltz
4 Replies

4. UNIX for Dummies Questions & Answers

Log File Writing and Reading

Hi all, I have the following shell script code which tries to sftp and writes the log into the log file. TestConnection () { echo 'Connection to ' $DESTUSERNAME@$DESTHOSTNAME $SETDEBUG if ]; then rm $SCRIPT ; fi touch $SCRIPT echo "cd" $REMOTEDIR >> $SCRIPT echo "quit" >>... (10 Replies)
Discussion started by: valluvan
10 Replies

5. Programming

I need help with file reading/writing in C

Hello everybody, I'm trying to code a program which makes the following: It sends an ARP request frame and when it gets the reply, extracts the IP address of source and writes it to a .txt file. This is gonna be done with many hosts (with a for() loop), so, the text file would look like... (2 Replies)
Discussion started by: Zykl0n-B
2 Replies

6. Shell Programming and Scripting

Reading data from DataBase and Writing to a file

Hi All, Please help me in writing data to a file in one row. In database there is a column which contains large data which does not fit in the file in one row. The column contains list of paths. I want to write these paths to a file in one row. Please find the code below writes : ... (2 Replies)
Discussion started by: rajeshorpu
2 Replies

7. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies

8. Programming

unexpected values received when writing and reading from file

In the code below i try to write and read from a file, but i get unexpected results, like after writing i cannot open the file, and when reading the file the value entered earlier is not shown bool creat_fragments(int nFragment) { int fd, rand_value; char frag_path, buf; for(int... (8 Replies)
Discussion started by: saman_glorious
8 Replies

9. Shell Programming and Scripting

reading a file extracting information writing to a file

Hi I am trying to extract information out of a file but keep getting grep cant open errors the code is below: #bash #extract orders with blank address details # # obtain the current date # set today to the current date ccyymmdd format today=`date +%c%m%d | cut -c24-31` echo... (8 Replies)
Discussion started by: Bruble
8 Replies

10. Shell Programming and Scripting

Reading and Writing a conf file - Suggestions and improvements?

Hello all As part of my TUI - (line based) Text User Interface, i do have 2 commands to assist working with conf files. Now, for me they work, but since i wrote them, i automaticly use them they way they should be used... you know what i mean. ;) Anyway, they are designed to read 'simple'... (3 Replies)
Discussion started by: sea
3 Replies
Perlbal::Manual::Logging(3pm)				User Contributed Perl Documentation			     Perlbal::Manual::Logging(3pm)

NAME
Perlbal::Manual::Logging - How Perlbal's logging system works VERSION Perlbal 1.78. DESCRIPTION Perlbal supports logging of a few messages (and you can log your messages in your plugins, for instance). This document describes how to achieve that. IMPORTANT: foreground vs. background If Perlbal is running on the foreground, it logs by calling "printf", which means you should get the logs on "STDOUT". If Perlbal is running on the background, it logs through Sys::Syslog. If Sys::Syslog is not available, there will be no logging, and THAT'S THE MOST IMPORTANT THING TO KNOW ABOUT PERLBAL'S LOGGING SYSTEM. How to log a message You can log a message by calling "Perlbal::log" as you'd call Sys::Syslog's "syslog": Perlbal::log( $priority, $format, @args ); You should read the documentation for Sys::Syslog for more information, but here's an example: Perlbal::log( 'info', 'beginning run' ); And here's another example: Perlbal::log( 'crit', "this thing crashed: $!" ); What is logged? o When we try to read from or write to a filehandle that is undefined, Perlbal::AIO logs a critical message: Perlbal::log("crit", "Undef $fh: $stack_trace"); o When failing to create a socket, Perlbal::BackendHTTP logs a critical message: Perlbal::log('crit', "Error creating socket: $!"); o When "inet_aton" fails to create a socket, Perlbal::BackendHTTP logs a critical message: Perlbal::log('crit', "inet_aton failed creating socket for $ip"); o When writing to a client, if we try to read more than we should from the backend, Perlbal::ClientHTTPBase logs a warning message: Perlbal::log('warning', "tried to readahead negative bytes. filesize=$self->{reproxy_file_size}, offset=$self->{reproxy_file_offset}"); o When opening a file being PUT for writing to disk, if there's an error (which is going to originate a 500 server error), Perlbal::ClientHTTPBase logs a warning message: Perlbal::log('warning', "system error: $msg ($info)"); o If we receive a request with a content length different from the actual length of the request, Perlbal::ClientProxy logs a critical message: Perlbal::log('crit', "Content length of $clen declared but $self->{buoutpos} bytes written to disk"); o When trying to buffer data to disk, if the operation fails Perlbal::ClientProxy logs a critical message: Perlbal::log('crit', "Failure to open $fn for buffered upload output"); o After buffering data to disk, if the file is empty, Perlbal::ClientProxy logs a critical message: Perlbal::log('crit', "Error writing buffered upload: $!. Tried to do $len bytes at $self->{buoutpos}."); o When purging a buffered upload on the disk, if an error occurs, Perlbal::ClientProxy logs a critical message: Perlbal::log('warning', "Unable to link $self->{bufilename}: $!"); o When marking a backend as pending, if there's already another one in that ip/port, Perlbal::Service will log a couple of warning messages: Perlbal::log('warning', "Warning: attempting to spawn backend connection that already existed."); Perlbal::log('warning', " -- [$filename:$line] $package::$subroutine"); o When deciding whether we should spawn one or more backend connections, if the total of pending conections is negative, Perlbal::Service will log a critical message: Perlbal::log('crit', "Bogus: service $self->{name} has pending connect count of $self->{pending_connect_count}?! Resetting."); o When spawning a backend connection, if there is no IP address for the backend, Perlbal::Service will log a critical message: Perlbal::log('crit', "No backend IP for service $self->{name}"); o When starting, Perlbal will log an info message: Perlbal::log('info', 'beginning run'); o When shutting down, Perlbal will log an info message: Perlbal::log('info', 'ending run'); o After each loop, is some error occurred, Perlbal will log a critical message: Perlbal::log('crit', "crash log: $_") foreach split(/ ? /, $@); o When attempting to create the pidfile, if unsuccessful, Perlbal will log an info message: Perlbal::log('info', "couldn't create pidfile '$file': $!" ); o When attempting to write to the pidfile, if unsuccessful, Perlbal will log an info message: Perlbal::log('info', "couldn't write into pidfile '$file': $!" ); Generating more logs by sending a USR1 signal to perlbal If you send a USR1 signal to perlbal, that tells it to log some basic statistics to the syslog. It's similar to connecting to a management service and issue a "show service" for each service, plus a "states" and a "queues" commands. Where is it logged to? The way Perlbal opens Sys::Syslog, it logs to /var/log/daemon.log by default. SEE ALSO You can tweek Sys::Syslog's configuration under /etc/syslog.conf. See Sys::Syslog for more details. perl v5.14.2 2012-03-23 Perlbal::Manual::Logging(3pm)
All times are GMT -4. The time now is 11:40 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy