Use grep sed or awk to extract string from log file and put into CSV

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Awk/sed command to extract the string between 2 patterns but having some particular value

Hi - i have one file with content as below. ***** BEGIN 123 ***** BASH is awesome ***** END ***** ***** BEGIN 365 ***** KSH is awesome ***** END ***** ***** BEGIN 157 ***** KSH is awesome ***** END ***** ***** BEGIN 7123 ***** C is awesome ***** END ***** I am trying to find all...

2. Shell Programming and Scripting

Replace string of a file with a string of another file for matches using grep,sed,awk

I have a file comp.pkglist which mention package version and release . In 'version change' and 'release change' line there are two versions 'old' and 'new' Version Change: --> Release Change: --> cat comp.pkglist Package list: nss-util-devel-3.28.4-1.el6_9.x86_64 Version Change: 3.28.4 -->...

3. Shell Programming and Scripting

Extract data from a log file and put it in a file

Hi, I would like to seek your help for a script that will extract data from log file and put it in a file. Sample log file 2018-10-23 12:33:21 AI ERROR -- tpid: SAMPLE_TH account: 123456789 aiSessionNumber: 660640464 mapName: xxx to yyy errorDesc: Translation Error:ErrorNumber : 993 ...

4. Shell Programming and Scripting

sed / awk / grep to extract information from log

Hi all, I have a query that runs that outputs data in the following format - 01/09/12 11:43:40,ADMIN,4,77,Application Group Load: Name(TESTED) LoadId(5137-1-0-1XX-15343-15343) File(/dir/dir/File.T03.CI2.RYR.2012009.11433350806.ARD) InputSize(5344) OutputSize(1359) Rows(2) Time(1.9960)...

5. Shell Programming and Scripting

How to extract start/end times from log file to CSV file?

Hi, I have a log file (log.txt) that which contains lines of date/time. I need to create a script to extract a CSV file (out.csv) that gets all the sequential times (with only 1 minute difference) together by stating the start time and end time of this period. Sample log file (log.txt) ...

6. Shell Programming and Scripting

Router ping log extract data from it Awk/Sed/grep

Hi, I am new to this world.. Using expect i loging to router and checking ping response to my links. I need to genarate report using this output and that report contains only three file link name, packet loss, latency. my output of script is like below: -bash-3.00$ monmw/mwbkp...

7. Shell Programming and Scripting

Need help please with Grep/Sed command to extract text and numbers from a file

Hello All, I need to extract lines from a file that contains ALPHANUMERIC and the length of Alphanumeric is set to 16. I have pasted the sample of the lines from the text file that I have created. My problem is that sometimes 16 appears in other part of the line. I'm only interested to...

8. UNIX for Advanced & Expert Users

bash/grep/awk/sed: How to extract every appearance of text between two specific strings

I have a text wich looks like this: clid=2 cid=6 client_database_id=35 client_nickname=Peter client_type=0|clid=3 cid=22 client_database_id=57 client_nickname=Paul client_type=0|clid=5 cid=22 client_database_id=7 client_nickname=Mary client_type=0|clid=6 cid=22 client_database_id=6...

9. UNIX for Advanced & Expert Users

WEB Server Log File Analysis using awk/sed/grep

I'm trying to find a way to show large page sizes (page size in K) from multiple web server log files. Essentially I want to show only rows from a file where a specific column is larger than some value. Has anyone ever done this type of log analysis? If so, a snippet of code would be very...

10. Shell Programming and Scripting

sed, grep, awk, regex -- extracting a matched substring from a file/string

Ok, I'm stumped and can't seem to find relevant info. (I'm not even sure, I might have asked something similar before.): I'm trying to use shell scripting/UNIX commands to extract URLs from a fairly large web page, with a view to ultimately wrapping this in PHP with exec() and including the...

LEARN ABOUT OSF1

log

Log(4)							     Kernel Interfaces Manual							    Log(4)

NAME

       Log, .Log - Contains the uucp program log files

SYNOPSIS

       /usr/spool/uucp/.Log

DESCRIPTION

       The /usr/spool/uucp/.Log directories contain uucp program log files.  The uucp program normally places status information about each trans-
       action in the appropriate log file each time you use the networking utilities facility.	All transactions of the uucico and  uuxqt  daemons
       are  logged  in	files named for the remote system concerned.  The files are stored in a subdirectory of the /usr/spool/uucp/.Log directory
       named for the daemon involved.  Thus, the log files are named with a form of the following: /usr/spool/uucp/.Log/DaemonName/SystemName

       The uucp and uuto commands call the uucico daemon.  The uucico daemon activities for a particular remote system are logged in  the  System-
       Name file in the /usr/spool/uucp/.Log/uucico directory on the local system.

       The uux and uusend commands call the uuxqt daemon.  The uuxqt daemon activities for a particular remote system are logged in the SystemName
       file in the /usr/spool/uucp/.Log/uuxqt directory on the local system.

       When more than one uucp process is running, however, the system cannot access the standard log file, so it places the status information in
       a file with a .Log prefix that covers just the single transaction.

       The  uucp  program can automatically append the temporary log files to a primary log file.  This is called compacting the log files, and is
       handled by the uudemon.cleanu command, a shell procedure, which combines the log files of the activities of the uucico and uuxqt daemons on
       a system and stores them in the /usr/spool/uucp/.Old directory.

       The  default  is for the uudemon.cleanu command to save log files that are 2 days old.  This default can be changed by modifying the appro-
       priate line in the shell script.  If storage space is a problem on a particular system, reduce the number of days that the files  are  kept
       in the individual log files.

       The uulog command can be used to view the uucp program log files.

RELATED INFORMATION

       Daemons: cron, uucico(8), uusched(8)

       Commands: uucp(1), uudemon.cleanu(4), uulog(1), uusend(1), uuto(1), uux(1) delim off

																	    Log(4)

Shell Programming and Scripting