Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to tail sed and awk in one line?
Top Forums Shell Programming and Scripting How to tail sed and awk in one line? Post 302983684 by Don Cragun on Friday 14th of October 2016 05:52:31 PM
Old 10-14-2016
Quote:
Originally Posted by baris35
Hello Don,
I mean that it's not creating a file named ip

Thanks for your time and suggestions

Kind regards
Boris
Ouch. Yes, the script I suggested:
Code:
#!/bin/bash
while true
do	awk '/myword/ && !a[$1]++ {print $1}' /var/log/apache2/access.log
	while IFS= read -r ip
	do	printf '%s\n' "$ip" >> ip
		./ban.sh
	done
done

was missing a pipe symbol (as pointed out by RudiC). I intended to write:
Code:
#!/bin/bash
while true
do	awk '/myword/ && !a[$1]++ {print $1}' /var/log/apache2/access.log |
	  while IFS= read -r ip
	  do	printf '%s\n' "$ip" >> ip
		./ban.sh
	  done
done

But, as I said before, I have no idea if this is what you want to do since you still have not specified what you are trying to do! And, we have no idea what ./ban.sh does, whether you want to run it each time an IP address is added to the file ip, or if you just want to run it once each time awk processes your apache2 log file.
This User Gave Thanks to Don Cragun For This Post:
baris35
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how to sed with tail

hi, I am searching error and exception in my log and >> to report file, my code is : sed -n '//p;//p' $ARIBA_LOG_DIR/MyLog.txt >> $LOG_ERR_REP I need to report avove 5 line, that line and bellow 5 line.. what change is required in my code? (1 Reply)
Discussion started by: redlotus72
1 Replies

2. Shell Programming and Scripting

Head and Tail in One Line

I am new to UNIX......I have one file which contains thousnads of records with header and tailer. Header Record 1 Record 2 .... .... Last Record Trailer I want to concatenate Header and Trailer in the first line....now the output should look like this: Header: Header value, Trailer:... (2 Replies)
Discussion started by: 33junaid
2 Replies

3. Shell Programming and Scripting

Read logline line by line with awk/sed

Hello, I have a logfile which is in this format: 1211667249500#3265 1211667266687#2875 1211667270781#1828 Is there a way to read the logfile line by line every time I execute the code and put the two numbers in the line in two separate variables? Something like: 1211667249500#3265... (7 Replies)
Discussion started by: dejavu88
7 Replies

4. Solaris

Tail command in one line

HI i have to copy the last 5000 lines form a log file and copy the same in the same file .overwriting the same log file. ex: tail -5000 testfile1 > testfile2 cat testfile2 mv tesftfile2 testfile1 will produce the correct result.but i want to have this done in one line???? (4 Replies)
Discussion started by: saurabh84g
4 Replies

5. Shell Programming and Scripting

awk;sed appending line to previous line....

I know this has been asked before but I just can't parse the syntax as explained. I have a set of files that has user information spread out over two lines that I wish to merge into one: User1NameLast User1NameFirst User1Address E-Mail:User1email User2NameLast User2NameFirst User2Address... (11 Replies)
Discussion started by: walkerwheeler
11 Replies

6. UNIX for Advanced & Expert Users

sed one liner simialr to tail command

Can anyone explain the below sed oneliner? sed -e ':a' -e '$q;N;11,$D;ba' It works same as tail command. I just want to know how it works. Thanks (1 Reply)
Discussion started by: pandeesh
1 Replies

7. Shell Programming and Scripting

sed or awk to replace a value in a certain line.

I have an input like following. *DEFINE_CURVE_TITLE Force for tool binder $# lcid sidr sfa sfo offa offo dattyp 3 0 1 .000000 125.00000 0.000 0.000 0 $# a1 ... (5 Replies)
Discussion started by: hamnsan
5 Replies

8. UNIX for Dummies Questions & Answers

What should be precedence of using awk, sed, head and tail in UNIX?

Hi All, I am new to unix. In this forum some days back, I have read something like below: 1) Do not use perl if awk can do your work. 2) Do not use awk if sed can do your work. . . . I do not re-collect the whole thing. I think it is good to know the precedence of using these... (2 Replies)
Discussion started by: Prathmesh
2 Replies

9. Shell Programming and Scripting

sed and awk giving error ./sample.sh: line 13: sed: command not found

Hi, I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

10. Shell Programming and Scripting

Multiple line search, replace second line, using awk or sed

All, I appreciate any help you can offer here as this is well beyond my grasp of awk/sed... I have an input file similar to: &LOG &LOG Part: "@DB/TC10000021855/--F" &LOG &LOG &LOG Part: "@DB/TC10000021852/--F" &LOG Cloning_Action: RETAIN &LOG Part: "@DB/TCCP000010713/--A" &LOG &LOG... (5 Replies)
Discussion started by: KarmaPoliceT2
5 Replies

LEARN ABOUT DEBIAN

stda

STDA(1) 							   User Commands							   STDA(1)

NAME

       stda -  Simple Tools for Data Analysis (STDA)

DESCRIPTION

       STDA includes some primary tools for data analysis. You can evaluate sums, averages, integrals, derivatives, histograms or probability dis-
       tribution functions of 1-d data, and eventually plot the results. The programs are stand-alone tools (supporting the  standard  UNIX  input
       and  output  pipelines)	intended for data processing from the command line. It should be noted that all but one of the scripts use awk and
       core system utilities. For plotting you have to install Gnuplot (see http://gnuplot.info) since 'muplot' is a wrapper around  it.  In  sum-
       mary,  the  package  provides  utilities  for straightforward analysis of data series where a complex analytical approach is not needed and
       where an ultimate numerical precision with floating-point numbers is not critical. Some general examples of application cases include eval-
       uating usage statistics from server logfiles, determining a response time distribution from a series of queries to a [remote] service, pro-
       ducing a plot from multiple data files, etc.

       This software should be considered as an open project to be extended with new command-line driven utilities helpful for	performing  common
       data analysis tasks. Any contributions and suggestions are welcome.

       Following programs are included in the distribution:

       * maphimbu   - histogram builder for 1-d numerical and text data

       * mintegrate - average/sum/integral/derivative of 1-d numerical data

       * mmval	    - find minimum and maximum value in a data set

       * muplot     - plot a multi-curve figure from multiple data by using Gnuplot

       * nnum	    - produce a series of equally separated integers or floats

       * prefield   - prepare input file for 'muplot' to plot 2-d fields by arrows

EXAMPLES

       -  Evaluate  the current apache2 logfile and make an unique list of the hostnames (respectively ip-addresses) sorted by the total number of
       their http requests:

	      maphimbu -rs2 /var/log/apache2/access.log

       - On a X terminal plot the probability function and the cumulative distribution function of a sin(x) data sample:

	      nnum -3.14159 3.14159 0.00001 %.6g |awk '{ print $1, sin($1) }'  | maphimbu -d0.01 -x2 -ns1 |mintegrate -d0.01 -x1 -y3  -S  |muplot
	      lp - 1:3,4

COPYRIGHT

       Copyright (C) 2009, 2011-2012 Dimitar Ivanov <dimitar.ivanov@mirendom.net>

       License: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
       This is free software: you are free to change and redistribute it.  There is NO WARRANTY, to the extent permitted by law.

stda 1.1.1							   February 2012							   STDA(1)
All times are GMT -4. The time now is 09:43 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy