Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to tail sed and awk in one line?
Top Forums Shell Programming and Scripting How to tail sed and awk in one line? Post 302983553 by baris35 on Wednesday 12th of October 2016 11:52:08 PM
Old 10-13-2016
How to tail sed and awk in one line?
Hello,
I am trying to create an iptables script with tail ,sed and awk.

1st Request: Search keyword "secret" in access.log file
2nd Request: Get first column matching lines (ip address)
3rd Request: Save it to a file

This is what I did so far:

grep.sh
Code:
#!/bin/bash
while true;
do
tail -f /var/log/apache2/access.log | awk '{print $1}' 
#tail -f /var/log/apache2/access.log | grep --line-buffered secret | awk '/secret/' | awk '{print $1}'     #not working as expected
#tail -f /var/log/apache2/access.log | grep --line-buffered debug | awk '$1' > ip.txt                          #gives all lines but not column1
#echo "iptables -A INPUT -s "$1" -j DROP" >> black
#echo "$A" >> black
#chmod 755 black
#./black
done

It prints out all ip address but not searching for the keyword "secret".
When I clear shebang symbol existing at the beginning of the following lines, it does not print matching output.

Is it possible to assign the pipe output to a variable so that I can use that value in following steps for iptables command?

Thanks
Boris
Last edited by baris35; 10-13-2016 at 12:58 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

how to sed with tail

hi, I am searching error and exception in my log and >> to report file, my code is : sed -n '//p;//p' $ARIBA_LOG_DIR/MyLog.txt >> $LOG_ERR_REP I need to report avove 5 line, that line and bellow 5 line.. what change is required in my code? (1 Reply)
Discussion started by: redlotus72
1 Replies

2. Shell Programming and Scripting

Head and Tail in One Line

I am new to UNIX......I have one file which contains thousnads of records with header and tailer. Header Record 1 Record 2 .... .... Last Record Trailer I want to concatenate Header and Trailer in the first line....now the output should look like this: Header: Header value, Trailer:... (2 Replies)
Discussion started by: 33junaid
2 Replies

3. Shell Programming and Scripting

Read logline line by line with awk/sed

Hello, I have a logfile which is in this format: 1211667249500#3265 1211667266687#2875 1211667270781#1828 Is there a way to read the logfile line by line every time I execute the code and put the two numbers in the line in two separate variables? Something like: 1211667249500#3265... (7 Replies)
Discussion started by: dejavu88
7 Replies

4. Solaris

Tail command in one line

HI i have to copy the last 5000 lines form a log file and copy the same in the same file .overwriting the same log file. ex: tail -5000 testfile1 > testfile2 cat testfile2 mv tesftfile2 testfile1 will produce the correct result.but i want to have this done in one line???? (4 Replies)
Discussion started by: saurabh84g
4 Replies

5. Shell Programming and Scripting

awk;sed appending line to previous line....

I know this has been asked before but I just can't parse the syntax as explained. I have a set of files that has user information spread out over two lines that I wish to merge into one: User1NameLast User1NameFirst User1Address E-Mail:User1email User2NameLast User2NameFirst User2Address... (11 Replies)
Discussion started by: walkerwheeler
11 Replies

6. UNIX for Advanced & Expert Users

sed one liner simialr to tail command

Can anyone explain the below sed oneliner? sed -e ':a' -e '$q;N;11,$D;ba' It works same as tail command. I just want to know how it works. Thanks (1 Reply)
Discussion started by: pandeesh
1 Replies

7. Shell Programming and Scripting

sed or awk to replace a value in a certain line.

I have an input like following. *DEFINE_CURVE_TITLE Force for tool binder $# lcid sidr sfa sfo offa offo dattyp 3 0 1 .000000 125.00000 0.000 0.000 0 $# a1 ... (5 Replies)
Discussion started by: hamnsan
5 Replies

8. UNIX for Dummies Questions & Answers

What should be precedence of using awk, sed, head and tail in UNIX?

Hi All, I am new to unix. In this forum some days back, I have read something like below: 1) Do not use perl if awk can do your work. 2) Do not use awk if sed can do your work. . . . I do not re-collect the whole thing. I think it is good to know the precedence of using these... (2 Replies)
Discussion started by: Prathmesh
2 Replies

9. Shell Programming and Scripting

sed and awk giving error ./sample.sh: line 13: sed: command not found

Hi, I am running a script sample.sh in bash environment .In the script i am using sed and awk commands which when executed individually from terminal they are getting executed normally but when i give these sed and awk commands in the script it is giving the below errors :- ./sample.sh: line... (12 Replies)
Discussion started by: satishmallidi
12 Replies

10. Shell Programming and Scripting

Multiple line search, replace second line, using awk or sed

All, I appreciate any help you can offer here as this is well beyond my grasp of awk/sed... I have an input file similar to: &LOG &LOG Part: "@DB/TC10000021855/--F" &LOG &LOG &LOG Part: "@DB/TC10000021852/--F" &LOG Cloning_Action: RETAIN &LOG Part: "@DB/TCCP000010713/--A" &LOG &LOG... (5 Replies)
Discussion started by: KarmaPoliceT2
5 Replies

LEARN ABOUT DEBIAN

pyp

PYP(1)							      General Commands Manual							    PYP(1)

NAME

       pyp - The Pyed Piper: A Modern Python Alternative to awk, sed and Other Unix Text Manipulation Utilities

SYNOPSIS

       pyp [options] files ...

DESCRIPTION

       pyp,  the  Pyed Piper, is a command line tool for text manipulation. It is similar to awk and sed in functionality, but its subcommands are
       Python based, and thus more familiar to many programmers.

       It can operate both on a per-line base and on the complete input stream.  Different features can be pipelined in a single command by  using
       the pipe character familiar from shell commands.

       pyp  backs  up  its  input  for reruns with modified commands, and can save commands as macros. On the downside, the rerun feature makes it
       unsuitable for continuous pipe operation.

OPTIONS

       These programs follow the usual GNU command line syntax, with long options starting with  two  dashes  (`-').   A  summary  of  options	is
       included below.	For a complete description, use --manual.

       -h, --help
	      Show this help message and exit.

       -m, --manual
	      Prints out extended help.

       -l, --macro_list
	      Lists all available macros.

       -s MACRO_SAVE_NAME, --macro_save=MACRO_SAVE_NAME
	      Saves current command as macro. use "#" for adding
	      comments	EXAMPLE:
	      pyp -s "great_macro # prints first letter" "p[1]".

       -f MACRO_FIND_NAME, --macro_find=MACRO_FIND_NAME
	      Searches for macros with keyword or user name.

       -d MACRO_DELETE_NAME, --macro_delete=MACRO_DELETE_NAME
	      Deletes specified public macro.

       -g, --macro_group
	      Specify group macros for save and delete; default is user.

       -t TEXT_FILE, --text_file=TEXT_FILE
	      Specify text file to load. For advanced users,
	      you should typically cat a file into pyp.

       -x, --execute
	      Execute all commands.

       -c, --turn_off_color
	      Prints raw, uncolored output.

       -u, --unmodified_config
	      Prints out generic PypCustom.py config file.

       -b BLANK_INPUTS, --blank_inputs=BLANK_INPUTS
	      Generate this number of blank input lines; useful for
	      generating numbered lists with variable 'n'.

       -n, --no_input
	      Use with command that generates output with no input;
	      same as --dummy_input 1.

       -k, --keep_false
	      Print blank lines for lines that test as False.
	      default is to filter out False lines from the output.

       -r, --rerun
	      Rerun based on automatically cached data from the last run.
	      Use this after executing "pyp", pasting input into the shell,
	      and hitting CTRL-D.

SEE ALSO

       awk(1), grep(1), sed(1).

AUTHOR

       pyp was written by Toby Rosen <tobyrosen@gmail.com>.

       This manual page was written by Khalid El Fathi <khalid@elfathi.fr>, for the Debian project (and may be used by others).

								  March 19, 2012							    PYP(1)
All times are GMT -4. The time now is 01:17 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy