Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Write only changes to file - avoid duplicates
Top Forums Shell Programming and Scripting Write only changes to file - avoid duplicates Post 303028015 by aristosv on Saturday 29th of December 2018 06:00:32 PM
Old 12-29-2018
Actually instead of exporting the banned IP addresses every 60 seconds and writing them to a file, I ended up reading fail2ban log files to find which IP's were banned.

Code:
cat /var/log/fail2ban.log* | grep -o 'Ban.*' | sed 's/\<Ban\> //g' | sort -u

The actual issue that I am trying to solve, is that the current version of FreePBX can only run fail2ban v0.8.14, which does not maintain it's list of banned IP addresses after a reboot. So I wanted to somehow save the list of banned IP's, and after reboot, manually ban them again. Something like this:

Code:
for ip in $(cat /var/log/fail2ban.log* | grep -o 'Ban.*' | sed 's/\<Ban\> //g' | sort -u); do fail2ban-client set asterisk-iptables banip $ip; done

Which again is not really working 100%, so now I'm thinking of using iptables commands to ban the IP's, not fail2ban commands.

But I appreciate your suggestions and the discussion. It helps with the learning.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Avoid Duplicates in a file

Hi Gurus, I had a question regarding avoiding duplicates.i have a file abc.txt abc.txt ------- READER_1_1_1> HIER_28056 XML Reader: Error occurred while parsing:; line number ; column number READER_1_3_1> Sun Mar 23 23:52:48 2008 READER_1_3_1> HIER_28056 XML Reader: Error occurred while... (7 Replies)
Discussion started by: pssandeep
7 Replies

2. Shell Programming and Scripting

How to avoid a temp file

Hi all. I want to check the free space on a given FS and process the output. Right now, I'm using a temp file to avoid using df twice. This is what I'm doing #!/usr/bin/ksh ... df -k $FS_NAME > $TMP_FILE 2>&1 if ]; then RESULT="CRITICAL - $(cat $TMP_FILE)" else cat $TMP_FILE | ...... (3 Replies)
Discussion started by: fox1212
3 Replies

3. HP-UX

Parameter to avoid file being deleted by SAM

Good afternoon. I am a newbie. We just had a potentially big problem (negated to having good backups). Basically, there is an option in SAM, to delete all the data from the system that a user ever created. Lo and behold, silly me, I choose that option, and all sorts of needed files... (5 Replies)
Discussion started by: instant000
5 Replies

4. Shell Programming and Scripting

Avoid file creation in a script...achive same result

Guys following lines help me in getting numbers from PID column ,to be thrown into first column of a CSV file. COLUMNS=2047 /usr/bin/ps -eo pid,ppid,uid,user,args | grep -v "PID" > /tmp/masterPID.txt cat /tmp/masterPID.txt|while read line do PID=`echo $line|awk '{print $1}'` echo "$PID"... (4 Replies)
Discussion started by: ak835
4 Replies

5. Shell Programming and Scripting

avoid open file to check field.

Hi Everyone, # cat a.txt 94,aqqc,62345907, 5,aeec,77, # cat 1.pl #!/usr/bin/perl use strict; use warnings; use Date::Manip; open(my $FA, "/root/a.txt") or die "$!"; while(<$FA>) { chomp; my @tmp=split(/\,/, $_); if (index($tmp, "qq") ne -1) { ... (4 Replies)
Discussion started by: jimmy_y
4 Replies

6. Programming

[c]Why first file is creating after the second. How to avoid

Hi, My Code is as below: nbECRITS = fwrite(strstr(data->buffer, ";") + 1, sizeof(char), (data->buffsize) - LEN_NOM_FIC, fic_sortie); fclose(fic_sortie); sprintf(PATH_BALISE, "%s.balise", PATH); fic_balise_data = fopen(PATH_BALISE, "a+"); if (fic_balise_data == NULL) {... (1 Reply)
Discussion started by: ezee
1 Replies

7. Shell Programming and Scripting

Request to check remove duplicates but write before it

Hi alll I have a file with following kind input I want in output duplicates should not be there but there should be numbering mentioned before that like (4 Replies)
Discussion started by: manigrover
4 Replies

8. Shell Programming and Scripting

Request to check:remove duplicates and write sytematically

Hi all I have a file with following input It contains 5 columns gene name drug drug ID disease approved Now the same gene is repeated many times with different data in column2,3 ,4,5 I want to arrange dat in such a way that there shuld be one entry in the column(no... (2 Replies)
Discussion started by: manigrover
2 Replies

9. Shell Programming and Scripting

How to avoid ssh :Write failed: Broken pipe?

Hello, I am trying to run some code on Matlab over ssh . The code takes around 5-6 hours to complete. so after giving the command to run it , I locked my machine and then went off to sleep at night, only to discover in the morning that I get this message : ...Code running, partial results... (1 Reply)
Discussion started by: ajayram
1 Replies

10. Shell Programming and Scripting

Avoid overwriting backup file when multiple entries need to replace in one file input from another

Hello, I have been working on script in which search and replace the multiple pattern. 1. update_params.sh read the multiple pattern from input file ParamMapping.txt(old_entry|New_entry) and passing this values one by one to change_text.sh 2. change_text.sh read... (0 Replies)
Discussion started by: ketanraut
0 Replies

LEARN ABOUT DEBIAN

fail2ban-client

FAIL2BAN-CLIENT(1)						   User Commands						FAIL2BAN-CLIENT(1)

NAME

       fail2ban-client - configure and control the server

SYNOPSIS

       fail2ban-client [OPTIONS] <COMMAND>

DESCRIPTION

       Fail2Ban v0.8.2 reads log file that contains password failure report and bans the corresponding IP addresses using firewall rules.

OPTIONS

       -c <DIR>
	      configuration directory

       -s <FILE>
	      socket path

       -d     dump configuration. For debugging

       -i     interactive mode

       -v     increase verbosity

       -q     decrease verbosity

       -x     force execution of the server (remove socket file)

       -h, --help
	      display this help message

       -V, --version
	      print the version

COMMAND

	      BASIC

       start  starts the server and the jails

       reload reloads the configuration

       reload <JAIL>
	      reloads the jail <JAIL>

       stop   stops all jails and terminate the server

       status gets the current status of the server

       ping   tests if the server is alive

	      LOGGING

       set loglevel <LEVEL>
	      sets logging level to <LEVEL>. 0 is minimal, 4 is debug

       get loglevel
	      gets the logging level

       set logtarget <TARGET>
	      sets logging target to <TARGET>.	Can be STDOUT, STDERR, SYSLOG or a file

       get logtarget
	      gets logging target

	      JAIL CONTROL

       add <JAIL> <BACKEND>
	      creates <JAIL> using <BACKEND>

       start <JAIL>
	      starts the jail <JAIL>

       stop <JAIL>
	      stops the jail <JAIL>. The jail is removed

       status <JAIL>
	      gets the current status of <JAIL>

	      JAIL CONFIGURATION

       set <JAIL> idle on|off
	      sets the idle state of <JAIL>

       set <JAIL> addignoreip <IP>
	      adds <IP> to the ignore list of <JAIL>

       set <JAIL> delignoreip <IP>
	      removes <IP> from the ignore list of <JAIL>

       set <JAIL> addlogpath <FILE>
	      adds <FILE> to the monitoring list of <JAIL>

       set <JAIL> dellogpath <FILE>
	      removes <FILE> to the monitoring list of <JAIL>

       set <JAIL> addfailregex <REGEX>
	      adds the regular expression <REGEX> which must match failures for <JAIL>

       set <JAIL> delfailregex <INDEX>
	      removes the regular expression at <INDEX> for failregex

       set <JAIL> addignoreregex <REGEX>
	      adds the regular expression <REGEX> which should match pattern to exclude for <JAIL>

       set <JAIL> delignoreregex <INDEX>
	      removes the regular expression at <INDEX> for ignoreregex

       set <JAIL> findtime <TIME>
	      sets the number of seconds <TIME> for which the filter will look back for <JAIL>

       set <JAIL> bantime <TIME>
	      sets the number of seconds <TIME> a host will be banned for <JAIL>

       set <JAIL> maxretry <RETRY>
	      sets the number of failures <RETRY> before banning the host for <JAIL>

       set <JAIL> addaction <ACT>
	      adds a new action named <NAME> for <JAIL>

       set <JAIL> delaction <ACT>
	      removes the action <NAME> from <JAIL>

       set <JAIL> setcinfo <ACT> <KEY> <VALUE>
	      sets <VALUE> for <KEY> of the action <NAME> for <JAIL>

       set <JAIL> delcinfo <ACT> <KEY>
	      removes <KEY> for the action <NAME> for <JAIL>

       set <JAIL> actionstart <ACT> <CMD>
	      sets the start command <CMD> of the action <ACT> for <JAIL>

       set <JAIL> actionstop <ACT> <CMD>
	      sets the stop command <CMD> of the action <ACT> for <JAIL>

       set <JAIL> actioncheck <ACT> <CMD>
	      sets the check command <CMD> of the action <ACT> for <JAIL>

       set <JAIL> actionban <ACT> <CMD>
	      sets the ban command <CMD> of the action <ACT> for <JAIL>

       set <JAIL> actionunban <ACT> <CMD>
	      sets the unban command <CMD> of the action <ACT> for <JAIL>

	      JAIL INFORMATION

       get <JAIL> logpath
	      gets the list of the monitored files for <JAIL>

       get <JAIL> ignoreip
	      gets the list of ignored IP addresses for <JAIL>

       get <JAIL> timeregex
	      gets the regular expression used for the time detection for <JAIL>

       get <JAIL> timepattern
	      gets the pattern used for the time detection for <JAIL>

       get <JAIL> failregex
	      gets the list of regular expressions which matches the failures for <JAIL>

       get <JAIL> ignoreregex
	      gets the list of regular expressions which matches patterns to ignore for <JAIL>

       get <JAIL> findtime
	      gets the time for which the filter will look back for failures for <JAIL>

       get <JAIL> bantime
	      gets the time a host is banned for <JAIL>

       get <JAIL> maxretry
	      gets the number of failures allowed for <JAIL>

       get <JAIL> addaction
	      gets the last action which has been added for <JAIL>

       get <JAIL> actionstart <ACT>
	      gets the start command for the action <ACT> for <JAIL>

       get <JAIL> actionstop <ACT>
	      gets the stop command for the action <ACT> for <JAIL>

       get <JAIL> actioncheck <ACT>
	      gets the check command for the action <ACT> for <JAIL>

       get <JAIL> actionban <ACT>
	      gets the ban command for the action <ACT> for <JAIL>

       get <JAIL> actionunban <ACT>
	      gets the unban command for the action <ACT> for <JAIL>

FILES

       /etc/fail2ban/*

AUTHOR

       Written by Cyril Jaquier <cyril.jaquier@fail2ban.org>.  Many contributions by Yaroslav O. Halchenko <debian@onerussian.com>.

REPORTING BUGS

       Please report bugs via Debian bug tracking system http://www.debian.org/Bugs/.

COPYRIGHT

       Copyright (C) 2004-2008 Cyril Jaquier
       Copyright of modifications held by their respective authors.  Licensed under the GNU General Public License v2 (GPL).

SEE ALSO

       fail2ban-server(1)

fail2ban-client v0.8.2						    March 2008							FAIL2BAN-CLIENT(1)
All times are GMT -4. The time now is 05:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy