01-24-2009
SH script to split squid log by date
Hi,
I really need your help to make a script to split a large squid's log file into a multiple files, each of them containing the log entries for every logged date.
To achieve the result I planned to use the function "date" with the first log field as a parameter using this syntax:
date -d @(ten number squid timestamp field) +%F
to obtain the desired filename for splitted logs.
Example:
# date -d @1232163496 +%F
will return: 2009-01-16
The idea is to analize the first field of each line in the log file and append whole line to the corresponding file.
Any help would be apreciated,
I'm a newbie ¿Someone can help me?
Last edited by _MCRH_; 01-28-2009 at 05:02 PM..
Reason: Before close it
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am trying to get the content of Apache access.log file for the current date for viewing purposes.
I can get it with the following sed command
sed -n '/09\/Oct\/2008/,/09\/Oct\/2008/p' access.log | less
now I want to enhance it such that it will automatically take current date instead of... (4 Replies)
Discussion started by: ysprathap
4 Replies
2. Shell Programming and Scripting
I am a newbie to scripting.
I need a korn shell script to copy log files of current day to archive folder and rename with current days date stamp.
I would really appreciate your help.
File structure is as follows. Everyday files get overwritten, so I need copy to a archive directory and... (3 Replies)
Discussion started by: mdncan
3 Replies
3. Shell Programming and Scripting
Hi frnds,
I have flat file as
.
Say :
output-file1.txt
Output-file2.txt (1 Reply)
Discussion started by: Gopal_Engg
1 Replies
4. Shell Programming and Scripting
hi All,
I have this sample text file - access.log:
Jan 18 21:34:29 root 209.151.232.70
Jan 18 21:34:40 root 209.151.232.70
Jan 18 21:34:43 root 209.151.232.70
Jan 18 21:34:56 root 209.151.232.70
Jan 18 21:35:10 root 209.151.232.70
Jan 18 21:35:23 root 209.151.232.70
Jan 18 21:36:04 root... (2 Replies)
Discussion started by: linuxgeek
2 Replies
5. Shell Programming and Scripting
Hi all,
I have logs(in a log file) with the following structure
20100916011501559;0.812;null;TRUE;;FALSE;0.812;0;0;;19
20100916011504762;0.015;null;TRUE;;FALSE;0;4|4;0.015;;4
20100916011504762;0;null;TRUE;;FALSE;0;0;0;;4
20100916011501731;3.343;null;TRUE;;FALSE;3.156;131|65;0.172;;11... (14 Replies)
Discussion started by: babai
14 Replies
6. IP Networking
Hello,
I have a pretty useless satellite link at home (far from any civilization), so I wanted to set up caching in order to speed things up. My Squid 2.6 runs "3128 transparent" and is set up quite well on a separate machine.
I also have my dd-wrt router to move all port 80 traffic through... (0 Replies)
Discussion started by: theWojtek
0 Replies
7. UNIX for Advanced & Expert Users
I searched and did not find a useful answer. Can someone please tell me the best practice to change the log directory from /var/log to /opt/squid? (4 Replies)
Discussion started by: glev2005
4 Replies
8. Shell Programming and Scripting
To delete log files content older than 30 days and append the lastest date log file date in the respective logs
I want to write a shell script that deletes all log files content older than 30 days and append the lastest log file date in the respective logs
This is my script
cd... (2 Replies)
Discussion started by: sreekumarhari
2 Replies
9. Shell Programming and Scripting
i need squid proxy log file daily auto generate by shell script (1 Reply)
Discussion started by: sanjeetkumar086
1 Replies
10. UNIX for Dummies Questions & Answers
I need to check 1 log file, which is logging:
2014-08-18T09:10:39+02:00 user: XXXXX START FEATURE
2014-08-18T09:10:39+02:00 user: XXXXX FINISH FEATURE
I first need to check that the START FEATURE starts and finish on the same time/date for the same user, which is different each time START... (2 Replies)
Discussion started by: TheBest43
2 Replies
squid(8) System Manager's Manual squid(8)
NAME
squid - proxy caching server
SYNOPSIS
squid [ -dhisrvzCDFNRVYX ] [ -l facility ] [ -f config-file ] [ -[ au ] port ] [ -k signal ] [ -n service-name ] [ -O cmd-line ]
DESCRIPTION
squid is a high-performance proxy caching server for web clients, supporting FTP, gopher, and HTTP data objects. Unlike traditional
caching software, squid handles all requests in a single, non-blocking, I/O-driven process.
squid keeps meta data and especially hot objects cached in RAM, caches DNS lookups, supports non-blocking DNS lookups, and implements nega-
tive caching of failed requests.
squid supports SSL, extensive access controls, and full request logging. By using the lightweight Internet Cache Protocol, squid caches
can be arranged in a hierarchy or mesh for additional bandwidth savings.
squid consists of a main server program squid, a Domain Name System lookup program dnsserver, some optional programs for rewriting requests
and performing authentication, and some management and client tools. When squid starts up, it spawns a configurable number of dnsserver
processes, each of which can perform a single, blocking Domain Name System (DNS) lookup. This reduces the amount of time the cache waits
for DNS lookups.
squid is derived from the ARPA-funded Harvest Project http://harvest.cs.colorado.edu/
This manual page only lists the command line arguments. For details on how to configure squid see the file /etc/squid/squid.conf, the
Squid FAQ and the documentation at the squid home page http://www.squid-cache.org
OPTIONS
-a port
Specify HTTP port number where Squid should listen for requests, in addition to any http_port specifications in squid.conf.
-d level
Write debugging to stderr also.
-f file
Use the given config-file instead of /etc/squid/squid.conf. If the file name starts with a ! or | then it is assumed to be an
external command or command line. Can for example be used to pre-process the configuration before it is being read by Squid. To
facilitate this Squid also understands the common #line notion to indicate the real source file.
-h Print help message.
-i Install as a Windows Service (see -n option).
-k reconfigure | rotate | shutdown | interrupt | kill | debug | check | parse
Parse configuration file, then send signal to running copy (except -k parse) and exit.
-n name
Specify Windows Service name to use for service operations, default is: Squid
-r Remove a Windows Service (see -n option).
-s Enable logging to syslog.
-l facility
Use specified syslog facility. implies -s
-u port
Specify ICP port number (default: 3130), disable with 0.
-v Print version.
-z Create swap directories
-C Do not catch fatal signals.
-D Disable initial DNS tests.
-F Don't serve any requests until store is rebuilt.
-O options
Set Windows Service Command line options in Registry.
-N No daemon mode.
-R Do not set REUSEADDR on port.
-X Force full debugging.
-Y Only return UDP_HIT or UDP_MISS_NOFETCH during fast reload.
FILES
/etc/squid/squid.conf
The main configuration file. You must initially make changes to this file for squid to work. For example, the default configura-
tion does not allow access from any browser.
/etc/squid/squid.conf.default
Reference copy of the configuration file. Always kept up to date with the version of Squid you are using. Use this to look up con-
figuration syntax after upgrading.
/etc/squid/mime.conf (mime_table)
MIME type mappings for FTP gatewaying
/usr/share/squid/errors/templates (error_directory)
Error page templates
SEE ALSO
cachemgr.cgi(8), pam_auth(8), squid_ldap_auth(8), squid_ldap_group(8), squid_session(8), squid_unix_group(8),
The Squid FAQ
Squid Web Proxy 3.0.STABLE25 squid(8)