Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Splitting log files
Top Forums UNIX for Dummies Questions & Answers Splitting log files Post 302968357 by bakunin on Tuesday 8th of March 2016 04:09:08 PM
Old 03-08-2016
To split the file it may help to observe that "weekly" means the part of the file from a certain day of week the next (same) day of week. Say, everything from with a "Fri" to the next "Fri". Similarly "monthes"" mean the parts of the file where the month part in the date lines: --- Day changed Fri Mar 04 2016 stays the same.

Here is some sample solution in KornShell doing the weekly split from Friday to Friday, you can do the same in awk, perl or any other text processing language with equal ease:

Code:
(( i = 1 ))
while read line ; do
     if print - "$line" | grep -q '^--- Day changed Fri' ; then
          outfile=out$(( i++ ))
     fi
     print - "$line" >> "$outfile"
done < /path/to/your/logfile

I hope this helps.

bakunin
This User Gave Thanks to bakunin For This Post:
Stacked
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

splitting the files

Hi, I'am using HP-UX.I have a input file which has 102 drop statements in it.I'am using csplit to split the files.The upper limit is 99 only.I'am using the -n 102 option.It says "suffix size not vaild".Any suggestions how to do it using csplit? Thanx in advance, sounder. (1 Reply)
Discussion started by: sounder123
1 Replies

2. UNIX for Advanced & Expert Users

splitting the files

Hi, How can i split the big file by the lines?. For eg. I wanna split the file from the line 140 to 1700. (9 Replies)
Discussion started by: sharif
9 Replies

3. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50... (3 Replies)
Discussion started by: arund_01
3 Replies

4. UNIX for Dummies Questions & Answers

splitting the files

Hi, I have some files with 2 million odd records which i need to split into chunks of 0.5 millions. I have the file sorted with a key column in order. The same key value can appear as 4 or 5 records in the file. Hence after splitting we are checking whether all the key values are present in the... (5 Replies)
Discussion started by: dnat
5 Replies

5. Shell Programming and Scripting

Splitting files from one file

Hi, I have an input file like: 111 abcdefgh asdfghjk dfghjkl 222 aaaaaaa bbbbbb 333 djfhfgjktitjhgfkg 444 djdhfjkhfjkghjkfg hsbfjksdbhjkgherjklg fjkhfjklsahjgh fkrjkgnj I want to read this input file and make separate output files with the header as numric value like "111"... (9 Replies)
Discussion started by: saltysumi
9 Replies

6. Shell Programming and Scripting

Splitting file into 2 files ?

Hi extending to one of my previous posted query .... I am using nawk -v invar1="$aa" '{print > ("ABS\_"((/\|/)?"A\_":"B\_")invar1"\_NETWORKID.txt")}' spfile.txt to get 2 different files based on split condition i.e. "|" Similar to invar1 variable in nawk I also need one more variable... (18 Replies)
Discussion started by: shekharjchandra
18 Replies

7. UNIX for Dummies Questions & Answers

Splitting Files Help

Hi Gurus, Lets say i have a file with some 30 records... How can i split that file into 3 files Also it shud be dynamic in the sense.. I wouldnt mind if file 1 has 15, file 2 has 10 and file 3 has 5.... Please help.. Thanks (6 Replies)
Discussion started by: saggiboy10
6 Replies

8. Shell Programming and Scripting

Splitting files

Hello all I have a file which has around 80 million records, I want to split it to 12 equal files, I tried using the split command but it is allowing me to split according to number of lines or by size. Is there a way i can split the file into 12 files without worrying about the number of lines... (7 Replies)
Discussion started by: Sri3001
7 Replies

9. Shell Programming and Scripting

Splitting files into 100 files with field value

I want a script to split my file upon the last field (15) As file A,b,c,.......,01 C,v,n,.......,02 C,r,v,........,01 F,s,a,........,03 X,y,d,........,99 To make output 01.txt A,b,c,.......,01 C,r,v,........,01 02.txt C,v,n,.......,02 (12 Replies)
Discussion started by: teefa
12 Replies

10. UNIX for Beginners Questions & Answers

Automate splitting of files , scp files as each split completes and combine files on target server

i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies

LEARN ABOUT DEBIAN

mhc

mhc(5)								File Formats Manual							    mhc(5)

NAME

       mhc - Message Harmonized Calendaring system

DESCRIPTION

       This  manual  page  documents  briefly the mhc file format.  This manual page was written for the Debian GNU/Linux distribution because the
       original program does not have a manual page.

FIELDS

       Mhc file format is based on STD11/RFC822: Standard for the format of ARPA Internet text messages.  In mhc file, the following extra  header
       fields are used.

       X-SC-Day:
	      Date of event in format yyyymmdd.  You can specify multiple date with space separated like:

		 X-SC-Day: 19990409 19990413

	      which means April 9th 1999 and April 13th 1999.

       X-SC-Time:
	      Time of event in format hh:mm-hh:mm or hh:mm.  For event which has no meanings about time, you can leave it empty in this field.

       X-SC-Duration:
	      Period  of event in yyyymmdd-yyyymmdd.  You can omit start date or end date, like "19991121-".  X-SC-Duration: is used only to limit
	      date specified by X-SC-Day: or X-SC-Cond, so you can't describe event date only by X-SC-Duration:.  If X-SC-Duration: is	empty,	it
	      means no limit.

       X-SC-Cond:
	      Condition of event date by using following keyword.

		 00-31 Day of month.

		 1st 2nd 3rd 4th 5th Last Week in month.

		 Sun Mon ... Sat Day of week.

		 Jan Feb ... Dec Month

	      Examples,

		 X-SC-Cond: Tue Fri
			Every Tuesday and Friday.

		 X-SC-Cond: 31 Aug
			Every August 31th.

		 X-SC-Cond: 1st 3rd Fri
			Every 1st and 3rd Friday.

		 X-SC-Cond: Fri
		 X-SC-Day: !19990409
			Every Friday, but except April 9th 1999.

		 X-SC-Cond: Fri 13
			Every 13th and Every Friday, not 13th Friday.

       X-SC-Alarm:
	      Hint  for alarm of event.  Currently, mhc.el doesn't alaram, but gemcal will pop-up alarm window.  It will be useful if you transfer
	      this event to PalmOS.  In X-SC-Alarm:, you can specify the number (1 to 99) with suffix such as minute, hour or day.  For example,

		 X-SC-Alarm: 10 minutes
			Alarm 10 minutes before event.

		 X-SC-Alarm: 3 hour
			Alarm 3 hours before event.

		 X-SC-Alarm: 3 day
			Alarm 3 day before event.

       X-SC-Subject:
	      Subject of event. unstructured?

       X-SC-Location:
	      Location of event. unstructured?

       X-SC-Category
	      Category of event.  Any keyword, space separeated.  Case ignored.

       X-SC-Recoard-Id:
	      Internal use only.

SEE ALSO

       adb2mhc(1) gemcal(1), mhc-sync(1), mhc2palm(1), palm2mhc(1), today(1).

AUTHOR

       This program was written by Yoshinari Nomura <nom@quickhack.net> and this manual page was written by  Fumitoshi	UKAI  <ukai@debian.or.jp>,
       for the Debian GNU/Linux system (but may be used by others).

								    23 Jun 2000 							    mhc(5)
All times are GMT -4. The time now is 10:08 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy