Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Spliting log file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Spliting log file
# 1  
Old 08-13-2010
Bug Spliting log file
Hello,

I want to split or cut a large size log file by year wise(eg 2009, 2010) .But the source file must not have the splited or cut lines after this process ,all of them must move to the destination folder.Does grep command have the fuctionality like cut and paste? I used grep -Ev command but the sourse file have the greped lines.

Thanks in advance Smilie
# 2  
Old 08-13-2010
Can you post some lines of your logfile?
# 3  
Old 08-13-2010
ok this is the sample lines of log file
Code:
cat file1
204.152.200.42 - - [11/Marl/2009:00:00:02 -0400] "GET /search-results.html
204.152.200.41 - - [13/Dec/2009:00:00:02 -0400] "GET /search-results.html
204.152.200.40 - - [13/Jul/2010:00:00:02 -0400] "GET /search-results.html

expected output files
Code:
cat file1
204.152.200.40 - - [13/Jul/2010:00:00:02 -0400] "GET /search-results.html

Code:
cat outputfile
204.152.200.42 - - [11/Marl/2009:00:00:02 -0400] "GET /search-results.html
204.152.200.41 - - [13/Dec/2009:00:00:02 -0400] "GET /search-results.html

thanks
Last edited by Franklin52; 08-13-2010 at 11:39 AM.. Reason: Please use code tags
# 4  
Old 08-13-2010
With this command you get the outputfiles as file_2009, file_2010 etc:
Code:
awk -F"[/:]" '{print > "file_" $3}' file1

# 5  
Old 08-13-2010
thanks Franklin52 , what i need is to cut from the source file and paste to destination and the line is choose by grepping special words (eg:2009) .
# 6  
Old 08-13-2010
Quote:
Originally Posted by jobycxa
thanks Franklin52 , what i need is to cut from the source file and paste to destination and the line is choose by grepping special words (eg:2009) .
Do you want to extract records from only a certain year?
# 7  
Old 08-13-2010
i have multiple year records to extract to different file names and source file must not contain the extracted lines .
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Requirement of Spliting a text file in UNIX Programing

Hi, There is a requirement, needs to split the text file based on RC code present in text file. For this, needs to write a unix shell programing script for the above requirement. For example in text file, if there are distinct RC codes, then we needs to split into multiple text files. In... (1 Reply)
Discussion started by: Chandra2678
1 Replies

2. Shell Programming and Scripting

Spliting file based field pattern

Hi all, i have file that looks like as below 2263881188,24570896,439,SOLO,SOLO_UNBEATABLE,E,+3.13,+0.00 2263881964,24339077,439,SOLO,SOLO_UNBEATABLE,F,-0.67,+0.00 2263883220,22619162,228,Bell,Bell_MONTHLY,E,-2.04,+0.00 2263883220,22619162,228,Bell,Bell_MONTHLY,F,-2.04,+0.00... (3 Replies)
Discussion started by: raghavendra.cse
3 Replies

3. Shell Programming and Scripting

spliting up a large file

Dear All, I have a very large file which which i would like split into indvidual frames evrytime the line ends with "ENDMDL" and then name frame1.pdb frame2.pdb etc can any one give me a few sugeestions? ideally i would like to have ENDMDL at the end of each frame or not pressent at all. an... (4 Replies)
Discussion started by: Mish_99
4 Replies

4. Shell Programming and Scripting

File Spliting problem

I have a very big log file which looks like this: I need to split this file and create files with "+=+=+=+=+=+=+=+=+=+=+=+=+=+=+=+=+=+" as the delimiter. The file names need to be the contents of the next line after the delimiter(FIRST_ITEM,SECOND_ITEM...so on..). (7 Replies)
Discussion started by: engineer
7 Replies

5. UNIX for Dummies Questions & Answers

spliting a file

how would i split the file "file1" into smaller files containg lines of 15 (1 Reply)
Discussion started by: JamieMurry
1 Replies

6. Shell Programming and Scripting

Spliting a file and renaming it's out put

Hi friends, I am new to unix. With the help of this site I wrote a script. But it's returning some errors pls help.:confused: Here is my specifications: I have a file obsrec_31583_090212.xls at /home/lingalma/temp/cdl I want it to mv to another temp folder called /home/lingalma/temp/obsrec... (6 Replies)
Discussion started by: raaj.manoj
6 Replies

7. UNIX for Dummies Questions & Answers

Caching while spliting a large file

Hi The scenario is like this. I need to split 5 files having size 3GB, 2GB, 4GB, 30GB and 20 GB respectively. The machine has 15GB heap space. Before starting split proces it was showing 15gb free space. Once the split process completed it showed 100 mb free and around 12GB cached. My... (3 Replies)
Discussion started by: siba.s.nayak
3 Replies

8. Shell Programming and Scripting

Spliting the file dynamically

i am creating the file , when this file reaches the size 2 GB, i need one message or fire (4 Replies)
Discussion started by: kingganesh04
4 Replies

9. Shell Programming and Scripting

Spliting file based on condition

Hi, I have a comma separated file with millions of records in it. I have a requirement to split the file based on the value in a one of the columns. Suppose i have a text file with columns like C1, C2,C3,C4 Column C4 can hold the values either 01 or 02 03 or 04. I nned to extract... (2 Replies)
Discussion started by: Raamc
2 Replies

10. UNIX for Dummies Questions & Answers

spliting up a huge file

I have a file {filename} which contains 65000 records I need to split into 6 smaller files roughly 11000 records each. Can someone advise me of the Unix command to do so ? Many thanks (2 Replies)
Discussion started by: grinder182533
2 Replies
Login or Register to Ask a Question