How to Split File to 2 depending on condition?

Login or Register to Ask a Question and Join Our Community

How to Split File to 2 depending on condition?

Tags

Login to Discuss or Reply to this Discussion in Our Community

Top Forums Shell Programming and Scripting How to Split File to 2 depending on condition?

09-25-2013

Registered User

20, 0

Join Date: Jun 2013

Last Activity: 28 September 2013, 7:10 AM EDT

Posts: 20

Thanks Given: 10

Thanked 0 Times in 0 Posts

How to Split File to 2 depending on condition?

Hi ,

cat myfile.txt

Code:

! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.30.33 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.22.11 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.2.50 ! 3100.2.22.11 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.30.33 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.20.11 ! 
! 3100.2.0.5 ! 3100.2.11.1 ! 3100.2.60.07 ! 3100.2.4.1 !

i need to split this file to 2 file , the first contains all the lines with occurrence the 3100.2.22.4 and absecne of 3100.2.22.11

and the second file contains all other lines , the result should be like below ,

myfile1

Code:

! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.30.33 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.30.33 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.20.11 !

myfile2

Code:

! 3100.2.0.5 ! 3100.2.22.4 ! 3100.2.22.11 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.2.50 ! 3100.2.22.11 ! 3100.2.4.1 !
! 3100.2.0.5 ! 3100.2.11.1 ! 3100.2.60.07 ! 3100.2.4.1 !

can you help me with this please

Last edited by OTNA; 09-25-2013 at 05:19 PM..

OTNA

View Public Profile for OTNA

Find all posts by OTNA

09-25-2013

Registered User

2,524, 241

Join Date: Dec 2007

Last Activity: 17 March 2020, 2:04 PM EDT

Posts: 2,524

Thanks Given: 173

Thanked 241 Times in 206 Posts

Just thinking...
what if you number all lines (cat -n)
then do you grep command
pull out all those line numbers into file_exclude
cut to remove the file numbers
use a grep with the contents of file_exclude

(Sorry could not go into more; got to go. But thought this might spur thought)

joeyg

View Public Profile for joeyg

Find all posts by joeyg

09-25-2013

Registered User

20, 0

Join Date: Jun 2013

Last Activity: 28 September 2013, 7:10 AM EDT

Posts: 20

Thanks Given: 10

Thanked 0 Times in 0 Posts

really i have alot of those files every seconds , i'm looking for maybe awk command to solve this quickly without genrating alot of temp files ,

OTNA

View Public Profile for OTNA

Find all posts by OTNA

09-25-2013

Registered User

15,129, 5,008

Join Date: Jul 2012

Last Activity: 4 May 2020, 4:31 PM EDT

Location: Aachen, Germany

Posts: 15,129

Thanks Given: 735

Thanked 5,008 Times in 4,483 Posts

How about applying the things you learned earlier?

RudiC

View Public Profile for RudiC

Find all posts by RudiC

09-25-2013

Registered User

20, 0

Join Date: Jun 2013

Last Activity: 28 September 2013, 7:10 AM EDT

Posts: 20

Thanks Given: 10

Thanked 0 Times in 0 Posts

Hi Rudic , really i tried to do it like before but i dont know how to use match to get not matching values as one Condition ( when match 3100.2.22.4 and not match 3100.2.30.33 in the same line ) , i will be thankful again if you changed the condition to fit this

OTNA

View Public Profile for OTNA

Find all posts by OTNA

09-25-2013

Registered User

15,129, 5,008

Join Date: Jul 2012

Last Activity: 4 May 2020, 4:31 PM EDT

Location: Aachen, Germany

Posts: 15,129

Thanks Given: 735

Thanked 5,008 Times in 4,483 Posts

man awk might help. However. try

Code:

awk     '/3100.2.22.4/ && !/3100.2.22.11/       {print > "myfile1"; next}    
                                                {print > "myfile2"}    
        ' file

This User Gave Thanks to RudiC For This Post:

RudiC

View Public Profile for RudiC

Find all posts by RudiC

09-25-2013

Registered User

20, 0

Join Date: Jun 2013

Last Activity: 28 September 2013, 7:10 AM EDT

Posts: 20

Thanks Given: 10

Thanked 0 Times in 0 Posts

Thanks "MAN" again

OTNA

View Public Profile for OTNA

Find all posts by OTNA

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

How to split a large file with the first 100 lines of each condition?

I have a huge file with the following input: Case1 Specific_Info Specific_Info Case1 Specific_Info Specific_Info Case3 Specific_Info Specific_Info Case4 Specific_Info Specific_Info Case1 Specific_Info Specific_Info Case2 Specific_Info Specific_Info Case2 Specific_Info Specific_Info...

2. Shell Programming and Scripting

Split a non delimited file into columns depending on user input

I would like some advice on some code. I want to write a small script that will take an input file of this format 111222233334444555666661112222AAAA 2222333445556612323244455445454545 2334556345643534505435345353453453 (and so on) It will be called as : script inputfile X (where X is...

3. Shell Programming and Scripting

Split file depending on Column Value

Hi , my file look likes below , cat file.csv 12/09/2014,50,5,0,300 12/09/2014, ,5,0,300 12/09/2014,50,,,300 i need to split file , the first one contains values (2nd column is 50 , 3rd and fourth column is null ) the second file contains all others firstfile ...

4. Shell Programming and Scripting

How to split a data file into separate files with the file names depending upon a column's value?

Hi, I have a data file xyz.dat similar to the one given below, 2345|98|809||x|969|0 2345|98|809||y|0|537 2345|97|809||x|544|0 2345|97|809||y|0|651 9685|98|809||x|321|0 9685|98|809||y|0|357 9685|98|709||x|687|0 9685|98|709||y|0|234 2315|98|809||x|564|0 2315|98|809||y|0|537...

5. Shell Programming and Scripting

How to reject row from one file to another depending upon some condition

Hi I have a input file say abc.dat which contains data as below name~address~email~ID john~newyork~john@gmail.com~1500D steve~sydney~steve@abc.com~3451E Now if length of name is > 50 or ID is null then the row should rejected to another file say reject.dat along with reason for rejection...

6. Shell Programming and Scripting

split file with condition

$ cat file H1:12:90 k:12:b n:22:i k:54:b k:42:b s:48:s a:41:b t:18:n c:77:a I am trying to split above file based on $2 such that if $2 is rounded to nearest 10's multiple (e.g. 10,20,30 etc), each sub file should contain 3 multiples and so on (also I want to keep header i.e. NR==1, in...

7. Shell Programming and Scripting

Split file into multiple files depending upon first 4 digits

Hi All, I have a file like below: 1016D"ddd","343","1299" 1016D"ddd","3564","1299" 1016D"ddd","3297","1393" 1016D"ddd","32989","1527" 1016D"ddd","346498","1652" 2312D"ddd","3269","1652" 2312D"ddd","328","1652" 2312D"ddd","2224","2100" 3444D"ddd","252","2100" 3444D"ddd","2619","2100"...

8. Shell Programming and Scripting

How to split the String based on condition?

hi , I have a String str="/opt/ibm/lotus/ibw/latest" or ="/opt/lotus/ibw/latest" this value is dynamic..I want to split this string into 2 strings 1. /opt/ibm/lotus(/opt/lotus) this string must ends with "lotus" 2./ibw/latest can any body help me on this? Regards, sankar

9. Shell Programming and Scripting

split file depending on content

Hi, I have a file which contains records of data. I need to split the file into multiple files depending upon the value of last field. How do i read the last field of each record in the file??? Regards, Chaitrali

10. Shell Programming and Scripting

awk script to split a file based on the condition

I have the file with the records like 4234234 US phone 3244234 US cup 2342342 CA phone 8947234 US phone 2389472 CA cup 2348972 US maps 3894234 CA phone I want the records with (US,phone) as record to be in one file, (Us, cup) in another file and (CA,cup) to be in another I mean all...

Login or Register to Ask a Question