Extracting Multiple Lines from a Text File


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Extracting Multiple Lines from a Text File
# 1  
Old 12-19-2011
Extracting Multiple Lines from a Text File

Hello. I am sorry if this is a common question but through all my searching, I haven't found an answer which matches what I want to do.

I am looking for a sed command that will parse through a large text file and extract lines that start with specific words (which are repeated throughout the file).

Example Text
Line 1: This is example line 1
Line 2: This is example line 2
Line 3: This is example line 3
Line 4: This is example line 4
Line 5: This is example line 5
<blankline>
Line 1: This is example line 1
Line 2: This is example line 2
Line 3: This is example line 3
Line 4: This is example line 4
Line 5: This is example line 5
<blankline>
Line 1: This is example line 1
Line 2: This is example line 2
Line 3: This is example line 3
Line 4: This is example line 4
Line 5: This is example line 5
etc.

Output Needed (in a new text file):
Line 2: This is example line 2
Line 4: This is example line 4
<blankline>
Line 2: This is example line 2
Line 4: This is example line 4
<blankline>
Line 2: This is example line 2
Line 4: This is example line 4
etc.

I tried grep but couldn't get the command to understand the separate lines.

Again, sorry if this is an obvious answer but finding it fails me.
Thanks.
# 2  
Old 12-19-2011
grep solution

Code:
grep -e '^Line 2' -e '^Line 4' -e '^$'  inputfile > newfile

The ^ indicates start of a line '^$' is a blank line with no spaces.

Last edited by jim mcnamara; 12-20-2011 at 09:49 AM..
# 3  
Old 12-20-2011
Thanks Jim. The 'blank line' part hangs the process but getting the two lines is very helpful.

Thank you again.
# 4  
Old 12-20-2011
Hangs? Makes no sense. I am assuming you are "translating" the example script to fit what you think the real data is.

Please show the output of
Code:
od -c inputfilename | head -40

This should show the real characters the file. If you cannot post the data, you can use the output to determine what a blank line really has in it. Note the red stuff in my original post - that was the hang. Gone now.
# 5  
Old 12-20-2011
Thank you again Jim for your support. I noticed the missing "e" in your original post and edited it but that didn't make a difference. :-)

Regarding your second command post, I can't post the output but I can see every new line is "\r\n".

BTW, I am not sure if I was that clear about the blank line aspect, I was hoping the grep command would grab the two lines and then insert a blank line for readability. I am not sure if that was what your suggestion of " -e '^$' " would do but regardless, I am at least getting the two lines which is helpful.

Thank you again for your support. It is appreciated.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove multiple lines from a text file

Hi I have a text file named main.txt with 10,000 lines. I have another file with a list of line numbers (around 1000) of the lines to be deleted from main.txt file. I tried with sed but it removes only a range of line numbers. Thanks for any help!! (1 Reply)
Discussion started by: prvnrk
1 Replies

2. Shell Programming and Scripting

Extracting lines from text files in folder based on the numbers in another file

Hello, I have a file ff.txt that looks as follows *ABNA.txt 356 24 36 112 *AC24.txt 457 458 321 2 ABNA.txt and AC24.txt are the files in the folder named foo1. Based on the numbers in the ff.txt file, I want to extract the lines from the corresponding files in the foo1 folder and... (2 Replies)
Discussion started by: mohamad
2 Replies

3. UNIX for Dummies Questions & Answers

Extracting lines from a text file based on another text file with line numbers

Hi, I am trying to extract lines from a text file given a text file containing line numbers to be extracted from the first file. How do I go about doing this? Thanks! (1 Reply)
Discussion started by: evelibertine
1 Replies

4. UNIX for Dummies Questions & Answers

How to grep multiple lines from a text file using another text file?

I would like to use grep to select multiple lines from a text file using a single-column text file. Basically I want to only select lines from the first text file where the second column of the first text file matches the second text file. How do I go about doing that? Thanks! (5 Replies)
Discussion started by: evelibertine
5 Replies

5. Shell Programming and Scripting

Process multiple lines in a text file

Hi All I have text file like this: a=21ej c=3tiu32 e=hydkehw f=hgdiuw g=jhdkj a=klkjhvl b=dlkjhyfd a=yo c=8732 Any way I can process data from first a to just before of second a, and then second a to just before of 3rd one. Just fetching records like that will help, I mean... (3 Replies)
Discussion started by: sandipjee
3 Replies

6. UNIX for Dummies Questions & Answers

How to generate multiple lines in a text file?

Hello, I want to create a file whose content is multiple lines of strings. The string has the following pattern: aaaa/bbbb/A-B.txt A is a variable ranges from A1 to A2 B is a variable ranges from B1 to B2 Any ideas? Thanks. (17 Replies)
Discussion started by: vic005
17 Replies

7. UNIX for Dummies Questions & Answers

Help please, extract multiple lines from a text file

Hi all, I need to extract lines between the lines 'RD' and 'QA' from a text file (following). there are more that one of such pattern in the file and I need to extract all of them. however, the number of lines between them is varied in the file. Therefore, I can not just use 'grep -A' command.... (6 Replies)
Discussion started by: johnshembb
6 Replies

8. Shell Programming and Scripting

[bash help]Adding multiple lines of text into a specific spot into a text file

I am attempting to insert multiple lines of text into a specific place in a text file based on the lines above or below it. For example, Here is a portion of a zone file. IN NS ns1.domain.tld. IN NS ns2.domain.tld. IN ... (2 Replies)
Discussion started by: cdn_humbucker
2 Replies

9. UNIX for Dummies Questions & Answers

removing multiple lines of text in a file

Hi, I'm trying to remove multiple lines of text based off a series of different words and output it to a new file The document contains a ton of data but i want to delete any line that has the following mx1.rr.biz.com or ns2.ri.biz.com i tried using grep -v filename "mx1.rr.biz.com" >... (3 Replies)
Discussion started by: spartan22
3 Replies

10. Shell Programming and Scripting

extracting unique lines from text file

I have a file with 14million lines and I would like to extract all the unique lines from the file into another text file. For example: Contents of file1 happy sad smile happy funny sad I want to run a command against file one that only returns the unique lines (ie 1 line for happy... (3 Replies)
Discussion started by: soliberus
3 Replies
Login or Register to Ask a Question