Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract certain patterns from file.
Top Forums Shell Programming and Scripting Extract certain patterns from file. Post 302537467 by shoaibjameel123 on Friday 8th of July 2011 09:37:51 AM
Old 07-08-2011
Extract certain patterns from file.
Hi All,

I tried extracting this pattern using grep but it did not work.

What I have is a file which has contents like this:


Code:
file:///channel/add-adhd.html
file:///channel/allergies.html
file:///channel/arthritis.html
http://mail.yahoo.com/
http://messenger.yahoo.com/
http://news.yahoo.com/
http://shine.yahoo.com/
https://twitter.com/YahooHealth
IMG
My Yahoo!
Yahoo! Finance
Yahoo! News
Yahoo! Sports

Now what I want to do is to extract all http, https, and file patterns or lines and get rid of IMG, My Yahoo!, Yahoo! News etc. This means my final output should like this:

Code:
file:///channel/add-adhd.html
file:///channel/allergies.html
file:///channel/arthritis.html
http://mail.yahoo.com/
http://messenger.yahoo.com/
http://news.yahoo.com/
http://shine.yahoo.com/
https://twitter.com/YahooHealth

Doing:

Code:
more file_name | grep http

extracts lines containing "http". But I want to extract all the three patterns by somehow nesting grep. I even tried this:
Code:
more file_name | grep http | grep https | grep file

But it did not work. I am using Linux with Bash.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To extract the string between two patterns

Sample input: Loading File System Networking in nature Closing the System now i need to extract the patterns between the words File and Closing: i.e. sample output: System Networking in Nature Thanks in advance !!!!!!!!!!!!!!!!! (6 Replies)
Discussion started by: aajan
6 Replies

2. Shell Programming and Scripting

Searching patterns in 1 file and deleting all lines with those patterns in 2nd file

Hi Gurus, I have a file say for ex. file1 which has 3500 lines in it which are different account numbers and another file (file2) which has 230000 lines in it. I want to read all the lines in file1 and delete all those lines from file2 which has that same pattern as in file1. I am not quite... (4 Replies)
Discussion started by: toms
4 Replies

3. Shell Programming and Scripting

Extract patterns and copy them in different files

Hi All, I have a file which looks like this: Name1;A01 Name2;A01.047 Name3;A01.047.025 Newname1;B01 NewName2;B01.056.32 NewName3;B04.09.43 NewNewName1;C01.03 NewNewName2;C01.034.44As you can see, in the file there is some name and followed by the name is some identifier. These... (5 Replies)
Discussion started by: shoaibjameel123
5 Replies

4. Shell Programming and Scripting

PERL: extract lines between two patterns

Hello Perl-experts, I am new to perl and need help to solve a problem. I have a table in below format. <Text A> <Pattern1> A Value B Value C Value D Value <Pattern2> <Text B> This table is in file1. I want to extract lines between Pattern1 and Pattern2 and write it into file2.... (11 Replies)
Discussion started by: mnithink
11 Replies

5. Shell Programming and Scripting

Extract line between two patterns

Hi All, I need a script to extract a lines between two patterns.I have done this using grep,cut,tail and head.But its very slow, because my input file contain more than a lakh. COMMAND:XXXXXXXXXXXXXXXXXXXX yyyyy zzzzzz REQUESTSTRING:aaaaaaaaaaaaaaa;11111 222222 333333... (4 Replies)
Discussion started by: rajamohan
4 Replies

6. Shell Programming and Scripting

Need to extract text repetitively between two patterns

Hi All, I want to extract the text between some pattern which occurs repeatedly in a file. For example my input is like, /home/..... ..........java:25: cannot find symbol ............ /home/...... /home/....... I want to display... (2 Replies)
Discussion started by: Vignesh58
2 Replies

7. Shell Programming and Scripting

Extract all the lines in between of 2 patterns and merge them

Hi, I have a file with many lines and need to extract lines between 2 patterns (AAA and BBB) and merge all the in-between lines into single line separated by space. $ cat file1 blah blah blah blah AAA 1 2 3 blah BBB blah blah blah blah blah blah blah blah blah AAA 5 6 blah blah... (4 Replies)
Discussion started by: prvnrk
4 Replies

8. Shell Programming and Scripting

Extract all the sentences that matched two patterns

Hi I have two lists of patterns named A and B consisting of around 200 entries in each and I want to extract all the sentences from a big text file which match atleast one pattern from both A and B. For example, pattern list A consists of : ama ani ahum mari ... ... and pattern... (1 Reply)
Discussion started by: my_Perl
1 Replies

9. Shell Programming and Scripting

Extract lines between patterns

I have a list in the format below, how do I read through the list and extract the lines between the ##START## and ##END##, so i can check for specific values between each ##START## & ##END## pattern ##START## RANDOMTEXT DFGSD SDFSDF ##END## ##START## morestuff sdfggfg sdfsdf... (10 Replies)
Discussion started by: squrcles
10 Replies

10. Shell Programming and Scripting

Bash - Find files excluding file patterns and subfolder patterns

Hello. For a given folder, I want to select any files find $PATH1 -f \( -name "*" but omit any files like pattern name ! -iname "*.jpg" ! -iname "*.xsession*" ..... \) and also omit any subfolder like pattern name -type d \( -name "/etc/gconf/gconf.*" -o -name "*cache*" -o -name "*Cache*" -o... (2 Replies)
Discussion started by: jcdole
2 Replies

LEARN ABOUT HPUX

xmscrollvisible

XmScrollVisible(library call)											     XmScrollVisible(library call)

NAME

       XmScrollVisible -- A ScrolledWindow function that makes an invisible
	descendant of a ScrolledWindow work area visible

SYNOPSIS

       #include <Xm/ScrolledW.h>
       void XmScrollVisible(
       Widget scrollw_widget,
       Widget widget,
       Dimension left_right_margin,
       Dimension top_bottom_margin);

DESCRIPTION

       XmScrollVisible makes an obscured or partially obscured widget or gadget descendant of a ScrolledWindow work area visible. The function re-
       positions the work area and sets the specified margins between the widget and the nearest viewport boundary. The widget's location relative
       to  the	viewport determines whether one or both of the margins must be adjusted. This function requires that the XmNscrollingPolicy of the
       ScrolledWindow widget be set to XmAUTOMATIC.

       scrollw_widget
		 Specifies the ID of the ScrolledWindow widget whose work area window contains an obscured descendant.

       widget	 Specifies the ID of the widget to be made visible.

       left_right_margin
		 Specifies the margin to establish between the left or right edge of the widget and the associated edge  of  the  viewport.   This
		 margin is established only if the widget must be moved horizontally to make it visible.

       top_bottom_margin
		 Specifies  the  margin  to  establish between the top or bottom edge of the widget and the associated edge of the viewport.  This
		 margin is established only if the widget must be moved vertically to make it visible.

       For a complete definition of ScrolledWindow and its associated resources, see XmScrolledWindow(3)

RELATED

       XmScrolledWindow(3).

														     XmScrollVisible(library call)
All times are GMT -4. The time now is 05:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy