|
|
Sponsored Content
Top Forums
UNIX for Dummies Questions & Answers
Awk: print all URL addresses between iframe tags without repeating an already printed URL
Post 302602876 by striker4o on Tuesday 28th of February 2012 04:01:11 PM
02-28-2012
Quote:
Code:
find . -name "*php*" -or -name "*htm*" |
xargs awk -F\" -v RS='<' '/^iframe src=/ { if(!X[$2]++) print $2 }'Code:
find . -name "*php*" -or -name "*htm*" | xargs awk -F\" -v RS='<' '/^iframe src=/ {print $2}' | sort -uSorry to be a pain. I started testing things globally, and I cannot get it to work recursively all the way from the root. I get:
awk: read error (Is a directory)
Any suggestions? ;/
---------- Post updated at 11:01 PM ---------- Previous update was at 10:52 PM ----------
I guess it needs to pipe through grep to work properly. Here is what I came up with:
Code:
find . -name "*php*" -or -name "*htm*" |xargs grep -rl iframe |xargs awk -F\" -v RS='<' '/^iframe src=/ {print $2}' | sort -uLast edited by striker4o; 02-28-2012 at 03:49 PM..
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
Hi all,
I need to write a unix script in which need to call a url.
Then need to pass parameters to that url.
please help.
Regards,
gander_ss (1 Reply)
Discussion started by: gander_ss
1 Replies
2. Shell Programming and Scripting
Hi all,
I need to write a unix script in which need to call a url.
Then need to pass parameters to that url.
please help.
Regards,
gander_ss (1 Reply)
Discussion started by: gander_ss
1 Replies
3. UNIX for Dummies Questions & Answers
Hello,
I need to redirect an existing URL, how can i do that?
There's a current web address to a GUI that I have to redirect to another webaddress. Does anyone know how to do this?
This is on Unix boxes Linux.
example:
https://m45.testing.address.net/host.php
make it so the... (3 Replies)
Discussion started by: SkySmart
3 Replies
4. UNIX for Advanced & Expert Users
my output looks like:
<A HREF="http://support.apple.com/kb/HT1629"> </A>
<A HREF="http://support.apple.com/kb/HT1200"> </A>
<A HREF="http://old.nabble.com/AFP-eating-up-CPU-td19976358.html"> </A>
<A HREF="http://jochsner.dyndns.org/scripts/NHR.html"> </A>
<A... (3 Replies)
Discussion started by: glev2005
3 Replies
5. Shell Programming and Scripting
rt
3ks:confused: (6 Replies)
Discussion started by: rainboisterous
6 Replies
6. Shell Programming and Scripting
Hi,
I have following data file;
<outline title="Matt Cutts" type="rss" version="RSS" xmlUrl="http://www.mattcutts.com/blog/feed/" htmlUrl="http://www.mattcutts.com/blog"/>
<outline title="Stone" text="Stone" type="rss" version="RSS" xmlUrl="http://feeds.feedburner.com/STC-Art"... (8 Replies)
Discussion started by: fahdmirza
8 Replies
7. Web Development
I am trying to find a way to test some code, but I need to rewrite a specific URL only from a specific HTTP_HOST
The call goes out to
http://SUB.DOMAIN.COM/showAssignment/7bde10b45efdd7a97629ef2fe01f7303/jsmodule/Nevow.Athena
The ID in the middle is always random due to the cookie.
I... (5 Replies)
Discussion started by: EXT3FSCK
5 Replies
8. UNIX for Dummies Questions & Answers
The challenge:
Decode URL's, i.e. convert %HEX to the corresponding special characters, using only UNIX base utilities, and without having to type out each special character.
I have an anonymous C code snippet where the author assigns each hex digit a number from 0 to 16 and then does some... (2 Replies)
Discussion started by: uiop44
2 Replies
9. Shell Programming and Scripting
I have a XML in which <Amt Ccy="EUR">3.1</Amt> tag repeats. This is under another tag <Main>. I need to sum all the values of <Amt Ccy=""> (Ccy may vary) coming under <Main> using awk and or sed command.
can some help?
Sample looks like below
<root>
<Main>
... (6 Replies)
Discussion started by: bk_12345
6 Replies
10. Shell Programming and Scripting
Hello,
Am very new to perl , please help me here !!
I need help in reading a URL from command line using PERL:: Mechanize and needs all the contents from the URL to get into a file.
below is the script which i have written so far ,
#!/usr/bin/perl
use LWP::UserAgent;
use... (2 Replies)
Discussion started by: scott_cog
2 Replies
LEARN ABOUT OPENSOLARIS
hal-find
hal-find(1M) System Administration Commands hal-find(1M) NAME
hal-find, hal-find-by-capability, hal-find-by-property - search HAL global device list SYNOPSIS
hal-find-by-capability --capability capability [--help] [--verbose] [--version] hal-find-by-property --key key --string value [--help] [--verbose] [--version] DESCRIPTION
The hal-find commands, hal-find-by-capability and hal-find-by-property, search the Hardware Abstraction Layer (HAL) device list by speci- fied criteria and displays results on the standard output. hal-find-by-capability searches by capability, such as volume or block. hal- find-by-property searches by property, such as block.is_volume or volume.disc.has_audio. OPTIONS
The following options are supported: --capability capability HAL device capability to search for. --help Display list of options. --key key The key to the property that is the basis of the search. --string value The string value associated with the property that is the basis of the search. --verbose Verbose mode. --version Display version and exit. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWhalr | +-----------------------------+-----------------------------+ |Interface Stability |Volatile | +-----------------------------+-----------------------------+ SEE ALSO
hald(1M), attributes(5), hal(5) SunOS 5.11 22 Aug 2006 hal-find(1M)