Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Help with shell script and sed!

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with shell script and sed!
# 1  
Old 08-24-2010
Help with shell script and sed!
Hi folks, maybe somebody here can help me.

I have 2 files. File A and File B. File A contains URLs leading to files on the Internet, with one URL per line; The format of the URLs on each line in File A is [http/filename].

File B contains only the filenames from each line in File A; One filename per line.

Here is my logic:

If any line in File B = A [http/"filename"] then echo the corresponding line in File A ["http/"filename].

I need to echo the results for each line. I'm assuming sed and some sort of loop would be necessary, but I'm still kind of a noob when it comes to this scripting stuff; sometimes I get it and sometimes I don't. I'll keep working on it in the meantime Smilie Thanks in advance.
# 2  
Old 08-24-2010
Try:
Code:
awk -F"/" 'NR==FNR{a[$0];next}$NF in a' fileB fileA

# 3  
Old 08-24-2010
Quote:
Originally Posted by bartus11
Try:
Code:
awk -F"/" 'NR==FNR{a[$0];next}$NF in a' fileB fileA

Thanks @bartus11. The only problem is that when I forward the output to a new file, the results are exactly the same as File A. I am trying to get the output to be everything that appears before the filenames in File A. Ex. http://blah/blah/blah/etc...
# 4  
Old 08-24-2010
Post exact data (or sample of it) that is in FileA, FileB, and corresponding output file, that you want to produce.
# 5  
Old 08-24-2010
Quote:
Originally Posted by bartus11
Post exact data (or sample of it) that is in FileA, FileB, and corresponding output file, that you want to produce.
File A
Code:
http://lh6.ggpht.com/_0ga0wb33PoQ/S2ulPfVJBTI/AAAAAAAAAYs/1wxZhiPW1mw/BM09_Starlight_-10.jpg
http://lh3.ggpht.com/_WpT8ajiz98w/R7aUf5YVUiI/AAAAAAAAAHA/00XJnAPH7TM/DSC02803.JPG
http://lh4.ggpht.com/_jgRMak8S5Ec/R5M5Zp8WFsI/AAAAAAAACWY/wrYFlk3e72c/Rubix%20Pyramid.JPG
http://lh3.ggpht.com/_WpT8ajiz98w/R7aT35YVUHI/AAAAAAAAADk/opr7BOANg2w/DSC02776.JPG
http://lh6.ggpht.com/_dFjcay6XJ8I/SM8PGL2ytcI/AAAAAAAAFmA/jKMF6wiNyaU/IMG_1367.JPG
http://lh3.ggpht.com/_AMLQDMZjxvk/RvQc2eZhxZI/AAAAAAAABt0/QmXjo-opZqk/DSCF1238.JPG
http://lh5.ggpht.com/_Ehm252Yypl4/S1uM4m374JI/AAAAAAAAKyk/dzsIhkApavc/IMG_5049.JPG
http://lh6.ggpht.com/_dfc1-DMKhn8/SQQTyuwfXLI/AAAAAAAABJs/E5BF5Ype_JU/Rubix%20Cubes%20%26%20Dogs%20010.jpg
http://lh5.ggpht.com/_dfc1-DMKhn8/SQQPXCS4sNI/AAAAAAAABIU/s7c0-tU18jA/Rubix%20Cubes%20%26%20Dogs%20048.jpg
http://lh4.ggpht.com/_tBkR4qZOXa0/Sb8aLUpr-vI/AAAAAAAAAQ8/55tir3tFWQQ/DSC_2723.JPG

File B
Code:
BM09_Starlight_-10.jpg
DSC02803.JPG
Rubix%20Pyramid.JPG
DSC02776.JPG
IMG_1367.JPG
DSCF1238.JPG
IMG_5049.JPG
Rubix%20Cubes%20%26%20Dogs%20010.jpg
Rubix%20Cubes%20%26%20Dogs%20048.jpg
DSC_2723.JPG

Output File (Desired Result)
Code:
http://lh6.ggpht.com/_0ga0wb33PoQ/S2ulPfVJBTI/AAAAAAAAAYs/1wxZhiPW1mw/
http://lh3.ggpht.com/_WpT8ajiz98w/R7aUf5YVUiI/AAAAAAAAAHA/00XJnAPH7TM/
http://lh4.ggpht.com/_jgRMak8S5Ec/R5M5Zp8WFsI/AAAAAAAACWY/wrYFlk3e72c/
http://lh3.ggpht.com/_WpT8ajiz98w/R7aT35YVUHI/AAAAAAAAADk/opr7BOANg2w/
http://lh6.ggpht.com/_dFjcay6XJ8I/SM8PGL2ytcI/AAAAAAAAFmA/jKMF6wiNyaU/
http://lh3.ggpht.com/_AMLQDMZjxvk/RvQc2eZhxZI/AAAAAAAABt0/QmXjo-opZqk/
http://lh5.ggpht.com/_Ehm252Yypl4/S1uM4m374JI/AAAAAAAAKyk/dzsIhkApavc/
http://lh6.ggpht.com/_dfc1-DMKhn8/SQQTyuwfXLI/AAAAAAAABJs/E5BF5Ype_JU/
http://lh5.ggpht.com/_dfc1-DMKhn8/SQQPXCS4sNI/AAAAAAAABIU/s7c0-tU18jA/
http://lh4.ggpht.com/_tBkR4qZOXa0/Sb8aLUpr-vI/AAAAAAAAAQ8/55tir3tFWQQ/

These links aren't static, they change everyday Smilie
Last edited by o0110o; 08-24-2010 at 06:30 PM.. Reason: Shortened up the examples :)
# 6  
Old 08-24-2010
Code:
# cat A
[http/filename1212]
[http/filename12]
[http/filename44]
[http/filename565]

Code:
 
# cat B
filename1
filename3
filename4
filename5
filename2
filename44
filename6

Code:
for i in $(sed "" B)
>  do
>  sed -n "/$i\]$/p" A
>  done
[http/filename44]

# 7  
Old 08-24-2010
I'm still having trouble with this Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need help on shell script (sed)

Hi Guys, I have a xml file as below where I need to find the particular XML tag(<dpath>) and delete the content of it. <?xml version="1.0" encoding="UTF-8"?> <title>XML</title><head>Ram</head><ControlCenter><doStatus>1</doStatus></ControlCenter><exitlabel>Gzip... (7 Replies)
Discussion started by: Vinoth Kumar G
7 Replies

2. Homework & Coursework Questions

Asst: Shell Script to sed

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: Generalize your sub2 script, producing a new script sub3 that will apply a substitution to any number of files... (16 Replies)
Discussion started by: raymondbn
16 Replies

3. Programming

Shell script using sed or awk

Hi, I want to read a file from the command line and remove all the spaces, tabs in it, replacing it with comma(,), and write it to a new file. can you help me out with this scenario. (1 Reply)
Discussion started by: sudhanshu12788
1 Replies

4. Shell Programming and Scripting

SED shell script

Generate a ddl file, we have a flat file which contains many commands like REM, CREATE table, TRuncate etc This script should copy only create table statements to the ddl file. Create stmts can be in a single or multiple lines. ex:- INPUT FILE create table tbl1 (fld1,... (5 Replies)
Discussion started by: learninfo
5 Replies

5. Shell Programming and Scripting

using sed in shell script

Hi, i want to replace sub text which is in the middle of long text. let me be more clear with an example. Here is the actual text in the xml file <module-option name="principalDNSuffix">,cn=Users,dc=X,dc=Y</module-option> Now, in the above text, i want to replace all the content lying... (3 Replies)
Discussion started by: sunrexstar
3 Replies

6. UNIX for Dummies Questions & Answers

Problems in shell script if sed is used

Hi All, Below is the script which i have written in cygwin: #!/usr/bin/sh fname=$1 cat $fname | sed 's/ //g' > fname1 for i in `cat $fname1` do echo $i > file1 #param1 is script name param1=`awk -F , '{print $1}' file1` param1="$param1.sql" #param2 is BL param2=`awk -F , '{print... (5 Replies)
Discussion started by: janardhanamk
5 Replies

7. Shell Programming and Scripting

using sed in shell script

Hi all, I have files with the following names; afgcxa.pem4jan.rain.nc afgcxa.pem4feb.rain.nc afgcxa.pem4mar.rain.nc afgcxa.pem4apr.rain.nc I want to rename them to afgcxa.pem4-01.jan.rain.nc afgcxa.pem4-02.feb.rain.nc afgcxa.pem4-03.mar.rain.nc ... (5 Replies)
Discussion started by: Muhammad Rahiz
5 Replies

8. UNIX for Dummies Questions & Answers

shell script - sed

Hi i have a problem how to put som lines on top or in the bottom of the text with sed. problem is that i am reading from stdin and when i have som lines starting with ++, i have to put some characters on the top of the lines starting with that ++ example of input oooo ++abcd ++befg... (1 Reply)
Discussion started by: Dun
1 Replies

9. Shell Programming and Scripting

shell script by sed

Hey everybody I need some help on how to order the data in file such as a file have first name last name and city and i would like to order them to in the same order by using sed thanks alot for your time (6 Replies)
Discussion started by: halola85
6 Replies

10. Shell Programming and Scripting

Sed command in shell script

I have a current code working(named subst1) having a user be able to type this line to substitute words using the sed command: subst1 old-pattern new-pattern filename Here is my shell script: #!/bin/bash # subst1 ARGS=3 E_BADARGS=65 if then echo "Usage: `basename $0`... (1 Reply)
Discussion started by: Todd88
1 Replies
Login or Register to Ask a Question