Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: filename in the script as input
Top Forums Shell Programming and Scripting filename in the script as input Post 302578056 by Corona688 on Wednesday 30th of November 2011 03:51:18 PM
Old 11-30-2011
That's a useless use of cat, grep and any other command which reads stdin is quite capable of reading a file without it. Just redirect in the shell.

Code:
while read ID
do
        lynx -source "http://domain.com/product.php?e=${ID}" > /tmp/$$.html
        lynx -dump /tmp/$$.html > ${ID}.dat
        grep -A 1 "<title>" < /tmp/$$.html >> "${ID}.dat"
done < listfile

rm -f /tmp/$$.html

This User Gave Thanks to Corona688 For This Post:
Johanni
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

AWK set FILENAME via user input

I am trying to write a awk script that prompts user for input to set the FILENAME varable. I can get it set, but I think awk is not doing anything with it. this is what I have so far #!/usr/bin/nawk -f BEGIN { FILENAME = "" printf "Enter name of file to check in : " ... (2 Replies)
Discussion started by: timj123
2 Replies

2. Shell Programming and Scripting

Need script to take input from file, match on it in file 2 and input data

All, I am trying to figure out a script to run in windows that will allow me to match on First column in file1 to 8th Column in File2 then Insert file1 column2 to file2 column4 then create a new file. File1: 12345 Sam 12346 Bob 12347 Bill File2:... (1 Reply)
Discussion started by: darkoth
1 Replies

3. Shell Programming and Scripting

Filename from splitting files to have the same filename of the original file with counter value

Hi all, I have a list of xml file. I need to split the files to a different files when see the <ko> tag. The list of filename are B20090908.1100-20090908.1200_CDMA=1,NO=2,SITE=3.xml B20090908.1200-20090908.1300_CDMA=1,NO=2,SITE=3.xml B20090908.1300-20090908.1400_CDMA=1,NO=2,SITE=3.xml ... (3 Replies)
Discussion started by: natalie23
3 Replies

4. Shell Programming and Scripting

use input filename as an argument to name output file

I know this is a simple matter, but I'm new to this. I have a shell script that calls a sed script from within it. I want the output of the shell script to be based on the input file I pass as an argument to the original script. In other words... ./script.sh file.txt (script.sh calls sed... (2 Replies)
Discussion started by: estebandido
2 Replies

5. Shell Programming and Scripting

Read input and output redirection filename within a script

Hello everyone, My requirement is that within a script I need to construct the command line exactly that it was invoked with. For example : sh a.sh arg1 arg2 arg3 < input.txt > output.txt Now within a.sh, I construct a file which has these contents " sh a.sh arg1 arg2 arg3 < input.txt >... (8 Replies)
Discussion started by: hedonist12
8 Replies

6. Shell Programming and Scripting

Script to delete files with an input for directories and an input for path/file

Hello, I'm trying to figure out how best to approach this script, and I have very little experience, so I could use all the help I can get. :wall: I regularly need to delete files from many directories. A file with the same name may exist any number of times in different subdirectories.... (3 Replies)
Discussion started by: *ShadowCat*
3 Replies

7. Shell Programming and Scripting

Call a awk script with variable and input filename

HI, MY question is a very simple one: if i want to call an awk script with the input file name and also pass a variable value , then how to do it. #>awk -f my_script.awk -v variable=value my_inputfile.txt I can't do it like this. throws error: awk: my_script.awk:18:... (0 Replies)
Discussion started by: Onkar Banerjee
0 Replies

8. Open Source

Splitting files using awk and reading filename value from input data

I have a process that requires me to read data from huge log files and find the most recent entry on a per-user basis. The number of users may fluctuate wildly month to month, so I can't code for it with names or a set number of variables to capture the data, and the files are large so I don't... (7 Replies)
Discussion started by: rbatte1
7 Replies

9. Shell Programming and Scripting

Use while loop to read file and use ${file} for both filename input into awk and as string to print

I have files named with different prefixes. From each I want to extract the first line containing a specific string, and then print that line along with the prefix. I've tried to do this with a while loop, but instead of printing the prefix I print the first line of the file twice. Files:... (3 Replies)
Discussion started by: pathunkathunk
3 Replies

10. Shell Programming and Scripting

Space in input filename with pipe

Hello, Normally below script works, could you please comment out what could be the reason of failure if there are spaces in input filename: script.sh #!/bin/bash cd /home/hts/.hts/tvh/ file="$1 $2 $3 $4" read -d $'\x04' name < "$file" /usr/bin/ffmpeg -i ""$name"" -vcodec copy -preset... (1 Reply)
Discussion started by: baris35
1 Replies

LEARN ABOUT CENTOS

lwp-download

LWP-DOWNLOAD(1) 					User Contributed Perl Documentation					   LWP-DOWNLOAD(1)

NAME

       lwp-download - Fetch large files from the web

SYNOPSIS

       lwp-download [-a] [-s] <url> [<local path>]

DESCRIPTION

       The lwp-download program will save the file at url to a local file.

       If local path is not specified, then the current directory is assumed.

       If local path is a directory, then the last segment of the path of the url is appended to form a local filename.  If the url path ends with
       slash the name "index" is used.	With the -s option pick up the last segment of the filename from server provided sources like the Content-
       Disposition header or any redirect URLs.  A file extension to match the server reported Content-Type might also be appended.  If a file
       with the produced filename already exists, then lwp-download will prompt before it overwrites and will fail if its standard input is not a
       terminal.  This form of invocation will also fail is no acceptable filename can be derived from the sources mentioned above.

       If local path is not a directory, then it is simply used as the path to save into.  If the file already exists it's overwritten.

       The lwp-download program is implemented using the libwww-perl library.  It is better suited to down load big files than the lwp-request
       program because it does not store the file in memory.  Another benefit is that it will keep you updated about its progress and that you
       don't have much options to worry about.

       Use the "-a" option to save the file in text (ascii) mode.  Might make a difference on dosish systems.

EXAMPLE

       Fetch the newest and greatest perl version:

	$ lwp-download http://www.perl.com/CPAN/src/latest.tar.gz
	Saving to 'latest.tar.gz'...
	11.4 MB received in 8 seconds (1.43 MB/sec)

AUTHOR

       Gisle Aas <gisle@aas.no>

perl v5.16.3							    2012-01-14							   LWP-DOWNLOAD(1)
All times are GMT -4. The time now is 12:00 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy