Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Two while loops with wget issue
Top Forums Shell Programming and Scripting Two while loops with wget issue Post 303022106 by baris35 on Saturday 25th of August 2018 06:47:01 AM
Old 08-25-2018
Dear Corona,
Single quote gives the same error.
when I wget from command line with url , it gives below file:

Code:
#EXTINF:0,RU: MIR
http://xx.yy.zz/aa/bb/13.ts
#EXTINF:0,RU: PIK
http://xx.yy.zz/aa/bb/21.ts
#EXTINF:0,RU: REN TV
http://xx.yy.zz/aa/bb/18.ts
#EXTINF:0,RU: RUSSIA 24
http://xx.yy.zz/aa/bb/44.ts
#EXTINF:0,RU: AAA
http://xx.yy.zz/aa/bb/55.ts

many thanks
Boris

------ Post updated 08-25-18 at 05:47 AM ------

Hello,
I renamed the file url to url.txt then, sorted out with curl


Code:
#!/bin/bash
for url in $(cat url.txt); do
  curl -A "Mozilla/5.0 (X11; Fedora; Linux x86_64; rv:40.0) Gecko/20100101 Firefox/40.0 referer" "$url" >> downloaded_file

                while read c1
                do
                       $do_something$
                        done < list
done

Kind regards
Boris
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

loops?

hello....very new user to unix...and i have a question..i am not sure if there is such a thing For example...the user is asked if he likes Bananas....if he says yes.... echo You like Bananas $name at the end of the script it echos all that the user has entered so they can read it.... but... (1 Reply)
Discussion started by: jonas27
1 Replies

2. Shell Programming and Scripting

while loops

Hi I've a file like so: Now, I want to read my file and take ex. the Media ID and the Type for each groups of Media (Media1,Media2,...,Media(n): cat /tmp/file|\ while read FILE do while $(FILE|cut -d: -f1)=Media$i do #here will be some test, ex: #if Media ID < 23 ... (4 Replies)
Discussion started by: nymus7
4 Replies

3. Shell Programming and Scripting

Wget issue

Hello there, I'm trying to download a dynamically generated page with Wget, but it downloads the wrong contents. The page link is below(it's a sitemap). I need this to work to set a Cron job that downloads it automatically every hour. ... (1 Reply)
Discussion started by: rlopes
1 Replies

4. UNIX for Dummies Questions & Answers

loops with tr

Hello, I'm not sure if this is more appropriate for the 'unix for dummies' or the 'unix for experts' forum because I'm new to this forum and this is the second topic I've discussed, but if you could let me know which one was more appropriate for something like this, please do! So in tr (an... (2 Replies)
Discussion started by: juliette salexa
2 Replies

5. UNIX for Dummies Questions & Answers

Help with for loops

Hi, I am starting to enhance my scripting knowledge and need some assistance with simple 1 line for loops. This may help to do a mass permissions change on a big apache doc root while I have an insane customer on my phone. What is the best resource to learn this skill and what are some that... (5 Replies)
Discussion started by: Oshie74
5 Replies

6. Shell Programming and Scripting

Too many for loops

My apologies for the long post.... I have a structure problem with my ksh script on linux. right now it does what i want (which i know is the point) but its really really ugly and i know there must be a simpler way to achieve my task. The data is a list of usernames. This list will help... (2 Replies)
Discussion started by: maverick72
2 Replies

7. Shell Programming and Scripting

korn shell for loops with expect issue

Hi I have the following Korn script having multiple for loops. #!/bin/ksh EXPECT=/usr/local/bin/expect exp_internal for d in 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 i22 23 24 25 26; do for i in 01 02 03 04 05 06 07 ; do for h in 00 01 02 03 04 05 06 07 08 09 10 11 12... (2 Replies)
Discussion started by: cic
2 Replies

8. Shell Programming and Scripting

Wget vs Curl - Proxy issue

Hi, My script needs to crawl the data from a third party site. Currently it is written in wget. The third party site is of shared interface with different IP addresses. My wget works with all the IP address but not with one. Whereas the curl is able to hit that IP address and comes out... (2 Replies)
Discussion started by: sathyaonnuix
2 Replies

9. Homework & Coursework Questions

If and Loops

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: In this script you will take a directory as input from the user and change the end of line sequence from a Unix... (1 Reply)
Discussion started by: Pcarson
1 Replies

10. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

LEARN ABOUT V7

firefox

FIREFOX(1)							Linux User's Manual							FIREFOX(1)

NAME

       firefox - a Web browser for X11 derived from the Mozilla browser

SYNOPSIS

       firefox [OPTIONS] [URL]

DESCRIPTION

       Mozilla Firefox is an open-source web browser, designed for standards compliance, performance and portability.

USAGE

       firefox is a simple shell script that will set up the environment for the actual executable.

OPTIONS

       A summary of the options supported by firefox is included below.

   GTK options
       --gdk-debug=FLAGS Gdk debugging flags to set

       --gdk-no-debug=FLAGS
	      Gdk debugging flags to unset

       --gtk-debug=FLAGS
	      Gtk+ debugging flags to set

       --gtk-no-debug=FLAGS
	      Gtk+ debugging flags to unset

       --gtk-module=MODULE
	      Load an additional Gtk module

   X11 options
       --display=DISPLAY
	      X display to use

       --sync Make X calls synchronous

       --no-xshm
	      Don't use X shared memory extension

       --xim-preedit=STYLE

       --xim-status=STYLE

       --g-fatal-warnings
	      Make all warnings fatal

   Firefox options
       -h, -help
	      Show summary of options.

       -height value
	      Set height of startup window to value.

       -width value
	      Set width of startup window to value.

       -v, -version
	      Print /usr/bin/firefox-bin version.

       -CreateProfile profile
	      Create profile.

       -P profile
	      Start with profile.

       -ProfileManager
	      Start with profile manager.

       -UILocale lang-region
	      Start with lang-region resources.

       -contentLocale lang-region
	      Start with lang-region resources.

       -remote command
	      Execute command in an already running Firefox process.  For more info, see: http://www.mozilla.org/unix/remote.html

       -no-remote
	      Don't try to control an already running instance.

       -jsconsole
	      Start with Javascript Console

       -chrome url
	      Load the specified chrome.

       -new-window url
	      Open URL in a new window if Firefox is already running.

       -new-tab url
	      Open URL in a new tab if Firefox is already running.

       -preferences
	      Open Firefox preferences menu.

       -safe-mode
	      Disables extensions and themes for this session.

       FILES  /usr/bin/firefox - shell script wrapping firefox
	      /usr/lib/firefox/firefox - firefox executable

VERSION

       3.0

BUGS

       To report a bug, please visit http://bugzilla.mozilla.org/

SEE ALSO

       mozilla(1)

AUTHORS

       The Mozilla Organization
	      http://www.mozilla.org/about.html

firefox 							 January 04, 2006							FIREFOX(1)
All times are GMT -4. The time now is 01:26 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy