Facing difficulty scraping website with curl Post: 303037942

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Reverse Proxy difficulty

Hi I am trying to set up two hosts in a reverse proxy. The reverse proxy already has 8 servers running perfectly, but they are all simply mapping pure addresses, which I have registered internally and externally. The latest two I wish to add are a bit different, they are app servers, one...

2. Shell Programming and Scripting

Perl Difficulty

Hi, I am trying to upload a file to a SQL database table. The column type is IMAGE. I am looking for a solution to upload a word doc file. I tried 3 approaches. 1) my $fileToStore = "mytest.doc"; open IPFILE, "<", $name; binmode IPFILE; while (<IPFILE>) { $fileToStore .= $_; } close...

3. Shell Programming and Scripting

Loop difficulty

hi all I am new to unix and want to create a loop to repeat the loop and before that it ask me to do so.I know "while" may help but I put it in my work and getting stuk with it.any help appreciated.

4. UNIX and Linux Applications

Unable to connect to a website using Curl

Hello, I am using Curl command to make a function call to a web service. The issue I am facing right now is: curl h**p://www.google.com with the above command, I get a XML file as a response. Also when i execute : wget h**p://www.google.com Replace ** : tt I can see status as...

5. Shell Programming and Scripting

difficulty with awk

hello folks, i am stuck with this awk command. i need to calculate the sum of a column of values on a flatfile and i am using the following command : awk -F"|" '{x += $10} END {print "Sum: "x}' standard_csv_file1.out that flatfile contains 180 fields and i am getting the...

6. UNIX for Dummies Questions & Answers

Difficulty with set - command

Hi , i have a shell script with the first two lines as #! /bin/ksh set -x when i try opening the file from unix using the command 'sh filename.sh' , i am getting the below error : invalid optionline 2: set: - Pls help Use code tags for you code and data...

7. Shell Programming and Scripting

Scraping line - Using awk or sed

Hello, Can somone help with this command please? I have this output pattern in a file. I use a simple awk command to print each field separated by comma. For example I use this to get the first awk -F, "{ print $1 }" "ABC=abcdefg,CDF=mnqrst,GGG=hrvyess" issue: What I...

8. Programming

Python Web Page Scraping Urls Creating A Dictionary

I have thrown in the towel and cant figure out how to do this. I have a directory of html files that contain urls that I need to scrape (loop through) and add into a dictionary. An example of the output I would like is: bigbadwolf.htlm: https://www.blah.com, http://www.blahblah.com,...

LEARN ABOUT FREEBSD

klist

KLIST(1)						    BSD General Commands Manual 						  KLIST(1)

NAME

     klist -- list Kerberos credentials

SYNOPSIS

     klist [-c cache | --cache=cache] [-s | -t | --test] [-T | --tokens] [-5 | --v5] [-v | --verbose] [-l | --list-caches] [-f] [--version]
	   [--help]

DESCRIPTION

     klist reads and displays the current tickets in the credential cache (also known as the ticket file).

     Options supported:

     -c cache, --cache=cache
	     credential cache to list

     -s, -t, --test
	     Test for there being an active and valid TGT for the local realm of the user in the credential cache.

     -T, --tokens
	     display AFS tokens

     -5, --v5
	     display v5 cred cache (this is the default)

     -f      Include ticket flags in short form, each character stands for a specific flag, as follows:
		   F	forwardable
		   f	forwarded
		   P	proxiable
		   p	proxied
		   D	postdate-able
		   d	postdated
		   R	renewable
		   I	initial
		   i	invalid
		   A	pre-authenticated
		   H	hardware authenticated

	     This information is also output with the --verbose option, but in a more verbose way.

     -v, --verbose
	     Verbose output. Include all possible information:

		   Server
			 the principal the ticket is for

		   Ticket etype
			 the encryption type used in the ticket, followed by the key version of the ticket, if it is available

		   Session key
			 the encryption type of the session key, if it's different from the encryption type of the ticket

		   Auth time
			 the time the authentication exchange took place

		   Start time
			 the time that this ticket is valid from (only printed if it's different from the auth time)

		   End time
			 when the ticket expires, if it has already expired this is also noted

		   Renew till
			 the maximum possible end time of any ticket derived from this one

		   Ticket flags
			 the flags set on the ticket

		   Addresses
			 the set of addresses from which this ticket is valid

     -l, --list-caches
	     List the credential caches for the current users, not all cache types supports listing multiple caches.

SEE ALSO

     kdestroy(1), kinit(1)

HEIMDAL 
							  October 6, 2005							   HEIMDAL