Visit The New, Modern Unix Linux Community


Access a complete flow with CURL + bash shell


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Access a complete flow with CURL + bash shell
# 1  
Access a complete flow with CURL + bash shell

Hello Experts ,

I have an use case which needed your help . I have been using google for 2 days buy couldn`t succed , i believe i can get the help here.

Here is my use case to run on bash shell

1. Access an URL -- in script , it will be mentioned as inputURL
2. Once i accessed the URL on step 1 , it will be redirected to a login page - in script it will be called as LoginPageURL
3. I will key in the creds with below syntax of curl - creds.txt has credentails saved
Code:
hitlogipage = curl --url $LoginPageURL  -K- <<< "--user $mydir/creds.txt"

4. Once i accessed internally , it will get redirect to an .fcc page and then to URL2 .
5. While it redirect to URL2 , it will have some cookie details in headers , which i need to capture and display-- It will be awked and saved on a variable called SessionCookie.

Code:
curl -I $hitloginpage

Can some one provide me some help ?

i couldn`t achieve step 4 and 5 .
and on step 3 , i keep getting "curl: (3) <url> malformed" . But when i give same with what is inside LoginPageURL , i am successfully redirecting to step 4.
# 2  
Stupid question, but could you use the -c/--cookie-jar switch to save the cookies into a file?

Andrew
# 3  
@andrew, I never worked on Java.. If you can give me a highlight I can Google and understand myself how I can take further...
# 4  
java? I thought you were using bash.

Curl has an option, -c in its short form, --cookie-jar in its long form, to save cookies:
Code:
curl --cookie-jar my-cookies http://some.url.com

Can you not use that to save the cookies, and read the file for the cookies you are interested in?

The curl man page can be found here.

Andrew
# 5  
Quote:
Originally Posted by apmcd47
java? I thought you were using bash.

Curl has an option, -c in its short form, --cookie-jar in its long form, to save cookies:
Code:
curl --cookie-jar my-cookies http://some.url.com

Can you not use that to save the cookies, and read the file for the cookies you are interested in?

The curl man page can be found here.

Andrew
I meant shell, by seeing jar thought your were referring to Java. Never mind..

I Gonna try this and keep you posted with result. But with your explanation seems it will work..

Do you have any suggestion on the url error I am getting when adding the url into a text file and using with - url option?
# 6  
If your URL is in a file named inputURL, and you want the result stored in file pageText. You should use:

Code:
curl --cookie-jar my-cookies --url $(< inputURL) > pageText


Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #22
Difficulty: Easy
RAM is considered volatile memory in a computer system.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Access a complete flow with CURL + bash shell

Hello Experts , I have an use case which needed your help . I have been using google for 2 days buy couldn`t succed , i believe i can get the help here. Here is my use case to run on bash shell 1. Access an URL -- in script , it will be mentioned as inputURL 2. Once i accessed the URL... (1 Reply)
Discussion started by: radha254
1 Replies

2. Shell Programming and Scripting

Using curl in bash script

Hello. I have pick up a script from internet to track errors from curl command. #!/bin/bash # URL_TO_TEST="http://www.xxxxxx.yyy" MY_VAR=curl_init("$URL_TO_TEST") ; curl_setopt($MY_VAR, CURLOPT_HEADER, 1); curl_setopt($MY_VAR, CURLOPT_RETURNTRANSFER, 1); curl_setopt($MY_VAR,... (2 Replies)
Discussion started by: jcdole
2 Replies

3. Shell Programming and Scripting

Curl won't complete in a script but does from prompt. Idea?

On RHEL5 from within both a shell (sh->bash) and a csh script curl fails with a "curl: (6) Couldn't resolve host 'application'" error. This is the result whether run as a command at the shell and/or c-shell prompt and curl also fails with the same error when the scripts are "source'd" at the... (5 Replies)
Discussion started by: GSalisbury
5 Replies

4. Red Hat

Bash: menu-complete and reverse

Hi, In the archives I found this: And this works fine. $if mode=vi "\C-0-": digit-argument TAB: menu-complete "\e But what I want is to reverse this. So I want that tab does reverse menu completion and shift tab does normal menu completion. Can anyone help me with this? Thanks (0 Replies)
Discussion started by: ozkanb
0 Replies

5. Shell Programming and Scripting

Help with control flow in a Bash script

In my bash script I want to say "if argument 2 is anything except x, y or z, than echo this" (x y and z being words). So my script looks like this: if ] then echo "unrecognized input: $2" fi This usually works but than I also want to say "if argument 2 IS x, y, or z, but argument 4 is... (4 Replies)
Discussion started by: Jrodicon
4 Replies

6. Shell Programming and Scripting

Help with make sure shell script execute instruction in flow

Hi, I want to write a shell script to make sure all the instruction is executive in flow. eg. I want my shell script to run finish this two progress first: ./program input_file_1.txt > input_file_1.txt.out & ./program input_file_2.txt > input_file_2.txt.out & After then, only run the... (1 Reply)
Discussion started by: edge_diners
1 Replies

7. Shell Programming and Scripting

Using Curl to Access PayPal

can anyone please help me with this? i know paypal is a secure site, so a code like the below would be needed. but that's where i get stuck. curl -s -K https://www.paypal.com I need to be able to curl to paypal and download a list of latest purchases. i know there HAS to be a way to do... (0 Replies)
Discussion started by: SkySmart
0 Replies

8. Shell Programming and Scripting

bash curl escape & in url

I'm running a curl command in bash, but the & in the middle causes the second half of the line to run in the background, here's what I'm trying to do: lat="37.451" lon="-122.18" url="http://ws.geonames.org/findNearestAddress?lat=$lat&lng=$lon" curl -s "$url" I tried escaping the & with \&,... (4 Replies)
Discussion started by: unclecameron
4 Replies

9. Shell Programming and Scripting

Bash script idea using cUrl -- possible?

I have an alias already in my .bash_profile to download files using cUrl's -o (output to file, user provides the file name) option. I find I'm using it quite a bit, so I wanted to write a script to run "curl -o", taking the necessary inputs - file name and URL from which to download - and then... (3 Replies)
Discussion started by: SilversleevesX
3 Replies

10. UNIX for Dummies Questions & Answers

BASH complete-filename & menu-complete together

Hi, Does anyone know how to make BASH provide a list of possible completions on the first tab, and then start cycling through the possibilites on the next tab? Right now this is what I have in my .bashrc: bind "set show-all-if-ambiguous on" bind \\C-o:menu-complete This allows... (0 Replies)
Discussion started by: Mithu
0 Replies

Featured Tech Videos