It's been a while I know, but as I said I was busy learning bash
Not saying I got it all, I still got a long way to go...
I just wanted to post here what I've been able to do all on my own until now.
It will definitely seem barbaric to you and less elegant that what you did earlier with the awk command but as I'm not sure how to control it, I'm taking another road :
Code:
#!/bin/bash
#setting variable for the link construction. This will be the part that comes after the www.dotmed.com"$link" for the second curl
set link
#Setting the index for the while loop. The limit U (constant in the while loop) will define the amount of equipment to "crawl"
i=1
#Setting the offset variable that helps passing from one href to the next. This variable is used in the first curl link
offset=0
#Starting the loop for the crawl
while [ $i -lt 5 ]
do
#Getting the listing and assigning each listing to the variable "link"
link=$(curl "https://www.dotmed.com/equipment/2/5/2693/all/offset/$offset/all?key=&limit=1&price_sort=descending&cond=all&continent_filter=0&zip=&distance=5&att_1=0&att_row_num=1&additionalkeywords=&country=ES" | egrep "href.*view more" | sed -n 's/.*href="\([^"]*\).*/\1/p')
#Getting information from each listing
curl "https://www.dotmed.com$link" | fgrep -e "id=\"price"
#Reseting for next iteration
unset link
(( i++ ))
(( offset++ ))
done
The great thing is that I can run it on any Linux machine plus I'm getting into each listing with this script to get info from there...
Now I've got to learn more about sed and grep to extract the information I need automatically and I'll be done .
Easy right? hopefully I will be able to do it soon.
If you have any comment on the script please be my guest! still trying to learn!
All the best!
Last edited by Ardzii; 01-12-2017 at 02:29 PM..
Reason: English
Hi all,
Still a newbie and learning as I go ... as you do :)
Have created this script to report on disc usage and I've just included the ChkSpace function this morning.
It's the first time I've read a file (line-by-bloody-line) and would like to know if I can improve this script ?
FYI - I... (11 Replies)
Hi ,
i'm searching for files over many Aix servers with rsh command using this request :
find /dir1 -name '*.' -exec ls {} \;
and then count them with "wc"
but i would improve this search because it's too long and replace directly find with ls command but "ls *. " doesn't work.
and... (3 Replies)
Wrote this script to find the date x days before or after today. Is there any way that this script can be speeded up or otherwise improved?
#!/usr/bin/sh
check_done() {
if
then
daysofmth=31
elif
then
if
... (11 Replies)
hi someone tell me which ways i can improve disk I/O and system process performance.kindly refer some commands so i can do it on my test machine.thanks, Mazhar (2 Replies)
I have a data file of 2 gig
I need to do all these, but its taking hours, any where i can improve performance, thanks a lot
#!/usr/bin/ksh
echo TIMESTAMP="$(date +'_%y-%m-%d.%H-%M-%S')"
function showHelp {
cat << EOF >&2
syntax extreme.sh FILENAME
Specify filename to parse
EOF... (3 Replies)
I have a 10Gbps network link connecting two machines A and B. I want to transfer 20GB data from A to B using TCP. With default setting, I can use 50% bandwidth. How to improve the throughput? Is there any way to make throughput as close to 10Gbps as possible? thanks~ :) (3 Replies)
Hi All,
I have written a script as follows which is taking lot of time in executing/searching only 3500 records taken as input from one file in log file of 12 GB Approximately.
Working of script is read the csv file as an input having 2 arguments which are transaction_id,mobile_number and search... (6 Replies)
I just wrote a very small script that improves readability on system sulog. The problem with all sulog is there is lack of clarity whether the info you are looking at is the most current. So if you just need a simple soution instead of going thru the trouble of writing a script that rotate logs and... (0 Replies)
Gents.
I have 2 different scripts for the same purpose:
raw2csv_1
Script raw2csv_1 finish the process in less that 1 minute
raw2csv_2
Script raw2csv_2 finish the process in more that 6 minutes.
Can you please check if there is any option to improve the raw2csv_2. To finish the job... (4 Replies)
Gents,
Is there the possibility to improve this script to be able to have same output information.
I did this script, but I believe there is a very short code to get same output
here my script
awk -F, '{if($10>0 && $10<=15) print $6}' tmp1 | sort -k1n | awk '{a++} END { for (n in a )... (23 Replies)
Discussion started by: jiam912
23 Replies
LEARN ABOUT OSX
curl-config
curl-config(1) curl-config manual curl-config(1)NAME
curl-config - Get information about a libcurl installation
SYNOPSIS
curl-config [options]
DESCRIPTION
curl-config displays information about the curl and libcurl installation.
OPTIONS --ca Displays the built-in path to the CA cert bundle this libcurl uses.
--cc Displays the compiler used to build libcurl.
--cflags
Set of compiler options (CFLAGS) to use when compiling files that use libcurl. Currently that is only the include path to the curl
include files.
--checkfor [version]
Specify the oldest possible libcurl version string you want, and this script will return 0 if the current installation is new enough
or it returns 1 and outputs a text saying that the current version is not new enough. (Added in 7.15.4)
--configure
Displays the arguments given to configure when building curl.
--feature
Lists what particular main features the installed libcurl was built with. At the time of writing, this list may include SSL, KRB4 or
IPv6. Do not assume any particular order. The keywords will be separated by newlines. There may be none, one, or several keywords in
the list.
--help Displays the available options.
--libs Shows the complete set of libs and other linker options you will need in order to link your application with libcurl.
--prefix
This is the prefix used when libcurl was installed. Libcurl is then installed in $prefix/lib and its header files are installed in
$prefix/include and so on. The prefix is set with "configure --prefix".
--protocols
Lists what particular protocols the installed libcurl was built to support. At the time of writing, this list may include HTTP,
HTTPS, FTP, FTPS, FILE, TELNET, LDAP, DICT. Do not assume any particular order. The protocols will be listed using uppercase and are
separated by newlines. There may be none, one, or several protocols in the list. (Added in 7.13.0)
--static-libs
Shows the complete set of libs and other linker options you will need in order to link your application with libcurl statically.
(Added in 7.17.1)
--version
Outputs version information about the installed libcurl.
--vernum
Outputs version information about the installed libcurl, in numerical mode. This outputs the version number, in hexadecimal, with 8
bits for each part; major, minor, patch. So that libcurl 7.7.4 would appear as 070704 and libcurl 12.13.14 would appear as 0c0d0e...
Note that the initial zero might be omitted. (This option was broken in the 7.15.0 release.)
EXAMPLES
What linker options do I need when I link with libcurl?
$ curl-config --libs
What compiler options do I need when I compile using libcurl functions?
$ curl-config --cflags
How do I know if libcurl was built with SSL support?
$ curl-config --feature | grep SSL
What's the installed libcurl version?
$ curl-config --version
How do I build a single file with a one-line command?
$ `curl-config --cc --cflags` -o example example.c `curl-config --libs`
SEE ALSO curl(1)Curl 7.17.1 25 Oct 2007 curl-config(1)
01-12-2017
and less elegant that what you did earlier with the awk command but as I'm not sure how to control it, I'm taking another road 
:
