Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Facing difficulty scraping website with curl Post 303037943 by Neo on Sunday 18th of August 2019 10:55:18 PM
Old 08-18-2019
I assume you are going to use their API?

API Reference -skyscanner developers

"Screen Scraping" is a thing of the past, really...

JSON APIs like this one are the current "in thing" Smilie
 

8 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Reverse Proxy difficulty

Hi I am trying to set up two hosts in a reverse proxy. The reverse proxy already has 8 servers running perfectly, but they are all simply mapping pure addresses, which I have registered internally and externally. The latest two I wish to add are a bit different, they are app servers, one... (1 Reply)
Discussion started by: rboekdrukker
1 Replies

2. Shell Programming and Scripting

Perl Difficulty

Hi, I am trying to upload a file to a SQL database table. The column type is IMAGE. I am looking for a solution to upload a word doc file. I tried 3 approaches. 1) my $fileToStore = "mytest.doc"; open IPFILE, "<", $name; binmode IPFILE; while (<IPFILE>) { $fileToStore .= $_; } close... (1 Reply)
Discussion started by: b.paramanatti
1 Replies

3. Shell Programming and Scripting

Loop difficulty

hi all I am new to unix and want to create a loop to repeat the loop and before that it ask me to do so.I know "while" may help but I put it in my work and getting stuk with it.any help appreciated. (13 Replies)
Discussion started by: samsami1971
13 Replies

4. UNIX and Linux Applications

Unable to connect to a website using Curl

Hello, I am using Curl command to make a function call to a web service. The issue I am facing right now is: curl h**p://www.google.com with the above command, I get a XML file as a response. Also when i execute : wget h**p://www.google.com Replace ** : tt I can see status as... (1 Reply)
Discussion started by: amitshete
1 Replies

5. Shell Programming and Scripting

difficulty with awk

hello folks, i am stuck with this awk command. i need to calculate the sum of a column of values on a flatfile and i am using the following command : awk -F"|" '{x += $10} END {print "Sum: "x}' standard_csv_file1.out that flatfile contains 180 fields and i am getting the... (5 Replies)
Discussion started by: jdsony
5 Replies

6. UNIX for Dummies Questions & Answers

Difficulty with set - command

Hi , i have a shell script with the first two lines as #! /bin/ksh set -x when i try opening the file from unix using the command 'sh filename.sh' , i am getting the below error : invalid optionline 2: set: - Pls help Use code tags for you code and data... (1 Reply)
Discussion started by: Rajankum
1 Replies

7. Shell Programming and Scripting

Scraping line - Using awk or sed

Hello, Can somone help with this command please? I have this output pattern in a file. I use a simple awk command to print each field separated by comma. For example I use this to get the first awk -F, "{ print $1 }" "ABC=abcdefg,CDF=mnqrst,GGG=hrvyess" issue: What I... (7 Replies)
Discussion started by: mnassiri
7 Replies

8. Programming

Python Web Page Scraping Urls Creating A Dictionary

I have thrown in the towel and cant figure out how to do this. I have a directory of html files that contain urls that I need to scrape (loop through) and add into a dictionary. An example of the output I would like is: bigbadwolf.htlm: https://www.blah.com, http://www.blahblah.com,... (5 Replies)
Discussion started by: metallica1973
5 Replies
WWW::Facebook::API::FBML(3pm)				User Contributed Perl Documentation			     WWW::Facebook::API::FBML(3pm)

NAME
WWW::Facebook::API::FBML - Facebook Markup Language SYNOPSIS
use WWW::Facebook::API; DESCRIPTION
Methods for updating FBML references with WWW::Facebook::API SUBROUTINES
/METHODS base Returns the WWW::Facebook::API base object. new Constructor. delete_custom_tags( names => [@tag_names] ) The fbml.deleteCustomTags method of the Facebook API. get_custom_tags( app_id => $id ) The fbml.getCustomTags method of the Facebook API. register_custom_tags( tags => [@json_tags] ) The fbml.registerCustomTags method of the Facebook API. set_ref_handle( handle => 'handleName', fbml => 'fbml' ) The fbml.setRefHandle method of the Facebook API. See this page on the wiki: http://wiki.developers.facebook.com/index.php/Changing_profile_content refresh_img_src( url => $url ) Request an image in Facebook's cache (at the given URL) be refreshed. See this page on the wiki: http://wiki.developers.facebook.com/index.php/Changing_profile_content refresh_ref_url( url => $url ) Have Facebook call the given URL to generate the FBML. See this page on the wiki: http://wiki.developers.facebook.com/index.php/Changing_profile_content upload_native_strings ( %params ) The fbml.uploadNativeStrings method of the Facebook API. "native_strings" is the only parameter required. $client->fbml->upload_native_strings( native_strings => 'JSON' ); The format for "native_strings" is described on the developers wiki: http://wiki.developers.facebook.com/index.php/Fbml.uploadNativeStrings DIAGNOSTICS
None. CONFIGURATION AND ENVIRONMENT
WWW::Facebook::API::FBML requires no configuration files or environment variables. DEPENDENCIES
See WWW::Facebook::API INCOMPATIBILITIES
None reported. BUGS AND LIMITATIONS
No bugs have been reported. Please report any bugs or feature requests to "bug-www-facebook-api@rt.cpan.org", or through the web interface at <http://rt.cpan.org>. AUTHOR
TSIBLEY "<tsibley@cpan.org>" LICENSE AND COPYRIGHT
Copyright (c) 2007, TSIBLEY "<tsibley@cpan.org>". All rights reserved. Certain part copyright (c) 2010, David Romano "<unobe@cpan.org>". All rights reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic. DISCLAIMER OF WARRANTY
BECAUSE THIS SOFTWARE IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE SOFTWARE, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE SOFTWARE "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE SOFTWARE IS WITH YOU. SHOULD THE SOFTWARE PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR, OR CORRECTION. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE SOFTWARE AS PERMITTED BY THE ABOVE LICENSE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE SOFTWARE (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE SOFTWARE TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. perl v5.10.1 2010-03-13 WWW::Facebook::API::FBML(3pm)
All times are GMT -4. The time now is 10:37 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy