Sponsored Content
Top Forums Shell Programming and Scripting Script to scrape page for and save data Post 302870099 by molwiko on Friday 1st of November 2013 07:14:27 AM
Old 11-01-2013
Script to scrape page for and save data

Hi All
I would like to get cars DB from this web site link removed , and I am trying to right script to go and parse the web page and save the data for each cars into a file, type of cars, mark, model, but when I look to the source page I found out that the first car type is preselected and the car marks also, if I want the models of cars I have the change the selected mark on the dropdown and then the models is populated, I think this function is done by Javascript but I can't find it in the source code. it will be good if you help me out to right script that change car mark, save the information cars type, marks, models into a file.
Doing this manually will be a lot of work.

Thanks.

Last edited by joeyg; 11-01-2013 at 08:33 AM..
 

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

How to save as image from a web page

I used flot to create a graph and I would like to be able to save/export the graph as an image. In firefox on windows you can just ctl rt-click and you have a save as image feature (which I can automate with js) but...I need this to work on a linux browser. On linux in firefox I can print preview... (11 Replies)
Discussion started by: vincaStar
11 Replies

2. Shell Programming and Scripting

How to pass data from server (CGI script) to client (html page)

Hi I know how to pass data from client side (html file) to server using CGI script (POST method). I also know how to re-create the html page from server side after receiving the data (using printf). However I want to write static pages on client side (only the structure), and only to pass... (0 Replies)
Discussion started by: naamabm
0 Replies

3. Shell Programming and Scripting

Save page source, including javascript

I need to get the source code of a webpage. I have tried to use wget and curl, but it doesn't show the necessary javascript part of the source. I don't have to execute it, only to view the source. How do I do that? (1 Reply)
Discussion started by: locoroco
1 Replies

4. Shell Programming and Scripting

Get Permissions and save to data

Hi all; I have the following code which gives me kind of what I need: #!/usr/bin/perl use Fcntl ':mode'; # if ($ARGV ne "") { $filename = $ARGV; } else { print "Please specify a file!\n"; exit; } # if... (2 Replies)
Discussion started by: gvolpini
2 Replies

5. Shell Programming and Scripting

script for adding page number before page breaks

Hi, If there is an expert that can help: I have many txt files that are produced from pdftotext that include page breaks the page breaks seem to be unix style hex 0C. I want to add page numbers before each page break as in : Page XXXX Regards antman (9 Replies)
Discussion started by: antman
9 Replies

6. Shell Programming and Scripting

Open Page and save it using mozilla

HI Guys, I have one command which can open page and i want to save and exit from it. pf@home> mozilla 181.131.193.10/g/report.txt It will open one page now how can i save it. Thanks (1 Reply)
Discussion started by: pareshkp
1 Replies

7. Shell Programming and Scripting

Scrape 10 million pages and save the raw html data in mysql database

I have a list of 10 million page urls. I want those pages scraped and saved in the mysql database as raw html. I own a Linux VPS server with 1GB RAM and WHM/cPanel. I would like to scrape at least 100,000 urls in 24 hours. So can anyone give me some sample shell scripting code? (4 Replies)
Discussion started by: Viruthagiri
4 Replies

8. UNIX for Dummies Questions & Answers

Get a data and save

If I have a A.log 1 Air Flow Monitor : 34.070 Degrees C 2 Air Flow Monitor : 41.730 Degrees C 3 Air Flow Monitor : 35.340 Degrees C 4 Air Flow Monitor : 33.370 Degrees C 5 Air Flow Monitor : 36.770 Degrees C 6 Air Flow Monitor : 45.910 Degrees C 7 Air Flow Monitor ... (1 Reply)
Discussion started by: sabercats
1 Replies

9. Shell Programming and Scripting

Run sql query in shell script and output data save as delimited text

I want to run sql query in shell script and output data save as delimited text (delimited text would be comma) Code: SPOOL_FILE=/pgedw/dan.txt SQL=/pgedw/dan.sql sqlplus -s username/password@myhost:port/servicename <<EOF set head on set COLSEP , set linesize 32767 SET TRIMSPOOL ON SET... (8 Replies)
Discussion started by: Jaganjag
8 Replies
Ac3d Compiler(6)						       Games							  Ac3d Compiler(6)

NAME
accc - Ac3d Compiler SYNTAX
accc [option] <inputfile> <outputfile> [dist][-order orderstring] DESCRIPTION
This manual describes the Ac3d compiler application that is shipped with the game TORCS. OPTIONS
-strip stripify any ac3d output models +o ac3d to ac3d: the result file is optimized in using groups by zone of track track must be named TKMNxxx dist is used to determine the distance of the objects +om ac3d to ac3d: the result is a vertex merged unique obj for smooth car only -o ac3d to obj +s ac3d to ac3d with strips (used for cars) +es <angle_of_smooth> ac3d to ac3d with strips (used for cars) and extended ac3d file output (computed normals) angle is in degrees: example: +es 80.0 clkdtm_o.ac clkdtm.ac the output file will also contains the secondary textcoord for the env sliding +et ac3d to ac3d with triangles (used for cars) and extended ac3d file output (normals normals) +etn ac3d to ac3d with triangles no split and extended ac3d file output (normals normals) +shad ac3d to ac3d with triangles, create a new ac3d file used for track shading vertical mapping of a single texture <inputfile> <outputfile> -order orderstring only used with +es , +s and +et orderstring is the order of the objects during the save for example: HB;OB;OBM is the names of the objet separate by a semicolon for imported NFS cars the object name HB must be used instead of: HB -g <outputfile> for grouping multilayer ac3d track -l0 <input filename> the base geometry -l1 <input filename> the base geometry map-tiled -l2 <input filename> the base geometry skids/and grass details -l3 <input filename> the base geometry shadows -d3 <val> the max distance of groups in tkmn -d2 <val> the distance of group 2 in tkmn -d1 <val> the distance of group 1 in tkmn -S <val> the distance of splitting for TERRAIN* objects -es for extended ac3d file format for strips -nts no texture split (for debug) SEE ALSO
torcs(6) AUTHOR
This manual page was writen by Rudy Godoy <rudy@stone-head.org>, for the Debian GNU/Linux system (but may be used by others). Rudy Godoy 1.4 Ac3d Compiler(6)
All times are GMT -4. The time now is 06:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy