MySQL bulk retrieval of database through html form

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Scrape 10 million pages and save the raw html data in mysql database

I have a list of 10 million page urls. I want those pages scraped and saved in the mysql database as raw html. I own a Linux VPS server with 1GB RAM and WHM/cPanel. I would like to scrape at least 100,000 urls in 24 hours. So can anyone give me some sample shell scripting code?

2. Shell Programming and Scripting

pass argument to html upload form

I am using an html form and a php upload script to upload files. HTML form <table width="500" border="0" align="center" cellpadding="0" cellspacing="1" bgcolor="#CCCCCC"> <tr> <form action="upload_ac.php" method="post" enctype="multipart/form-data" name="form1" id="form1"> <td> <table...

3. Solaris

man pages in html form

Hi I would like to convert standard online man pages from my solaris10 system into html form to publish it on my webpage. How this can be done in Sol10 ? thx for help.

4. Shell Programming and Scripting

download an html file via wget and pass it to mysql and update a database

CAN I download an html file via wget and pass it to mysql and update a database field?

5. Shell Programming and Scripting

Pass variable to php from html form

I am sure this is easy but I can't figure it out... Here is the form. <?php $searchString = $_POST; if (!isset($_POST)) ?> <html> <head> <title>Personal INFO</title> </head> <body> <form method="post" action="search.php"> <input type="text" size="20" maxlength="20" name="search">...

6. Shell Programming and Scripting

Converting %## back to special characters from an HTML form

I have an HTML form that sends email to a large list of users one at a time by matching an email address in peoplesoft to their username. It works great, except that special characters are converted to %## format. Is there a library of these I can use to sed them back (yes this is a crappy UNIX...

7. Shell Programming and Scripting

HTML form to cgi help

I wrote a script to automate user account verification against peoplesoft. Now I want to make it available to my peers via the web. It is running on Solaris. I have the form written, but am not sure how to make it work. I think the form should call a perl cgi when submitted. The cgi should call...

8. Shell Programming and Scripting

Passing FORM(HTML) variable to ksh

I am currently able to use the $QUERY_STRING variable and simply cut out what I need to be assigned as variables within the shell script. However, I've been able to use the "name" value assigned within the FORM(HTML) as a variable when I use perl. Why is it that ksh doesn't read the "name" in as...

LEARN ABOUT DEBIAN

mysql2dlf

MYSQL2DLF.IN(1) 					  LogReport's Lire Documentation					   MYSQL2DLF.IN(1)

NAME

       mysql2dlf - convert mysql logfiles to dlf format

SYNOPSIS

       mysql2dlf

DESCRIPTION

       mysql2dlf converts a MySQL query log file to DLF format.  Information on MySQL can be found on http://www.mysql.org/. The query log file is
       defined by the --log[=file] option of mysqld, or the log=file setting in MySQL configuration file.

       Such a log file looks like e.g.

	/usr/sbin/mysqld, Version: 3.23.43-debug-log, started with:
	Tcp port: 3306	Unix socket: /var/run/mysqld/mysqld.sock
	Time		     Id Command    Argument
	011218 15:02:58       1 Connect     root@localhost on
			      1 Query	    SHOW VARIABLES LIKE 'pid_file'
			      1 Shutdown
	011226 21:35:59       6 Connect     joe@localhost on
			      6 Init DB     nmrshiftdb
			      6 Query	    SHOW VARIABLES

       or

			 42401 Query	   SELECT
			 bannerID,
			 banner,
			 format,
			 width,
			 height,
			 alt,
			 url
		     FROM
			 banners
		     WHERE

			 act = 'true'  AND (keyw = 'fullsize' OR keyw = 'global')

       The generic database dlf format is described in database.xml.

EXAMPLES

       To process a log as produced by MySQL:

	$ mysql2dlf < mysql-log

       mysql2dlf will be rarely used on its own, but is more likely called by lr_log2report:

	$ lr_log2report mysql < /var/log/mysql-log

NOTES

       The parser has been tested for query log files for MySQL 3.23.46 only.

BUGS

       This converter stores all log files information in one big nested array in memory, before writing.  Therefore, memory consumption is linear
       with the size of the log.

SEE ALSO

       mysql(1), mysqld(1)

VERSION

       $Id: mysql2dlf.in,v 1.12 2010/12/05 20:36:45 wraay Exp $

COPYRIGHT

       Copyright (C) 2001, 2002 Stichting LogReport Foundation LogReport@LogReport.org

       This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
       the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

       This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
       MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with
       http://www.gnu.org/copyleft/gpl.html.

AUTHOR

       Egon Willighagen <egonw@logreport.org>

Lire 2.1.1							    2011-12-31							   MYSQL2DLF.IN(1)

Shell Programming and Scripting