Sponsored Content
Full Discussion: sh and MySQL LOAD DATA
Top Forums Shell Programming and Scripting sh and MySQL LOAD DATA Post 302296937 by ShawnMilo on Thursday 12th of March 2009 07:24:06 AM
Old 03-12-2009
You can create a 'LOAD DATA INFILE' query and place it in the ".sql" file (the name is irrelevant). This is what I meant earlier, but I didn't specify that because I mistakenly thought your first post already mentioned it, but instead I see you wrote "MYSQL LOAD DATA," which may have been referring to something else.

The LOAD DATA INFILE syntax allows you to ignore any number of lines from the beginning of the file, and you don't have to convert a string date to a datetime if it's in a reasonable format.

Obviously you can tell the query that your file delimiter is a comma, and if you have strings which may include commas, use the ENCLOSED BY option.

MySQL :: MySQL 5.1 Reference Manual :: 12.2.6 LOAD DATA INFILE Syntax

You keep saying that you have no control over the CSV file. That's not true in any way. If you're able to write a script to rename it or move it to a temp folder, there's no reason why you can't run it through a little sed, awk, or Perl to do a little cleanup first. You're on a *nix command line -- you're empowered!
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need help in wrting Load Script for a Load-Resume type of load.

hi all need your help. I am wrting a script that will load data into the table. then on another load will append the data into the existing table. Regards Ankit (1 Reply)
Discussion started by: ankitgupta
1 Replies

2. Programming

Load text file into a MySQL field

Hello, maybe this post is offtopic, sorry for the inconveniencies. I found examples about how to populate different fields from a text file (with MySQL, the LOAD DATA INFILE sentece), but not about how to load a complete plain text file into a concrete database field. Could you please tell me if... (1 Reply)
Discussion started by: aristegui
1 Replies

3. Shell Programming and Scripting

Automatically Load data from all files in directory

I'm new in Unix shell scripting and i need someone to help me to make Script that run all time watching my directory that files uploaded to it via FTP (/mydir/incoming_files), if any files exists in it then (if many files exists, then sort files and load them ascending) it‘ll checks the size of the... (1 Reply)
Discussion started by: m_fighter
1 Replies

4. Shell Programming and Scripting

How to load different type of data in a file to two arrays

Hi, I have tried to find some sort of previous similar thread on this but not quite close to what I want to achieve. Basically I have two class of data in my file..e.g 1,1,1,1,1,2,yes 1,2,3,4,5,5,yes 2,3,4,5,5,5,no 1,2,3,4,4,2,no 1,1,3,4,5,2,no I wanted to read the "yes" entry to an... (5 Replies)
Discussion started by: ahjiefreak
5 Replies

5. Shell Programming and Scripting

executing mysql load statement from shell script

Hi, I have a piece of shell script which will connect to mysql database and execute a load statement(which will load datas in a file to the database table).The code is working and the data is in the tables. Now my requirement is, i need to grab the output from the load statement... (4 Replies)
Discussion started by: DILEEP410
4 Replies

6. Web Development

script to load data from csv file

hello i want a script to load the data line by line from a csv file into a mysql table (3 Replies)
Discussion started by: srpa01red
3 Replies

7. Shell Programming and Scripting

Load data from a flat file to oracle.

I have a flat file with records like Header 123 James Williams Finance2000 124 Pete Pete HR 1500 125 PatrickHeather Engg 3000 Footer The structure is: Eno:4 characters Name:8 characters Surname : 9 characters Dept:7 characters Sal:4characters These are sample... (1 Reply)
Discussion started by: Shivdatta
1 Replies

8. UNIX for Dummies Questions & Answers

Load UNIX data into excel sheet

Hi, i have some data in a temporary file in Unix (the data is taken from the result of an SQL query). Now i want to dump that data into an excel sheet. How to do that. Someone please advise. Thanks Regards, Vinit (3 Replies)
Discussion started by: vinit raj
3 Replies

9. Shell Programming and Scripting

Parallel sqlldr to load data.

I am using SQLLDR to load data in DB.For parallel loading I'm using nohup command. The requirement is: I have different files within a directories. Ex: 1) Dir/folder_A/AE.txt 2) Dir/folder_A/DM.txt 3) Dir/folder_B/CM.txt I need to loop through directories and load the data... (1 Reply)
Discussion started by: Pratiksha Mehra
1 Replies
MYSQLI_SET_LOCAL_INFILE_HANDLER(3)					 1					MYSQLI_SET_LOCAL_INFILE_HANDLER(3)

mysqli::set_local_infile_handler - Set callback function for LOAD DATA LOCAL INFILE command

       Object oriented style

SYNOPSIS
bool mysqli::set_local_infile_handler (mysqli $link, callable $read_func) DESCRIPTION
Procedural style bool mysqli_set_local_infile_handler (mysqli $link, callable $read_func) Set callback function for LOAD DATA LOCAL INFILE command The callbacks task is to read input from the file specified in the LOAD DATA LOCAL INFILE and to reformat it into the format understood by LOAD DATA INFILE. The returned data needs to match the format specified in the LOAD DATA PARAMETERS
o $ link -Procedural style only: A link identifier returned by mysqli_connect(3) or mysqli_init(3) o $read_func - A callback function or object method taking the following parameters: o $stream -A PHP stream associated with the SQL commands INFILE o $&buffer -A string buffer to store the rewritten input into o $buflen -The maximum number of characters to be stored in the buffer o $&errormsg -If an error occurs you can store an error message in here The callback function should return the number of characters stored in the $buffer or a negative value if an error occurred. RETURN VALUES
Returns TRUE on success or FALSE on failure. EXAMPLES
Example #1 mysqli::set_local_infile_handler example Object oriented style <?php $db = mysqli_init(); $db->real_connect("localhost","root","","test"); function callme($stream, &$buffer, $buflen, &$errmsg) { $buffer = fgets($stream); echo $buffer; // convert to upper case and replace "," delimiter with [TAB] $buffer = strtoupper(str_replace(",", " ", $buffer)); return strlen($buffer); } echo "Input: "; $db->set_local_infile_handler("callme"); $db->query("LOAD DATA LOCAL INFILE 'input.txt' INTO TABLE t1"); $db->set_local_infile_default(); $res = $db->query("SELECT * FROM t1"); echo " Result: "; while ($row = $res->fetch_assoc()) { echo join(",", $row)." "; } ?> Procedural style <?php $db = mysqli_init(); mysqli_real_connect($db, "localhost","root","","test"); function callme($stream, &$buffer, $buflen, &$errmsg) { $buffer = fgets($stream); echo $buffer; // convert to upper case and replace "," delimiter with [TAB] $buffer = strtoupper(str_replace(",", " ", $buffer)); return strlen($buffer); } echo "Input: "; mysqli_set_local_infile_handler($db, "callme"); mysqli_query($db, "LOAD DATA LOCAL INFILE 'input.txt' INTO TABLE t1"); mysqli_set_local_infile_default($db); $res = mysqli_query($db, "SELECT * FROM t1"); echo " Result: "; while ($row = mysqli_fetch_assoc($res)) { echo join(",", $row)." "; } ?> The above examples will output: Input: 23,foo 42,bar Output: 23,FOO 42,BAR SEE ALSO
mysqli_set_local_infile_default(3). PHP Documentation Group MYSQLI_SET_LOCAL_INFILE_HANDLER(3)
All times are GMT -4. The time now is 02:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy