Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Formation of sql files
Top Forums Shell Programming and Scripting Formation of sql files Post 302580448 by Corona688 on Thursday 8th of December 2011 02:08:55 PM
Old 12-08-2011
I'm not surprised... That's a dangerous use of backticks and useless use of cat. It works as a quick fix only but when you use it for anything big, as you've discovered, it has major problems. Like storing the entire file in memory while it's working on it, and possibly truncating the end if it's just too large.

It also produces 5 update statements when you only needed 1, and reopens the query file 5000 times to process 1000 lines when you only needed to open it once for all of them.

Code:
SPLIT="$(printf "\r\n");

while IFS="${SPLIT}" read i
do
        echo "update table set id1=0,id2=0,id3=0,id4=0,id5=0 where no='$i';"
done > output < input

Or a version in awk which may be faster yet:

Code:
awk -v RS="\r\n" '$1 { printf("update table set id1=0, id2=0, id3=0,id4=0,id5=0 where no=\"%s\";", $1); }' filename > output

If you're not on Linux, use gawk or nawk.

---------- Post updated at 01:08 PM ---------- Previous update was at 01:08 PM ----------

Depending on what your database is, it's probably also possible to pipe that output directly into your database, so it can process it as it happens, instead of having to store it in a gigantic temp file in the meantime then start over from the beginning when done.
This User Gave Thanks to Corona688 For This Post:
Naga06
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

date command op formation

Dear All I am facing below mention problem plz suggest me solution. Op of date command: > date Tue Jan 1 12:17:52 IST 2008 Now i want Jan 1 12: or Jan 1 12 op in some another variable. I had tried awk but if give me problem when there is date comes in 2 digit i.e. greater that 9.... (1 Reply)
Discussion started by: jaydeep_sadaria
1 Replies

2. Shell Programming and Scripting

Need to extract .sql files

Hi, I am trying to extract all .sql files present in a particular directory and its sub directories. How can i do this using shell script or awk? any help would be earnestly appreciated. thanks. (1 Reply)
Discussion started by: sprinleo
1 Replies

3. Shell Programming and Scripting

How to retrieve all the linked script files/ctl files/sql files?

Hi I am going to migrate our datawarehouse system from HP Tru 64 Unix to the Red Hat Linux. Inside the box, it is running around 40 cron jobs; inside each cron job, it is calling other shell script files, and the shell script files may again call other shell script files or ctl files(for... (1 Reply)
Discussion started by: franksubramania
1 Replies

4. Shell Programming and Scripting

Help to merge multiple .sql files

Hello all, I have a shell script that uses multiple .sql files. These .sql files mainly contain Oracle SQL queries to pull fields from the database. I want to place all the contents of these .sql files in one .sql file and have some parameter sent based on which the respective block or query... (6 Replies)
Discussion started by: snvniranjanrao
6 Replies

5. Shell Programming and Scripting

Perl string formation from array

HI I ma using perl programming my perl is like this $InputFile = $ENV{UDE_TMP} . "/" ."cre_fmr_gen.temp_data_file_gen.dat"; @duplicates = `cat $InputFile | cut -d "|" -f 1,1 | sort | uniq -c | awk '{ if(\$1>1) {print \$2;}}'`; my $cusiplist ; foreach $cusip (@duplicates) {... (1 Reply)
Discussion started by: ptappeta
1 Replies

6. UNIX for Advanced & Expert Users

Data formation

I have a data like as follows, I need to format it as shown in as below. Request you to help me here ? I/P aa|3|1 aa|4|2 bb|3|1 bb|4|1 cc|3|26 cc|4|1 O/P aa|3|1|4|2 bb|3|1|4|1 cc|3|26|4|1 Thanks, Srikanth (5 Replies)
Discussion started by: srikanth38
5 Replies

7. Shell Programming and Scripting

How to get sql command with output in files?

I tried executing set of queries from shell script but not able to capture the input query in the log file,but the input query is not displayed along with output. Only the outputs are being captured in the log file. Is there a way to capture the input query along with the corresponding input?? (8 Replies)
Discussion started by: pallvi_mahajan
8 Replies

8. Programming

Perl script to create football formation

I need help to create varieties of football formation. The available positions are: GK SW DR DC DL WBR DM WBL MR MC ML AMR AMC AML ST But the conditions are: a. the maximum number in 1 formation: GK is 1 SW is 1 (1 Reply)
Discussion started by: Tzeronone
1 Replies

9. Shell Programming and Scripting

Football formation

I'm trying to create a perl script that will automatically fit the player's name to the formation. For example, in my: DR.txt Arbeloa 200 Carvajal 190 Ramos 180 DC.txt Ramos 200 Pepe 190 Varane 180 DL.txt Marcelo 200 Coentrao 190 Arbeloa 180 formation.txt: DR DC DC DL DR (7 Replies)
Discussion started by: Tzeronone
7 Replies

10. Programming

Not a repeated question (Perl Script Create Football Formation)

https://www.unix.com/programming/252468-perl-script-create-football-formation.html https://www.unix.com/members/43551.html, it is not repeated question. please read it before u block my question. Unblock it for me. Thanks:mad: (0 Replies)
Discussion started by: Tzeronone
0 Replies

LEARN ABOUT PHP

mysql_drop_db

MYSQL_DROP_DB(3)							 1							  MYSQL_DROP_DB(3)

mysql_drop_db - Drop (delete) a MySQL database

SYNOPSIS

       Warning

	      This  function  was deprecated in PHP 4.3.0, and will be removed in the future, along with the entirety of the original MySQL exten-
	      sion. Instead, the MySQLi or PDO_MySQL extension should be used. See also MySQL: choosing an API guide  and  related  FAQ  for  more
	      information. Alternatives to this function include:

		     oExecute a
		       DROP DATABASE query

       bool mysql_drop_db (string  $database_name, [resource  $link_identifier = NULL])

DESCRIPTION

       mysql_drop_db(3)  attempts to drop (remove) an entire database from the server associated with the specified link identifier. This function
       is deprecated, it is preferable to use mysql_query(3) to issue an sql DROP DATABASE statement instead.

	      o $database_name
		- The name of the database that will be deleted.

	      o $
		link_identifier -The MySQL connection. If the link identifier is not specified,  the  last  link  opened  by  mysql_connect(3)	is
		assumed. If no such link is found, it will try to create one as if mysql_connect(3) was called with no arguments. If no connection
		is found or established, an E_WARNING level error is generated.

	Returns TRUE on success or FALSE on failure.

       Example #1

	      mysql_drop_db(3) alternative example

	      <?php
	      $link = mysql_connect('localhost', 'mysql_user', 'mysql_password');
	      if (!$link) {
		  die('Could not connect: ' . mysql_error());
	      }

	      $sql = 'DROP DATABASE my_db';
	      if (mysql_query($sql, $link)) {
		  echo "Database my_db was successfully dropped
";
	      } else {
		  echo 'Error dropping database: ' . mysql_error() . "
";
	      }
	      ?>

       Warning

	       This function will not be available if the MySQL extension was built against a MySQL 4.x client library.

       Note

	       For backward compatibility, the following deprecated alias may be used: mysql_dropdb(3)

       mysql_query(3).

PHP Documentation Group 													  MYSQL_DROP_DB(3)
All times are GMT -4. The time now is 12:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy