Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Splitting a complex file using awk
Top Forums Shell Programming and Scripting Splitting a complex file using awk Post 302460614 by hukcjv on Thursday 7th of October 2010 06:46:40 AM
Old 10-07-2010
file1
Code:
insert into table1 (col1, col2) values (value1, value2)@
insert into table1 (col1, col2) values(value3, value4)@

file2
Code:
insert into table2 (col1, col2) values (value1, value2)@
insert into table2 (col1, col2) values(value3, value4)@

file3
Code:
etc etc

So we have 1 file containing all the inserts for 1 table, 1 file for all the inserts for table 2 etc

Also I have just noticed that some of the INSERTS are over multiple lines.

eg.

Code:
INSERT INTO
table3 (col1, col2) values(val1 etc)

Last edited by Scott; 10-07-2010 at 07:53 AM.. Reason: Code tags, please...
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Help with splitting lines in a file using awk

I have a file which is one big long line of text about 10Kb long. Can someone provide a way using awk to introduce carriage returns every 40 chars in this file. Any other solutions would also be welcome. Thank you in advance. (5 Replies)
Discussion started by: martinbarretto
5 Replies

2. Shell Programming and Scripting

splitting tab-delimited file with awk

Hi all, I need help to split a tab-delimited list into separate files by the filename-field. The list is already sorted ascendingly by filename, an example list would look like this; filename001 word1 word2 filename001 word3 word4 filename002 word1 word2 filename002 word3 word4... (4 Replies)
Discussion started by: perkele
4 Replies

3. Shell Programming and Scripting

Sorting complex file with awk

i have a file ddd.txt its delimiter is : but has , and "" within each column as below and also each line ends with ; I_EP,"29":I_US,"120":I_P_ID,"2020":I_NEW,"600":I_OLD,"400":I_POW,"4.5":I_NAME,"TOM";... (9 Replies)
Discussion started by: blackzinga80
9 Replies

4. Shell Programming and Scripting

awk for splitting file in constant chunks

Hi gurus, I wanted to split main file in 20 files with 2500 lines in each file. My main file conatins total 2500*20 lines. Following awk I made, but it is breaking with error. awk '{ for (i = 1; i <= 20; i++) { starts=2500*$i-1; ends=2500*$i; NR>=starts && NR<=ends {f=My$i".txt"; print >> f;... (10 Replies)
Discussion started by: mukesh.lalwani
10 Replies

5. Shell Programming and Scripting

echoing complex awk command into file fails

Using hp-ux's shell, I'm trying to echo a complex awk command into a script file for later use. But it fails on a newline character and splits the rest of the command onto the next line. echo ' printf("%s: TOTAL = %18.0lf\n", FILENAME, TOTAL) >> "TOTAL.TXT";' >>awk.script Looks... (3 Replies)
Discussion started by: Scottie1954
3 Replies

6. Shell Programming and Scripting

Splitting file using awk

I have file with below content FG1620000|20000 FG1623000|23000 FG1625000|25000 FG1643894|43894 FG1643895|43895 FG1643896|43896 FG1643897|43897 FG1643898|43898 My aim is to split the above file into two files based on the value in the second field. If the value in second field is... (2 Replies)
Discussion started by: anijan
2 Replies

7. Shell Programming and Scripting

Splitting the file using awk

Hi, I have a requirement in which I am going to receive one file and should be splitted to 9 different files based on one distinguisher called TYPE. I heard that this can be done using awk or sed. Can any one advise regardint the logic and simpler way other than using awk or sed is also... (15 Replies)
Discussion started by: sagar.cumar
15 Replies

8. Programming

How to replace the complex strings from a file using sed or awk?

Dear All, I am having a requirement to find the difference between 2 files and generate a discrepancy report out of it as an html page. I prefer using diff -y file1 file2 since it gives user friendly layout to know any discrepancy in the record and unique records among the 2 file. Here's how it... (12 Replies)
Discussion started by: Badhrish
12 Replies

9. Shell Programming and Scripting

Splitting a text file into smaller files with awk, how to create a different name for each new file

Hello, I have some large text files that look like, putrescine Mrv1583 01041713302D 6 5 0 0 0 0 999 V2000 2.0928 -0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 5.6650 0.2063 0.0000 N 0 0 0 0 0 0 0 0 0 0 0 0 3.5217 ... (3 Replies)
Discussion started by: LMHmedchem
3 Replies

10. UNIX for Beginners Questions & Answers

awk solution for Splitting a file.

Hi I have a csv file with as below sdg-catalog-00000001 sdg-sku-00000317 sdg-sku-00000318 sdg-sku-00000319 sdg-sku-00000320 sdg-catalog-00000002 sdg-sku-00000321 sdg-sku-00000322 sdg-sku-00000323 sdg-sku-00000324 sdg-sku-00000325 sdg-catalog-00000003 sdg-sku-00000326... (3 Replies)
Discussion started by: Raghuram717
3 Replies

LEARN ABOUT DEBIAN

gtk2::liststore

Gtk2::ListStore(3pm)					User Contributed Perl Documentation				      Gtk2::ListStore(3pm)

NAME

       Gtk2::ListStore - wrapper for GtkListStore

HIERARCHY

	 Glib::Object
	 +----Gtk2::ListStore

INTERFACES

	 Gtk2::TreeModel
	 Gtk2::TreeDragSource
	 Gtk2::TreeDragDest
	 Gtk2::TreeSortable
	 Gtk2::Buildable

METHODS

   liststore = Gtk2::ListStore->new (...)
       o   ... (list) of strings

   treeiter = $list_store->append
   $list_store->clear
   $list_store->set_column_types (...)
       o   ... (list) of strings

   $list_store->set ($iter, $col1, $val1, ...)
       o   $iter (Gtk2::TreeIter)

       o   $col1 (integer) the first column number

       o   $val1 (scalar) the first value

       o   ... (list) pairs of column numbers and values

   treeiter = $list_store->insert ($position)
       o   $position (integer)

   treeiter = $list_store->insert_after ($sibling)
       o   $sibling (Gtk2::TreeIter or undef)

   treeiter = $list_store->insert_before ($sibling)
       o   $sibling (Gtk2::TreeIter or undef)

   treeiter = $list_store->insert_with_values ($position, ...)
       o   $position (integer) position to insert the new row

       o   ... (list) pairs of column numbers and values

       Like doing insert followed by set, except that insert_with_values emits only the row-inserted signal, rather than row-inserted, row-
       changed, and, if the store is sorted, rows-reordered as in the multiple-operation case.	Since emitting the rows-reordered signal
       repeatedly can affect the performance of the program, insert_with_values should generally be preferred when inserting rows in a sorted list
       store.

       Since: gtk+ 2.6

   boolean = $list_store->iter_is_valid ($iter)
       o   $iter (Gtk2::TreeIter)

       Since: gtk+ 2.2

   $store->move_after ($iter, $position)
       o   $iter (Gtk2::TreeIter)

       o   $position (Gtk2::TreeIter or undef)

       Since: gtk+ 2.2

   $store->move_before ($iter, $position)
       o   $iter (Gtk2::TreeIter)

       o   $position (Gtk2::TreeIter or undef)

       Since: gtk+ 2.2

   treeiter = $list_store->prepend
   boolean = $list_store->remove ($iter)
       o   $iter (Gtk2::TreeIter)

       The return is always a boolean in the style of Gtk 2.2.x and up, even when running on Gtk 2.0.x.

   $store->reorder (...)
       o   ... (list) of integers the reordered posistions

       Reorders store to follow the order indicated by new_order. Note that this function only works with unsorted stores.

       A list of position should be passed, one for each item in the list.

       Since: gtk+ 2.2

   $store->swap ($a, $b)
       o   $a (Gtk2::TreeIter)

       o   $b (Gtk2::TreeIter)

       Since: gtk+ 2.2

   $list_store->set_value ($iter, $col, $val)
       o   $iter (Gtk2::TreeIter)

       o   $val (scalar)

       o   $col (integer)

SEE ALSO

       Gtk2, Glib::Object

COPYRIGHT

       Copyright (C) 2003-2011 by the gtk2-perl team.

       This software is licensed under the LGPL.  See Gtk2 for a full notice.

perl v5.14.2							    2012-05-27						      Gtk2::ListStore(3pm)
All times are GMT -4. The time now is 09:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy