Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Create multiple files from single file based on row separator
Top Forums Shell Programming and Scripting Create multiple files from single file based on row separator Post 302962286 by Don Cragun on Friday 11th of December 2015 06:50:41 AM
Old 12-11-2015
Quote:
Originally Posted by Pratik4891
Done below -

Code:
#!/bin/sh

while read line
do
   if echo $line | grep source; then
       line_no=`echo $line | sed 's/source\([0-9]*\)/\1/g'`
   elif echo $line | grep END; then
       : #ignore
   else
       echo $line >> out.$line_no.txt
   fi
done < input_split.txt

Any smarter approach ?
Your post #1 didn't say anything about ignoring lines containing the string END as the code above does, said you wanted output files abc.txt and bcd.txt instead of the files produced by the above code (out. table abc.txt and out. table bcd.txt), will convert any sequence of one or more spaces and/or tabs to a single space character (which is not what I expected from the sample you provided), and is processing a file named input_split.txt instead of the file Input.txt that you said you wanted to process.

To get something closer to what you said you wanted, you might try something more like:
Code:
#!/bin/sh
awk '
/^source table/ {
	if(fn)	close(fn)
	fn = $NF ".txt"
	next
}
{	print > fn
}' Input.txt

You didn't answer my question about what operating system you're using. If you're using a Solaris/SunOS system, change awk to /usr/xpg4/bin/awk or nawk.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split single file into multiple files based on the number in the column

Dear All, I would like to split a file of the following format into multiple files based on the number in the 6th column (numbers 1, 2, 3...): ATOM 1 N GLY A 1 -3.198 27.537 -5.958 1.00 0.00 N ATOM 2 CA GLY A 1 -2.199 28.399 -6.617 1.00 0.00 ... (3 Replies)
Discussion started by: tomasl
3 Replies

2. UNIX for Advanced & Expert Users

Create a file based on multiple files

Hey everyone. I am trying to figure out a way to create a file that will be renamed based off of one of multiple files. For example, if I have 3 files (cat.ctl, dog.ctl, and bird.ctl) that gets placed on to an ftp site I want to create a single file called new.cat.ctl, new.dog.ctl, etc for each... (3 Replies)
Discussion started by: coach5779
3 Replies

3. Shell Programming and Scripting

duplicate row based on single column

I am a newbie to shell scripting .. I have a .csv file. It has 1000 some rows and about 7 columns... but before I insert this data to a table I have to parse it and clean it ..basing on the value of the first column..which a string of phone number type... example below.. column 1 ... (2 Replies)
Discussion started by: mitr
2 Replies

4. Shell Programming and Scripting

Combining multiple rows in single row based on certain condition using awk or sed

Hi, I'm using AIX(ksh shell). > cat temp.txt "a","b",0 "c",bc",0 "a1","b1",0 "cc","cb",1 "cc","b2",1 "bb","bc",2 I want the output as: "a","b","c","bc","a1","b1" "cc","cb","cc","b2" "bb","bc" I want to combine multiple lines into single line where third column is same. Is... (1 Reply)
Discussion started by: samuelray
1 Replies

5. Shell Programming and Scripting

Subtracting each row from the first row in a single column file using awk

Hi Friends, I have a single column data like below. 1 2 3 4 5 I need the output like below. 0 1 2 3 4 where each row (including first row) subtracting from first row and the result should print below like the way shown in output file. Thanks Sid (11 Replies)
Discussion started by: ks_reddy
11 Replies

6. Shell Programming and Scripting

Single command to create multiple empty files(no trailing lines as well).

Hi, i need a single command to create multiple empty files(no trailing lines as well) and empty the files if already existing. please let me know or if this has been ansered, if some ocan share the link please, thanks > newfile.txt or :> newfile.txt do not work (4 Replies)
Discussion started by: Onkar Banerjee
4 Replies

7. Shell Programming and Scripting

Converting a single row to multiple rows

Hi, I want to convert a single row values to multiple rows, but the no. of rows are not fixed. For example, I have a row as below abc-def-lmn-mno-xyz out put should be get abc get def get lmn get xyz (4 Replies)
Discussion started by: Suneel Mekala
4 Replies

8. Shell Programming and Scripting

awk Parse And Create Multiple Files Based on Field Value

Hello: I am working parsing a large input file which will be broken down into multiples based on the second field in the file, in this case: STORE. The idea is to create each file with the corresponding store number, for example: Report_$STORENUM_$DATETIMESTAMP , and obtaining the... (7 Replies)
Discussion started by: ec012
7 Replies

9. Shell Programming and Scripting

Split a single file into multiple files based on a value.

Hi All, I have the sales_data.csv file in the directory as below. SDDCCR; SOM ; MD6546474777 ;05-JAN-16 ABC ; KIRAN ; CB789 ;04-JAN-16 ABC ; RAMANA; KS566767477747 ;06-JAN-16 ABC ; KAMESH; A33535335 ;04-JAN-16 SDDCCR; DINESH; GD6674474747 ;08-JAN-16... (4 Replies)
Discussion started by: ROCK_PLSQL
4 Replies

10. Shell Programming and Scripting

Splitting single row into multiple rows based on for every 10 digits of last field of the row

Hi ALL, We have requirement in a file, i have multiple rows. Example below: Input file rows 01,1,102319,0,0,70,26,U,1,331,000000113200000011920000001212 01,1,102319,0,1,80,20,U,1,241,00000059420000006021 I need my output file should be as mentioned below. Last field should split for... (4 Replies)
Discussion started by: kotra
4 Replies

LEARN ABOUT DEBIAN

rdup-up

RDUP-UP(1)							       rdup								RDUP-UP(1)

NAME

       rdup-up - update a directory tree with a rdup archive

SYNOPSIS

       rdup-up [OPTION]...  DIRECTORY

DESCRIPTION

       With rdup-up you can update an (possibly) existing directory structure with a rdup archive.

       The rdup archive has to be given to rdup-up's standard input.

   Username and uids
       rdup  outputs  both  the  username  and	uid, the receiving system (which may be a totally different system) checks if the username and uid
       match. If the username and uid don't match the (numeric) uid is used on the file. The same holds true for the groupname and gid.

OPTIONS

       -n     Do a dry-run and do not create anything on disk.

       -t     Create DIRECTORY (ala mkdir -p) if it does not exist.

       -s N   Strip N path components from a pathname. If the resulting pathname is empty after this operation it is skipped. Be  careful  however
	      with the following structure:

		  /foo
		  /foo/bar
		  /foo/bar/bla.txt
		  /foo/blork/bla.txt

	      With rdup-up -s2 this will leave:

		  <empty>
		  <empty>
		  /bla.txt
		  /bla.txt

	      And the last 'bla.txt' will overwrite the previous one, this will happen without warnings.

       -r PATH
	      This option is related to the -s option, but works different. The string PATH is removed from (the beginning of) each pathname. With
	      -r /home/backup the pathname /home/backup/bin/mycmd becomes /bin/mycmd. The same could be done with -s 2, but then you need to count
	      the slashes. Note -s is always performed before -r.

       -v     Be more verbose and echo the processed files to standard output.

       -vv    Be even more verbose and echo processed file and the uid and gid information to standard output.

       -T     Show  a  table  of  contents of the rdup stream received (ala tar -tf -).  With -T the directory argument is optional. -T unsets any
	      verbose (-v) options.

       -h     A short help message.

       -V     Show the version.

EXIT CODE

       rdup-up return a zero exit code on success, otherwise 1 is returned.

AUTHOR

       Written by Miek Gieben.

REPORTING BUGS

       Report bugs to <miek@miek.nl>.

SEE ALSO

       http:/www.miek.nl/projects/rdup/ is the main site of rdup. Also see rdup(1), rdup-tr(1) and rdup-backups(7).

COPYRIGHT

       Copyright (C) 2005-2010 Miek Gieben. This is free software. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A	PARTICULAR
       PURPOSE.

       Licensed under the GPL version 3. See the file LICENSE in the source distribution of rdup.

1.1.11								    13 Dec 2008 							RDUP-UP(1)
All times are GMT -4. The time now is 08:59 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy