Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: split records into different files
Top Forums Shell Programming and Scripting split records into different files Post 302556677 by ahamed101 on Monday 19th of September 2011 09:32:35 AM
Old 09-19-2011
Code:
[root@D152153 tmp]# cat input_file
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

[root@D152153 tmp]# awk -v val="$val" 'BEGIN{i=1}{if(t==1){i++;t=0}}
{if($0%val==0){t=1};file="File_"i".txt";print >>file}' input_file

[root@D152153 tmp]# cat File_1.txt
1
2
3
4

[root@D152153 tmp]# cat File_2.txt
5
6
7
8

[root@D152153 tmp]# cat File_3.txt
9
10
11
12

[root@D152153 tmp]# cat File_4.txt
13
14
15

Its working for me. Can you paste your input file?
--ahamed
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

dynamically split the records

Hi, I was wandering would it be possible to split the record dynamically based on the certain values, for an instance i have a file with record with predefined split value i.e 10 col1 col2 col3 col4 ------------------------ aaaa bbbb 2 44aaaabbbb55cccddd1110 mmn xnmn 3... (6 Replies)
Discussion started by: braindrain
6 Replies

2. UNIX for Dummies Questions & Answers

How to split multiple records file in n files

Hello, Each record has a lenght of 7 characters I have 2 types of records 010 and 011 There is no character of end of line. For example my file is like that : 010hello 010bonjour011both 011sisters I would like to have 2 files 010.txt (2 records) hello bonjour and ... (1 Reply)
Discussion started by: jeuffeu
1 Replies

3. UNIX for Advanced & Expert Users

Split records based on '-'

HI, I have a pipe delimiter file , I have to search for second field pattern, if the second field does not contain a '-' , I need to start capturing the record from this line till I find another second field with '-' value. Below is the sample data SOURCE DATA ABC|ABC_702148-PARAM... (3 Replies)
Discussion started by: mora
3 Replies

4. Shell Programming and Scripting

Split records into multiple records

Hi All, I am trying to split a record into multiple records based on a value. Input.txt "A",1,0,10 "B",2,0,10,15,20 "C",3,11,14,16,19,21,23 "D",1,0,5 My desired output is: "A",1,0,10 "B",2,0,10 "B",2,15,20 "C",3,11,14 "C",3,16,19 "C",3,21,23 (4 Replies)
Discussion started by: kmsekhar
4 Replies

5. Shell Programming and Scripting

Split the Master and Child Records

Hi, I receive a file that has Master record followed by one/more Child Records as shown below & also as attached in the file. Now , The key for the child record is from pos 4 to position 80 in the parent record, now the requirement is to create two files 1. Parent file --> has all the parent... (1 Reply)
Discussion started by: KNaveen
1 Replies

6. Shell Programming and Scripting

Split Records

I have a flat file with 2 columns Id,loc 1,nj:ny:pa 2,pa 3,ca:tx:fl:nj Second colum data is seperated by semi colon and can i have many locations for one id Output i need is 1,nj 1,ny 1,pa 1,pa 3,ca 3,tx 3,fl (1 Reply)
Discussion started by: traininfa
1 Replies

7. Shell Programming and Scripting

Split file based on records

I have to split a file based on number of lines and the below command works fine: split -l 2 Inputfile -d OutputfileMy input file contains header, detail and trailor info as below: H D D D D TMy split files for the above command contains: First File: H DSecond File: ... (11 Replies)
Discussion started by: Ajay Venkatesan
11 Replies

8. Shell Programming and Scripting

Split records

Hi I have a file $cat test a,1;2;3 b,4;5;6;7 c,8;9 I want to split each record to multiple based on semicolon in 2nd field. i.e a,1 a,2 a,3 b,4 b,5 (3 Replies)
Discussion started by: Shivdatta
3 Replies

9. Shell Programming and Scripting

How to split one record to multiple records?

Hi, I have one tab delimited file which is having multiple store_ids in first column seprated by pipe.I want to split the file on the basis of store_id(separating 1st record in to 2 records ). I tried some more options like below with using split,awk etc ,But not able to get proper output. can... (1 Reply)
Discussion started by: jaggy
1 Replies

10. Shell Programming and Scripting

Want to grep records in alphabetical order from a file and split into other files

Hi All, I have one file containing thousands of table names in single column. Now I want that file split into multiple files e.g one file containing table names starting from A, other containing all tables starting from B...and so on..till Z. I tried below but it did not work. for i in... (6 Replies)
Discussion started by: shekhar_4_u
6 Replies

LEARN ABOUT DEBIAN

flow-cat

flow-cat(1)						      General Commands Manual						       flow-cat(1)

NAME

       flow-cat -- Concatenate flow files

SYNOPSIS

       flow-cat  [-aghmp]   [-b  big|little]   [-C  comment]   [-d  debug_level]   [-o	filename]   [-t start_time]  [-T start_time]  [-z z_level]
       [file|directory ...]

DESCRIPTION

       The flow-cat utility processes files and/or directories of files in the flow-tools format.  The resulting concatenated data set is  written
       to the standard output or file specified by -o.	If file is a single dash (`-') or absent, flow-cat will read from the standard input.

OPTIONS

       -a	 Do not ignore filenames that begin with tmp.

       -b big|little
		 Byte order of output.

       -C Comment
		 Add a comment.

       -d debug_level
		 Enable debugging.

       -g	 Sort file list by capture start time before processing.

       -h	 Display help.

       -m	 Disable the use of mmap().

       -p	 Preload headers.  Use to preserve meta information such as lost flows.

       -o file	 Write to file instead of the standard out.

       -t start_time
		 Select flow files up to start_time.  If used with -T select files between start_time and end_time.

       -T end_time
		 Select flow files after end_time.  If used with -t select files between start_time and end_time.

       -z z_level
		 Configure compression level to  z_level.  0 is disabled (no compression), 9 is highest compression.

       file|directory...
		 Process the files and/or directory.

TIME
/DATE parsing
       start_time  and	end_time  parsing  is  implemented with getdate.y, a commonly used function to process free-form time date specifications.
       Example usage borrowed from cvs:
	   1 month ago
	   2 hours ago
	   400000 seconds ago
	   last year
	   last Monday
	   yesterday
	   a fortnight ago
	   3/31/92 10:00:07 PST
	   January 23, 1987 10:05pm
	   22:00 GMT

EXAMPLES

       Concatenate all flow files begining with ft-v05.2001-05.01, use flow-print to display the results.

	   flow-cat ft-v05.2001-05-01.* | flow-print

       Concatenate flow files in /flows/krc4, store store the output in compressed.flows at compression level 9 (best).  The headers are preloaded
       so  various  metadata  such  as	the flow count is correct in the result.  Filenames begining with tmp which are typically in-progress flow
       files from flow-capture are not processed.

	   flow-cat -p -z9 /flows/krc4 > compressed.flows

BUGS

       None known.

AUTHOR

       Mark Fullmer maf@splintered.net

SEE ALSO

       flow-tools(1)

																       flow-cat(1)
All times are GMT -4. The time now is 10:39 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy