Sponsored Content
Top Forums Shell Programming and Scripting Split a file into multiple files based on line numbers and first column value Post 302636391 by sarav.shan on Monday 7th of May 2012 11:05:29 AM
Old 05-07-2012
Split a file into multiple files based on line numbers and first column value

Hi All
I have one query,say i have a requirement like the below code should be
move to diffent files whose maximum lines can be of 10 lines.Say in the below example,it consist of 14 lines.
This should be moved logically using the data in the fisrt coloumn to file1 and file 2.The data of first coloum should
not be present in both files(file 1 and file2 for a value i.e in the below example 102103 should be in on file only.In the below
example 102103 has 8 lines and i cannot place all in file 1 bcos it will exceed the maximum lines of file(10) .
Input
Code:
102100|LName|Gender|Company|Branch|Bday|Salary|Age
102100|bbbb|male|cccc|dddd|19900814|15000|20|
102101|asdg|male|gggg|ksgu|19911216|||
102102|bdbm|male|kkkk|acke|19931018||23|
102102|kfjg|male|kkkc|gkgg|19921213|14000|24|
102102|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|

Output should be like below:
File 1:
Code:
102100|LName|Gender|Company|Branch|Bday|Salary|Age
102100|bbbb|male|cccc|dddd|19900814|15000|20|
102101|asdg|male|gggg|ksgu|19911216|||
102102|bdbm|male|kkkk|acke|19931018||23|
102102|kfjg|male|kkkc|gkgg|19921213|14000|24|
102102|bprb|male|cccc|pppp||15000|20|

File 2
Code:
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|
102103|kfjg|male|kkkc|gkgg|19921213|14000|24|
102103|bprb|male|cccc|pppp||15000|20|

Thanks in advance.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Split single file into multiple files based on the number in the column

Dear All, I would like to split a file of the following format into multiple files based on the number in the 6th column (numbers 1, 2, 3...): ATOM 1 N GLY A 1 -3.198 27.537 -5.958 1.00 0.00 N ATOM 2 CA GLY A 1 -2.199 28.399 -6.617 1.00 0.00 ... (3 Replies)
Discussion started by: tomasl
3 Replies

2. Shell Programming and Scripting

Split a file into multiple files based on the input pattern

I have a file with lines something like. ...... 123_start ...... ....... 123_end .... ..... 456_start ...... ..... 456_end .... ..... 789_start .... .... 789_end (6 Replies)
Discussion started by: abinash
6 Replies

3. Shell Programming and Scripting

split XML file into multiple files based on pattern

Hello, I am using awk to split a file into multiple files using command: nawk '{ if ( $1 == "<process" ) { n=split($2, arr, "\""); file=arr } print > file }' processes.xml <process name="Process1.process"> ... (3 Replies)
Discussion started by: chiru_h
3 Replies

4. Shell Programming and Scripting

Split a file into multiple files based on field value

Hi, I've one requirement. I have to split one comma delimited file into multiple files based on one of the column values. How can I achieve this Unix Here is the sample data. In this case I have split the files based on date column(c4) Input file c1,c2,c3,c4,c5... (1 Reply)
Discussion started by: manasvi24
1 Replies

5. Shell Programming and Scripting

How to split file into multiple files using awk based on 1 field in the file?

Good day all I need some helps, say that I have data like below, each field separated by a tab DATE NAME ADDRESS 15/7/2012 LX a.b.c 15/7/2012 LX1 a.b.c 16/7/2012 AB a.b.c 16/7/2012 AB2 a.b.c 15/7/2012 LX2 a.b.c... (2 Replies)
Discussion started by: alexyyw
2 Replies

6. Shell Programming and Scripting

awk script to split file into multiple files based on many columns

So I have a space delimited file that I'd like to split into multiple files based on multiple column values. This is what my data looks like 1bc9A02 1 10 1000 FTDLNLVQALRQFLWSFRLPGEAQKIDRMMEAFAQRYCQCNNGVFQSTDTCYVLSFAIIMLNTSLHNPNVKDKPTVERFIAMNRGINDGGDLPEELLRNLYESIKNEPFKIPELEHHHHHH 1ku1A02 1 10... (9 Replies)
Discussion started by: viored
9 Replies

7. Shell Programming and Scripting

Split a big file into multiple files based on first four characters

I have a requirement to split a huge file to smaller text files based on first four characters which look like ABCD 1234 DFGH RREX : : : : : 0000 Each of these records are OF EQUAL bytes with a different internal layout based on the above first digit identifier.. Any help to start... (5 Replies)
Discussion started by: etldev
5 Replies

8. Shell Programming and Scripting

Extracting values based on line-column numbers from multiple text files

Dear All, I have to solve the following problems with multiple tab-separated text file but I don't know how. Any help would be greatly appreciated. I have access to Linux mint (but not as a professional). I have multiple tab-delimited files with the following structure: file1: 1 44 2 ... (5 Replies)
Discussion started by: Bastami
5 Replies

9. Shell Programming and Scripting

Split a single file into multiple files based on a value.

Hi All, I have the sales_data.csv file in the directory as below. SDDCCR; SOM ; MD6546474777 ;05-JAN-16 ABC ; KIRAN ; CB789 ;04-JAN-16 ABC ; RAMANA; KS566767477747 ;06-JAN-16 ABC ; KAMESH; A33535335 ;04-JAN-16 SDDCCR; DINESH; GD6674474747 ;08-JAN-16... (4 Replies)
Discussion started by: ROCK_PLSQL
4 Replies

10. UNIX for Beginners Questions & Answers

Split file into multiple files based on empty lines

I am using below code to split files based on blank lines but it does not work. awk 'BEGIN{i=0}{RS="";}{x="F"++i;}{print > x;}' Your help would be highly appreciated find attachment of sample.txt file (2 Replies)
Discussion started by: imranrasheedamu
2 Replies
ILINK(1)						      General Commands Manual							  ILINK(1)

NAME
ilink - GEMINI optimization procedure to find a locally optimal value of the theta vector of recombination fractions SYNOPSIS
ilink [options] ipedfile.dat pedfile.dat DESCRIPTION
This manual page documents briefly the ilink command. In fact this is a very raw intend to provide a manpage because the Debian GNU/Linux distribution requires each program to have a manpage. Any enhancement would be greatly apreciated. ilink is part of the fastlink software package. ILINK uses the GEMINI optimization procedure to find a locally optimal value of the theta vector of recombination fractions. If you use the default scripts produced by lcp, your initial guess for theta is .1 in every dimension. GEMINI evaluates each theta by its likelihood, seeking to find theta vectors that have a higher pedigree likelihood. The GEMINI procedure has multiple iterations. Each iteration corresponds to one line of output. Each iteration includes multiple likelihood function evaluations. Each iteration has two phases. In Phase I GEMINI seeks to improve the current best theta. In Phase II, GEMINI esti- mates the gradient of the likelihood with respect to the current best theta vector. In the first iteration, Phase I only evaluates the likelihood at the initial candidate theta. When ILINK prints out a line such as: maxcensor can be reduced to -32767, it has completed the first likelihood function evaluation. On long runs, this fact can be used to estimate running time. A reasonable rough estimate for the number of function evaluations is 10*(number of dimensions of theta vector). The number of dimensions of the theta vector is one fewer than the number of loci in most cases. If male- theta and femaletheta are allowed to differ (sexdif is set to 1), then the number of dimensions doubles to 2 * (number of loci - 1). Esti- mating other parameters (with fitmodel set to true) can also increase the number of dimensions. To learn more about ilink it might be useful to read the file /usr/share/doc/fastlink/README.ILINK if you have a Debian GNU/Linux system. OPTIONS
There might be options but I did not found any information about them. Please foreward any information about them to <tille@debian.org> SEE ALSO
linkmap(1), lodscore(1), mlink(1), unknown(1). Word-Wide-Web: http://www.ncbi.nlm.nih.gov/CBBResearch/Schaffer/fastlink.html AUTHOR
: Alejandro Schaeffer <schaffer@helix.nih.gov> and others This manual page was written by Andreas Tille <tille@debian.org>, for the Debian GNU/Linux system (but may be used by others). April 15, 2003 ILINK(1)
All times are GMT -4. The time now is 05:27 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy