Splitting help required Post: 302935951

Sponsored Content

Top Forums Shell Programming and Scripting Splitting help required Post 302935951 by Scrutinizer on Friday 20th of February 2015 12:56:11 PM

02-20-2015

Moderator

Hi, try this approach which tries to distribute the records over n files (and therefore you do not need to provide a maximum number of records), while keeping records with the same $2 together..

Code:

awk -v  n=4 -v fname=outfile '
  BEGIN {
    FS=OFS="|"
    m=1
  }
  p!=$2 {
    if(NR>1) {
      A[m]+=sz
      f=fname m
      printf "%s",s>f
    }
    m=1
    for(i=2; i<=n; i++)
      if(A[m]>A[i])
        m=i
    s=x
    sz=0
    p=$2
  }
  {
    s=s $0 ORS 
    sz++
  }
  END {
    if(NR>1)printf "%s",s>f
  }
' file

Code:

$ for i in outfile{1..4}; do echo "$i"; cat "$i"; done
outfile1
01|00010103|00025.00
01|00010103|00045.00
01|00010103|00080.00
01|00010103|00067.00
01|00010103|00067.95
outfile2
01|00010287|00025.00
01|00010287|00045.00
01|00010287|00080.00
01|00010287|00067.00
outfile3
01|00010299|00025.00
01|00010299|00045.00
01|00010299|00080.00
01|00010299|00067.00
01|00010299|00067.95
outfile4
01|00010500|00025.00
01|00010500|00067.95
01|00010724|00025.00
01|00010724|00045.00

Last edited by Scrutinizer; 02-21-2015 at 09:06 AM..

Scrutinizer

View Public Profile for Scrutinizer

Find all posts by Scrutinizer

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Splitting the input value

Hi, I have a Variable Char field coming whose value looks like below 562432569856 I need to extract 2 characters from it till the end and put it elsewhere say 56 24 32 56 98 56 in this case. Any input is appreciated.

2. UNIX for Dummies Questions & Answers

Splitting a line

I have a series of .txt files, that contain lines of text separated by the following string ==================== In some of the .txt files, the string ends with the word Document, leaving the string ==================Document. I would like to be able to split any such line and move the word...

3. Shell Programming and Scripting

Need help in splitting the file

Hi, I got a file which may have 100 - 500 rows with header and trailer... based on the total number of real rows ( excluding header and trailer) I want to break the file in 3 or 4 files .. Coded like this .. but giving error in the AWK in 8th line of below code. awk 'NR > 5 {print line}...

4. Shell Programming and Scripting

Getting required fields from a test file in required fromat in unix

My data is something like shown below. date1 date2 aaa bbbb ccccc date3 date4 dddd eeeeeee ffffffffff ggggg hh I want the output like this date1date2 aaa eeeeee I serached in the forum but didn't find the exact matching solution. Please help.

5. Shell Programming and Scripting

help in splitting

Hi experts, In the lines below I am trying to copy only the words which come after "//" into an array short nloh; // Comments int age; // Age of the person Please help me in achieving this After the code, the output of the array should Comments Age of the person

6. Shell Programming and Scripting

need help in splitting the file

hi i have file with the format as below. header and associated company details company,accno,accname,amount abc,123,checking,100 abc,234,saving,200 company,accno,accname,amount def,678,checking,100 def,222,saving,200 company,accno,accname,amount dfdf,567,checking,100...

7. Shell Programming and Scripting

splitting value

Hello, i want to take a one word from my file. -- myfile.txt -- test blablabla suPHP_ConfigPath /home/performe/etc blablabla etc. bla bla. -- myfile.txt -- How can i take performe from this file ? Thank you.

8. Shell Programming and Scripting

Help required in Splitting a xml file into multiple and appending it in another .xml file

HI All, I have to split a xml file into multiple xml files and append it in another .xml file. for example below is a sample xml and using shell script i have to split it into three xml files and append all the three xmls in a .xml file. Can some one help plz. eg: <?xml version="1.0"?>...

9. Shell Programming and Scripting

Help with splitting of file

Hi, I'm beginner in UNIX I would like to split file in separate files depending on Pattern. Input file looks like:-A B C brfbeg A B C brfbeg A B C brfbeg . . n so on

10. Shell Programming and Scripting

Splitting a file

I have a source file where a record starts with # entry-id: followed by a number. i want to move the record in file 1 iff the second row is "dn: uid=.*,ou=perm,dc=mssb,dc=com" and the record to file 2 if contents of second row anything else # entry-id: 1 dn:...

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Splitting the input value

Discussion started by: thumsup9

2. UNIX for Dummies Questions & Answers

Splitting a line

Discussion started by: spindoctor

3. Shell Programming and Scripting

Need help in splitting the file

Discussion started by: Vaddadi

4. Shell Programming and Scripting

Getting required fields from a test file in required fromat in unix

Discussion started by: rdhanek

5. Shell Programming and Scripting

help in splitting

Discussion started by: ramakanth_burra

6. Shell Programming and Scripting

need help in splitting the file

Discussion started by: dsdev_123

7. Shell Programming and Scripting

splitting value

Discussion started by: SAYGIN

8. Shell Programming and Scripting

Help required in Splitting a xml file into multiple and appending it in another .xml file

Discussion started by: ganesan kulasek

9. Shell Programming and Scripting

Help with splitting of file

Discussion started by: Rohit_Mokal

10. Shell Programming and Scripting

Splitting a file

Discussion started by: r_t_1601