Visit Our UNIX and Linux User Community

how to group records in a file

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting how to group records in a file
# 1  
Old 09-04-2009
how to group records in a file

I have records like this,127,569,BRAD,25/08/2009 23:59,127,569,BRAD,25/08/2009 23:59,159,1170,DAVE,25/08/2009 23:59,159,1181,HALE,25/08/2009 23:59,393,1209,CAPIT,25/08/2009 23:59,457,571,NORTT,25/08/2009 23:59,460,4184,OKEEC,25/08/2009 23:59

I want to group records like this into different files
-----------,127,569,BRAD,25/08/2009 23:59,127,569,BRAD,25/08/2009 23:59
-----,159,1170,DAVE,25/08/2009 23:59,159,1181,HALE,25/08/2009 23:59
-----,393,1209,CAPIT,25/08/2009 23:59
-----,457,571,NORTT,25/08/2009 23:59
-----,460,4184,OKEEC,25/08/2009 23:59

can any one help me on this?
# 2  
Old 09-04-2009
Something like this?

awk -F, 'f!=$1{close(f);f=$1}{print > f}' file

# 3  
Old 09-09-2009
hi franklin,
the solution you gave worked
thanks a lot
can you please explain how it is working
# 4  
Old 09-09-2009
awk -F,

Set field separator


Close file (variable f = filename) if $1 != filename...


...and assign new filename to f

{print > f}

print the line to the file
# 5  
Old 09-09-2009
thanks for your reply Franklin

Previous Thread | Next Thread
Test Your Knowledge in Computers #768
Difficulty: Medium
Smart cache, developed by AMD, is a level 2 or level 3 caching method for multiple execution cores
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

To group records in the file in UNIX

Hi All, I am using RHEL 6.9. I got a requirement to group the records in a file.The file content as shown below. #### FAILED JOBS IN XXX ##### 1> ABCD failed in the project XXX 2> HJK Job is in compiled state in the project XXX 3> ILKD failed in the project XXX 4> DFG failed in the... (5 Replies)
Discussion started by: ginrkf
5 Replies

2. UNIX for Beginners Questions & Answers

Awk: group multiple fields from different records

Hi, My input looks like that: A|123|qwer A|456|tyui A|456|wsxe B|789|dfgh Using awk, I am trying to get: A|123;456|qwer;tyui;wsxe B|789|dfgh For records with same $1, group all the $2 in a field (without replicates), and all the $3 in a field (without replicates). What I have tried:... (6 Replies)
Discussion started by: beca123456
6 Replies

3. Shell Programming and Scripting

Sorting group of records and loading last record

Hi Everyone, I have below record set. File is fixed widht file 101newjersyus 20150110 101nboston us 20150103 102boston us 20140106 102boston us 20140103 I need to group record based on first 3 letters in our case(101 and 102) and sort last 8 digit in ascending order and print only... (4 Replies)
Discussion started by: patricjemmy6
4 Replies

4. UNIX for Advanced & Expert Users

Group the records based on empno and send mail

Hi All, I have records in a file with name,SSO,openitems,manageremail with | delimited file.Now i want to group the records by SSO and openitems and send email to their manageremail. kiran|1111|draft| guna|2222|reject| kiran|1111|submitter| (2 Replies)
Discussion started by: kiranparsha
2 Replies

5. UNIX for Dummies Questions & Answers

keeping last record among group of records with common fields (awk)

input: ref.1;rack.1;1 #group1 ref.1;rack.1;2 #group1 ref.1;rack.2;1 #group2 ref.2;rack.3;1 #group3 ref.2;rack.3;2 #group3 ref.2;rack.3;3 #group3 Among records from same group (i.e. with same 1st and 2nd field - separated by ";"), I would need to keep the last record... (5 Replies)
Discussion started by: beca123456
5 Replies

6. Infrastructure Monitoring

Processing records as group - awk

I have a file has following records policy glb id 1233 name Permit ping from "One" to "Second" "Address1" "Any" "ICMP-ANY" permit policy id 999251 service "snmp-udp" exit policy glb id 1234 name Permit telnet from "One" to "Second" "Address2" "Any" "TCP-ANY" permit policy id 1234... (3 Replies)
Discussion started by: baskar
3 Replies

7. Shell Programming and Scripting

KSH to group records in a file and compare it with another file

Hi, I've a file like below: DeptFile.csv DeptID EmpID ------- ------ Dep01 Emp01 Dep01 Emp02 Dep01 Emp03 Dep02 Emp04 Dep02 Emp05 I've another file which has EmpFile.csv EmpID Salary ------ ------ (3 Replies)
Discussion started by: Matrix2682
3 Replies

8. Shell Programming and Scripting

command to group records

hi, i have records like this supplier,product, persons involved 10,150, 30,200, 20,111, 40,211, i want to write a command which displays values like this 10,30,40, for if there are n number of... (7 Replies)
Discussion started by: trichyselva
7 Replies

9. Shell Programming and Scripting

Column sum group by uniq records

Dear All, I want to get help for below case. I have a file like this. saman 1 gihan 2 saman 4 ravi 1 ravi 2 so i want to get the result, saman 5 gihan 2 ravi 3 like this. Pls help me. (17 Replies)
Discussion started by: Nayanajith
17 Replies

10. UNIX for Advanced & Expert Users

find and group records in a file

Hi, I have this file which has 3 columns, District , stores and unit. What I want is all rows belonging to one district to be created separately under each district, the districts may vary every day , the source file may have 3 districts today and may have 160 tomorrow, so what I need is a... (20 Replies)
Discussion started by: thumsup9
20 Replies

Featured Tech Videos