Sponsored Content
Top Forums Shell Programming and Scripting Issues with filtering duplicate records using gawk script Post 302305849 by vidyadhar85 on Friday 10th of April 2009 12:07:24 AM
Old 04-10-2009
whats the problem you are facing??
1.Trade file will be sorted in ascending order on first two columns(COB date and trade id)
2.Trade file will be sorted in descending order on first two columns(COB date and trade id)
i didn't understand above two condition..
why do you want it to sort it in both ways ??
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Filtering duplicate lines

Does anybody know a command that filters duplicate lines out of a file. Similar to the uniq command but can handle duplicate lines no matter where they occur in a file? (9 Replies)
Discussion started by: AreaMan
9 Replies

2. UNIX for Dummies Questions & Answers

Filtering records of a file based on a value of a column

Hi all, I would like to extract records of a file based on a condition. The file contains 47 fields, and I would like to extract only those records that match a certain value in one of the columns, e.g. COL1 COL2 COL3 ............... COL47 1 XX 45 ... (4 Replies)
Discussion started by: risk_sly
4 Replies

3. Linux

Need awk script for removing duplicate records

I have huge txt file having millions of trade data. For e.g Trade.txt (first 8 lines in the file is header info) COB_DATE,TRADE_ID,SOURCE_SYSTEM_TRADE_ID,TRADE_GROUP_ID, TRADE_TYPE,DEALER_NAME,EXTERNAL_COUNTERPARTY_ID, EXTERNAL_COUNTERPARTY_NAME,DB_COUNTERPARTY_ID,... (6 Replies)
Discussion started by: nmumbarkar
6 Replies

4. Shell Programming and Scripting

Filtering issues with multiple columns in a single file

Hi, I am new to unix and would greatly appreciate some help. I have a file containing multiple colums containing different sets of data e.g. File 1: John Ireland 27_December_69 Mary England 13_March_55 Mike France 02_June_80 I am currently using the awk... (10 Replies)
Discussion started by: crunchie
10 Replies

5. Shell Programming and Scripting

Filtering Issues Using sed and awk

Hi, I am currently using the sed and awk commands to filter a file that has multiple sets of data in different columns. An example of part of the file i am filtering is as follows; Sat Oct 2 07:42:45 2010 01:33:46 R1_CAR_12.34 Sun Oct 3 13:09:53 2010 00:02:34 R2_BUS_56.78 Sun... (4 Replies)
Discussion started by: crunchie
4 Replies

6. Shell Programming and Scripting

Filtering issues while using nawk

Hi, I am currently filtering a file that has multiple sets of data. An example of some of the data is as follows; Sat Oct 2 07:42:45 2010 01:33:46 R1_CAR_12.34 Sun Oct 3 13:09:53 2010 00:02:34 R2_BUS_56.78 Sun Oct 3 21:11:39 2010 00:43:21 R3_TRAIN_COACH_90.12 Mon Oct 4... (1 Reply)
Discussion started by: crunchie
1 Replies

7. Linux

Need awk script for removing duplicate records

I have log file having Traffic line 2011-05-21 15:11:50.356599 TCP (6), length: 52) 10.10.10.1.3020 > 10.10.10.254.50404: 2011-05-21 15:11:50.652739 TCP (6), length: 52) 10.10.10.254.50404 > 10.10.10.1.3020: 2011-05-21 15:11:50.652558 TCP (6), length: 89) 10.10.10.1.3020 >... (1 Reply)
Discussion started by: Rastamed
1 Replies

8. Shell Programming and Scripting

Perl: filtering lines based on duplicate values in a column

Hi I have a file like this. I need to eliminate lines with first column having the same value 10 times. 13 18 1 + chromosome 1, 122638287 AGAGTATGGTCGCGGTTG 13 18 1 + chromosome 1, 128904080 AGAGTATGGTCGCGGTTG 13 18 1 - chromosome 14, 13627938 CAACCGCGACCATACTCT 13 18 1 + chromosome 1,... (5 Replies)
Discussion started by: polsum
5 Replies

9. Shell Programming and Scripting

Need help with filtering records in a file

Hi, I have following records in a file more file1.txt setting applicaction ABC for user setting applicaction CDE for user setting applicaction XXX for user logging applicaction XXX for user I need to filter out records which have strings " setting... (5 Replies)
Discussion started by: manid
5 Replies

10. UNIX for Beginners Questions & Answers

Filtering records of a csv file based on a value of a column

Hi, I tried filtering the records in a csv file using "awk" command listed below. awk -F"~" '$4 ~ /Active/{print }' inputfile > outputfile The output always has all the entries. The same command worked for different users from one of the forum links. content of file I was... (3 Replies)
Discussion started by: sunilmudikonda
3 Replies
evmsort(1)						      General Commands Manual							evmsort(1)

NAME
evmsort - sort events SYNOPSIS
show_template]] sport_spec] [filename | DESCRIPTION
The command reads and sorts a stream of EVM events. By default, events are read from and are sorted into ascending timestamp order. Sorted events are written to the command's stream in the form of raw EVM events. The sort order can be specified by supplying a sort_spec, either through the option or by setting the environment variable to the required specification. The specification is a character string of the form: key_item[ The key_item is the name of any EVM standard data item and the character is optional. If the special key_item is specified, the event's data item is expanded as described in the evmshow(1) manpage, and the resulting string is used as the sort key. The optional trailing or character indicates ascending or descending sort. By default, items are sorted in ascending order. Multiple items in the string are separated by colon characters The left-most key_item in the specification is the most significant key. If a key_item that is included in the sort specification is not present in an event read from the input stream, the item is considered to have a low value for that event. For example, if input events are being sorted in ascending order according to their data items, and one event does not contain a name, that event appears first in the output stream. If the option is specified, automatically starts and pipes the sorted event stream into it, producing a sorted and formatted display of events. If a argument is also specified with the specified template string is passed to through its own option. See the evmshow(1) manpage for more information. Options Automatically starts to produce a formatted display of the sorted events. The specification to be used in sorting events. See the section for the syntax of the sort_spec, and for details of the default sort order. Template string to be passed to if the option is also specified. If the option is not specified, this argument is ignored. See the evmshow(1) manpage for a description of the template string. Operands filename Reads event sources from filename. If filename is omitted, or is specified as event sources are read from EXTERNAL INFLUENCES
Environment Variables The following environment variables affect the execution of This variable contains a string formatted as described for a sort_spec. If the option is omitted, the string is used as the sort_spec. RETURN VALUES
The following exit values are returned: Successful completion. An error occurred. EXAMPLES
o The following example retrieves all events with a priority of 300 or greater, sorts them into descending order of priority (most urgent event first) and then ascending order of time (oldest event first), and automatically runs to display them. o The following example yields a list of all events, sorted with the latest event first within o The following example yields a list of all events, sorted first in order of their formatted messages and then sorted in ascending order of time. Events are passed to for display and subsequently to the command for viewing. WARNINGS
The command rejects attempts to output raw events to a terminal device. SEE ALSO
Commands evmget(1), evmpost(1), evmshow(1), evmwatch(1). Files evmchannel.conf(4). Event Management EVM(5). EVM Events EvmEvent(5). Event Filter EvmFilter(5). evmsort(1)
All times are GMT -4. The time now is 03:25 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy