Removing duplicates in fixed width file which has multiple key columns Post: 302745161

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Combining Two fixed width columns to a variable length file

Hi, I have two files. File1: File1 contains two fixed width columns ID of 15 characters length and Name is of 100 characters length. ID Name 1-43<<11 spaces>>Swapna<<94 spaces>> 1-234<<10 spaces>>Mani<<96 spaces>> 1-3456<<9 spaces>>Kapil<<95 spaces>> File2: ...

2. Shell Programming and Scripting

Removing \n within a fixed width record

I am trying to remove a line feed (\n) within a fixed width record. I tried the tr -d �\n' command, but it also removes the record delimiter. Is there a way to remove the line feed without removing the record delimiter?

3. Shell Programming and Scripting

Removing inserted newlines from a fileld of fixed width file.

Hi champs! I have a fixed width file in which the records appear like this 11111 <fixed spaces such as 6> description for 11111 <fixed spaces such as 6> some more field to the record of 11111 22222 <fixed spaces such as 6> description for 22222 <fixed spaces such as 6> some more field to the...

4. Shell Programming and Scripting

Printing Fixed Width Columns

Hi everyone, I have been working on a pretty laborious shellscript (with bash) the last couple weeks that parses my firewall policies (from a Juniper) for me and creates a nifty little columned output. It does so using awk on a line by line basis to pull out the appropriate pieces of each...

5. UNIX for Dummies Questions & Answers

Remove duplicates based on a column in fixed width file

Hi, How to output the duplicate record to another file. We say the record is duplicate based on a column whose position is from 2 and its length is 11 characters. The file is a fixed width file. ex of Record: DTYU12333567opert tjhi kkklTRG9012 The data in bold is the key on which...

6. UNIX for Dummies Questions & Answers

Removing duplicates based on key

Hi, I have the input file with the below data: 12345|12|34 12345|13|23 3456|12|90 15670|12|13 12345|10|14 3456|12|13 I need to remove the duplicates based on the first field only. I need the output like: 12345|12|34 3456|12|90 15670|12|13 The first field needs to be unique .

7. Shell Programming and Scripting

How to parse fixed-width columns which may include empty fields?

I am trying to selectively display several columns from a db2 query, which gives me a fixed-width output (partial output listed here): --------- -------------------------- ------------ ------ 000 0000000000198012 702 29 000 0000000000198013 ...

8. Shell Programming and Scripting

Remove Duplicates on multiple Key Columns and get the Latest Record from Date/Time Column

Hi Experts , we have a CDC file where we need to get the latest record of the Key columns Key Columns will be CDC_FLAG and SRC_PMTN_I and fetch the latest record from the CDC_PRCS_TS Can we do it with a single awk command. Please help....

9. Shell Programming and Scripting

Removing duplicates from delimited file based on 2 columns

Hi guys,Got a bit of a bind I'm in. I'm looking to remove duplicates from a pipe delimited file, but do so based on 2 columns. Sounds easy enough, but here's the kicker... Column #1 is a simple ID, which is used to identify the duplicate. Once dups are identified, I need to only keep the one...

LEARN ABOUT FREEBSD

mailq

MAILQ(1)						      General Commands Manual							  MAILQ(1)

NAME

       mailq - print the mail queue

SYNOPSIS

       mailq [-Ac] [-q...]  [-v]

DESCRIPTION

       Mailq prints a summary of the mail messages queued for future delivery.

       The  first  line printed for each message shows the internal identifier used on this host for the message with a possible status character,
       the size of the message in bytes, the date and time the message was accepted into the queue, and the envelope sender of the  message.   The
       second  line  shows  the error message that caused this message to be retained in the queue; it will not be present if the message is being
       processed for the first time.  The status characters are either * to indicate the job is being processed; X to indicate that  the  load	is
       too  high to process the job; and - to indicate that the job is too young to process.  The following lines show message recipients, one per
       line.

       Mailq is identical to ``sendmail -bp''.

       The relevant options are as follows:

       -Ac    Show the mail submission queue specified in /etc/mail/submit.cf instead of the MTA queue specified in /etc/mail/sendmail.cf.

       -qL    Show the "lost" items in the mail queue instead of the normal queue items.

       -qQ    Show the quarantined items in the mail queue instead of the normal queue items.

       -q[!]I substr
	      Limit processed jobs to those containing substr as a substring of the queue id or not when !  is specified.

       -q[!]Q substr
	      Limit processed jobs to quarantined jobs containing substr as a substring of the quarantine reason or not when !	is specified.

       -q[!]R substr
	      Limit processed jobs to those containing substr as a substring of one of the recipients or not when !  is specified.

       -q[!]S substr
	      Limit processed jobs to those containing substr as a substring of the sender or not when !  is specified.

       -v     Print verbose information.  This adds the priority of the message and a single  character  indicator  (``+''  or	blank)	indicating
	      whether  a  warning  message  has  been sent on the first line of the message.  Additionally, extra lines may be intermixed with the
	      recipients indicating the ``controlling user'' information; this shows who will own any programs that are executed on behalf of this
	      message  and  the name of the alias this command expanded from, if any.  Moreover, status messages for each recipient are printed if
	      available.

       Several sendmail.cf options influence the behavior of the mailq utility: The number of items printed  per  queue  group	is  restricted	by
       MaxQueueRunSize	if  that  value  is set.  The status character * is not printed for some values of QueueSortOrder, e.g., filename, random,
       modification, and none, unless a -q option is used to limit the processed jobs.

       The mailq utility exits 0 on success, and >0 if an error occurs.

SEE ALSO

       sendmail(8)

HISTORY

       The mailq command appeared in 4.0BSD.

							   $Date: 2013-11-22 20:51:55 $ 						  MAILQ(1)