Sponsored Content
Top Forums Shell Programming and Scripting Remove lines with unique information in indicated columns Post 302890940 by MadeInGermany on Sunday 2nd of March 2014 02:55:23 PM
Old 03-02-2014
Code:
awk '
NR==FNR {cnt[$2]++; next}
cnt[$2]>1
' infile infile

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove lines with n columns

Hi folks - hope you are all well. I am trying to perform some pre-processing on a data file, to make sure it is in a valid format before performing a data upload. Each row of data in the file should consist of 10 comma delimited fields. Can anyone advise me of a sed/awk command that might... (2 Replies)
Discussion started by: Krispy
2 Replies

2. Shell Programming and Scripting

Remove lines, Sorted with Time based columns using AWK & SORT

Hi having a file as follows MediaErr.log 84 Server1 Policy1 Schedule1 master1 05/08/2008 02:12:16 84 Server1 Policy1 Schedule1 master1 05/08/2008 02:22:47 84 Server1 Policy1 Schedule1 master1 05/08/2008 03:41:26 84 Server1 Policy1 ... (1 Reply)
Discussion started by: karthikn7974
1 Replies

3. Shell Programming and Scripting

Remove All Lines Between Two Unique Lines

Hi all! Im wondering if its possible to remove all lines between two lines. Im working with a document like this: data1 data2 <Remove> data3 data4 </Remove> data5 data6 I need it to end up like this if that possible: data1 data2 data5 data6 There are multiple instances of... (2 Replies)
Discussion started by: Grizzly
2 Replies

4. Shell Programming and Scripting

awk : extracting unique lines based on columns

Hi, snp.txt CHR_A SNP_A BP_A_st BP_A_End CHR_B BP_B SNP_B R2 p-SNP_A p-SNP_B 5 rs1988728 74904317 74904318 5 74960646 rs1427924 0.377333 0.000740085 0.013930081 5 ... (12 Replies)
Discussion started by: genehunter
12 Replies

5. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Discussion started by: krishnix
16 Replies

6. UNIX for Dummies Questions & Answers

remove duplicate lines based on two columns and judging from a third one

hello all, I have an input file with four columns like this with a lot of lines and for example, line 1 and line 5 match because the first 4 characters match and the fourth column matches too. I want to keep the line that has the lowest number in the third column. So I discard line 5.... (5 Replies)
Discussion started by: TheTransporter
5 Replies

7. Shell Programming and Scripting

How to merge columns into lines, using unique keys?

I would really appreciate a sulution for this : invoice# client# 5929 231 4358 231 2185 231 6234 231 1166 464 1264 464 3432 464 1720 464 9747 464 1133 791 4930 791 5496 791 6291 791 8681 989 3023 989 (2 Replies)
Discussion started by: hemo21
2 Replies

8. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies

9. Shell Programming and Scripting

Remove nullable columns in lines

Hi Every one, my requirement is to remove the null columns in line, comma delimiter used For example, A,11,20,30,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, B1,,,,,, gem,plum,kite,,,,gud,bad,,,,,,,,,,,,, B2,kiing,kong,height,,,,,,,,,,,,,,,,,,,,,,,,,rak,,,,,,,,,,,,, B1,,,,,,... (9 Replies)
Discussion started by: skpshell
9 Replies

10. Shell Programming and Scripting

Reading multiple values from multiple lines and columns and setting them to unique variables.

Hello, I would like to ask for help with csh script. An example of an input in .txt file is below, the number of lines varies from file to file and I have 2 or 3 columns with values. I would like to read all the values (probably one by one) and set them to independent unique variables that... (7 Replies)
Discussion started by: FMMOLA
7 Replies
CW(7)							 Miscellaneous Information Manual						     CW(7)

NAME
CW - the international Morse code DESCRIPTION
CW is an abbreviation for "continuous wave", the commonly used technical term for Morse code communication. A basic knowledge or under- standing of Morse code is a requirement for Radio Amateurs and Marine Radio Operators in many parts of the world. MORSE CODE TIMINGS In Morse code, a dot or dash is referred to as an element. The basic timing unit is the dot period. This is the time taken to send a dot, not including any space before or after the dot. The lengths of all other elements are then derived from this basic unit, using the fol- lowing rules: The duration of a dash is three dots. The time between each element (dot or dash) is one dot length. The space between characters is three dot lengths. The space between words is seven dot lengths. The following formula calculates the dot period in microseconds from the Morse code speed in words per minute: dot period = ( 1200000 / speed ) This formula arises from the use of the word PARIS as a 'standard' word for calibrating Morse code speed. PARIS is 50 units long when sent in Morse code. Analysis of English plain-text indicates that the average word is 50 units, including spaces. MORSE CODE CHARACTERS The following list shows the IS0 8859-1 (Latin-1) characters that have commonly understood representations in Morse code: ABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789"$()+-./:;=?_@ and space In addition, following ISO 8859-1 and ISO 8859-2 accented characters are also part of the generally accepted international Morse code: UACOEEANS (S with cedilla), (Z with caron/hacek), Finally, libcw adds the following ASCII characters as extensions to single character procedural signals: <>!&^~ MORSE CODE CHARACTER TABLES The following table shows the Morse code equivalents for the ISO 8859-1, accented ISO 8859-1, and accented ISO 8859-2 characters above. The ASCII portion of this table is taken from the ARRL Handbook, and the accented extensions from various other sources: Ch Code Ch Code Ch Code Ch Code ------------------------------------------------------- A .- B -... C -.-. D -.. E . F ..-. G --. H .... I .. J .--- K -.- L .-.. M -- N -. O --- P .--. Q --.- R .-. S ... T - U ..- V ...- W .-- X -..- Y -.-- Z --.. 0 ----- 1 .---- 2 ..--- 3 ...-- 4 ....- 5 ..... 6 -.... 7 --... 8 ---.. 9 ----. " .-..-. ' .----. $ ...-..- ( -.--. ) -.--.- + .-.-. , --..-- - -....- . .-.-.- / -..-. : ---... ; -.-.-. = -...- ? ..--.. _ ..--.- Ch Code Ch Code ------------------------------------------------- U ..-- A .-.- C -.-.. O ---. E ..-.. A .-..- A .--.- N --.-- S (S+cedilla) ---- (Z+caron/hacek) --..- In addition to the above standard characters, the following characters are conventionally used for punctuation and procedural signals as follows: Ch Code Ch Code Ch Code Ch Code ------------------------------------------------------- " .-..-. ' .----. $ ...-..- ( -.--. ) -.--.- + .-.-. , --..-- - -....- . .-.-.- / -..-. : ---... ; -.-.-. = -...- ? ..--.. _ ..--.- @ .--.-. and the following are non-conventional extensions implemented by libcw: Ch Code Ch Code Ch Code Ch Code ----------------------------------------------------- < ...-.- > -...-.- ! ...-. & .-... ^ -.-.- ~ .-.-.. An alternative view of punctuation and procedural signals is as combination Morse characters: Ch Prosig Ch Prosig Ch Prosig Ch Prosig --------------------------------------------------------- " [AF] ' [WG] $ [SX] ( [KN] ) [KK] + [AR] , [MIM] - [DU] . [AAA] / [DN] : [OS] ; [KR] = [BT] ? [IMI] _ [IQ] @ [AC] < [VA],[SK] > [BK] ! [SN] & [AS] ^ [KA] ~ [AL] NOTES
Despite the fact that this manual page constantly and consistently refers to Morse code elements as dots and dashes, DO NOT think in these terms when trying to learn Morse code. Always think of them as 'dit's and 'dah's. SEE ALSO
Man pages for libcw(3,LOCAL), cw(1,LOCAL), cwgen(1,LOCAL), cwcp(1,LOCAL), and xcwcp(1,LOCAL). CW Tutor Package CW(7)
All times are GMT -4. The time now is 02:31 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy