Hi,
I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g.
COL1 COL2 COL3
A 1234 1234
B 3k32 2322
C Xk32 TTT
A NEW XX22
B 3k32 ... (7 Replies)
Hi,
Need to find a duplicate records on the first column,
ANU4501710430989 0000000W20389390
ANU4501710430989 0000000W67065483
ANU4501130050520 0000000W80838713
ANU4501210170685 0000000W69246611... (3 Replies)
Hi,
I want to remove duplicate records including the first line based on column1. For example
inputfile(filer.txt):
-------------
1,3000,5000
1,4000,6000
2,4000,600
2,5000,700
3,60000,4000
4,7000,7777
5,999,8888
expected output:
----------------
3,60000,4000
4,7000,7777... (5 Replies)
I was reading this thread. It looks like a simpler way to say this is to only keep uniq lines based on field or column 1.
https://www.unix.com/shell-programming-scripting/165717-removing-duplicate-records-file-based-single-column.html
Can someone explain this command please? How are there no... (5 Replies)
Hello experts,
I have a requirement where I have to implement two checks on a csv file:
1. Check to see if the value in first column is duplicate, if any value is duplicate script should exit.
2. Check to verify if the value at second column is between "yes" or "no", if it is anything else... (4 Replies)
Input
1,ABCD,no
2,system,yes
3,ABCD,yes
4,XYZ,no
5,XYZ,yes
6,pc,noCode used to find duplicate with regard to 2nd column
awk 'NR == 1 {p=$2; next} p == $2 { print "Line" NR "$2 is duplicated"} {p=$2}' FS="," ./input.csv
Now is there a wise way to de-duplicate the entire line (remove... (4 Replies)
Hello,
I have a script that is generating a tab delimited output file.
num Name PCA_A1 PCA_A2 PCA_A3
0 compound_00 -3.5054 -1.1207 -2.4372
1 compound_01 -2.2641 0.4287 -1.6120
3 compound_03 -1.3053 1.8495 ... (3 Replies)
Hi Gurus,
I have a file(weblog) as below
abc|xyz|123|agentcode=sample code abcdeeess,agentcode=sample code abcdeeess,agentcode=sample code abcdeeess|agentadd=abcd stereet 23343,agentadd=abcd stereet 23343
sss|wwq|999|agentcode=sample1 code wqwdeeess,gentcode=sample1 code... (4 Replies)
I have csv file with 30, 40 columns
Pasting just three column for problem description
I want to filter record if column 1 matches CN or DN then,
check for values in column 2 if column contain 1235, 1235 then in column 3 values must be sequence of 2345, 2345
and if column 2 contains 6789, 6789... (5 Replies)
Hi Experts,
I have csv file with 30, 40 columns
Pasting just 2 column for problem description.
Need to print error if below combination is not present in file
check for column-1 (DocumentNumber) and filter columns where value in DocumentNumber field is same.
For all such rows, the field... (7 Replies)
Discussion started by: as7951
7 Replies
LEARN ABOUT OSX
tabs
TABS(1) BSD General Commands Manual TABS(1)NAME
tabs -- set terminal tabs
SYNOPSIS
tabs [-n | -a | -a2 | -c | -c2 | -c3 | -f | -p | -s | -u] [+m[n]] [-T type]
tabs [-T type] [+[n]] n1[,n2,...]
DESCRIPTION
The tabs utility displays a series of characters that clear the hardware terminal tab settings then initialises tab stops at specified posi-
tions, and optionally adjusts the margin.
In the first synopsis form, the tab stops set depend on the command line options used, and may be one of the predefined formats or at regular
intervals.
In the second synopsis form, tab stops are set at positions n1, n2, etc. If a position is preceded by a '+', it is relative to the previous
position set. No more than 20 positions may be specified.
If no tab stops are specified, the ``standard'' UNIX tab width of 8 is used.
The options are as follows:
-n Set a tab stop every n columns. If n is 0, the tab stops are cleared but no new ones are set.
-a Assembler format (columns 1, 10, 16, 36, 72).
-a2 Assembler format (columns 1, 10, 16, 40, 72).
-c COBOL normal format (columns 1, 8, 12, 16, 20, 55)
-c2 COBOL compact format (columns 1, 6, 10, 14, 49)
-c3 COBOL compact format (columns 1, 6, 10, 14, 18, 22, 26, 30, 34, 38, 42, 46, 50, 54, 58, 62, 67).
-f FORTRAN format (columns 1, 7, 11, 15, 19, 23).
-p PL/1 format (columns 1, 5, 9, 13, 17, 21, 25, 29, 33, 37, 41, 45, 49, 53, 57, 61).
-s SNOBOL format (columns 1, 10, 55).
-u Assembler format (columns 1, 12, 20, 44).
+m[n], +[n]
Set an n character left margin, or 10 if n is omitted.
-T type
Output escape sequence for the terminal type type.
ENVIRONMENT
The LANG, LC_ALL, LC_CTYPE and TERM environment variables affect the execution of tabs as described in environ(7).
The -T option overrides the setting of the TERM environment variable. If neither TERM nor the -T option are present, tabs will fail.
EXIT STATUS
The tabs utility exits 0 on success, and >0 if an error occurs.
SEE ALSO expand(1), stty(1), tput(1), unexpand(1), termcap(5)STANDARDS
The tabs utility conforms to IEEE Std 1003.1-2001 (``POSIX.1'').
HISTORY
A tabs utility appeared in PWB UNIX. This implementation was introduced in FreeBSD 5.0.
BUGS
The current termcap(5) database does not define the 'ML' (set left soft margin) capability for any terminals.
BSD May 20, 2002 BSD