|
|
Sponsored Content
Top Forums
UNIX for Dummies Questions & Answers
Remove duplicates lines in a files
Post 302737545 by zaxxon on Thursday 29th of November 2012 07:30:54 AM
11-29-2012
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I am writing a shell script that needs to remove duplicate lines within a file by category.
example:
section a
a
c
b
a
section b
a
b
a
c
I need to remove the duplicates within th category with out removing the duplicates from the 2 different sections (one of the a's in section... (1 Reply)
Discussion started by: RichElks
1 Replies
2. Shell Programming and Scripting
I have two files and need to compare the two files and to remove the matching lines from both the files (4 Replies)
Discussion started by: shellscripter
4 Replies
3. Shell Programming and Scripting
Input:
a
b
b
c
d
d
I need:
a
c
I know how to get this (the lines that have duplicates) :
b
d
sort file | uniq -d
But i need opossite of this. I have searched the forum and other places as well, but have found solution for everything except this variant of the problem. (3 Replies)
Discussion started by: necroman08
3 Replies
4. Shell Programming and Scripting
Hi everyone
I have a dilemma and I'm hoping someone has an answer for me.
I have two files:
# cat masterfile
line3
line4
line5
line6
line7
# cat tempfile
line1
line2
line3
line4
I want to compare tempfile with masterfile. (3 Replies)
Discussion started by: soliberus
3 Replies
5. Shell Programming and Scripting
Hi all,
I'm a newbie and I'm sorry if my question is too simple.
I'm having problem to delete the files that have less than certain lines, say 16.
#!/bin/tcsh
set filen = `sh -c 'ls *csv 2> /dev/null'`
foreach fil (${filen})
if ]; then
rm -f ${filen}
fi
end
exit
... (2 Replies)
Discussion started by: GoldenFire
2 Replies
6. Shell Programming and Scripting
Have two files and want to compare the content of file1 with file2. When matched remove the line.
awk 'NR==FNR {b; next} !(b in $0)' file1 file2file1
1. if match
2. removefile2
1. this line has to be removed if match
2. this line has a match, remove
3. this line has no match, no removingThe... (3 Replies)
Discussion started by: sdf
3 Replies
7. Shell Programming and Scripting
Hello,
I need to run a command or shell script that will remove the last 3 lines from every .js file that is under the directory /var/ww/vhost/
Can you please help ?
thank you. (22 Replies)
Discussion started by: MaRiOsGR
22 Replies
8. Shell Programming and Scripting
Hi All, I have two files
file1
123456CRTGHG
125437CRNDGF
126537CRDDGF
file2
123456CRTZHC
124567CJHGHG
125987CJHGDF
I need to compare the two files and any records in file 1 and 2 based on initial n characters (6 in example) need to be ignored.
string separated by unprintable... (2 Replies)
Discussion started by: Bruble
2 Replies
9. Shell Programming and Scripting
I have two files, a keepout.txt and a database.csv. They're unsorted, but could be sorted.
keepout:
user1
buser3
anuser19
notheruser27
database:
user1,2343,"information about",field,blah,34
user2,4231,"mo info",etc,stuff,43
notheruser27,4344,"hiya",thing,more thing,423... (4 Replies)
Discussion started by: esoffron
4 Replies
10. Shell Programming and Scripting
I have two large files (~250GB) that I am trying to remove the where GT: 0/0 or 1/1 or 2/2 for both files. I was going to use a bash with the below awk, which I think will find each line but how do I remove that line is that condition is found? Thank you :).
Input
20 60055 . A ... (4 Replies)
Discussion started by: cmccabe
4 Replies
LEARN ABOUT HPUX
lintian-info
LINTIAN-INFO(1) User Contributed Perl Documentation LINTIAN-INFO(1) NAME
lintian-info - give detailed information about Lintian's error tags SYNOPSIS
lintian-info [log-file...] lintian-info --tags tag ... DESCRIPTION
The lintian-info command parses the output of the lintian command and gives verbose information about the listed Lintian error tags, parses a Lintian override file and gives verbose information about the tags included, or (if given the -t or --tags option) explains a given tag or tags. If no log-file is specified on the command line, this command expects its input on stdin. Thus, the output of lintian can either be piped through lintian-info or a log file produced by lintian can be processed with this command. (Note, though, that the lintian command has a command line option -i to display the same results as lintian-info, so you will not normally need to pipe the output of lintian into this command.) OPTIONS
-a, --annotate Read from standard input or any files specified on the command line and search the input for lines formatted like Lintian override entries. For each one that was found, display verbose information about that tag. -h, --help Display usage information and exit. --profile prof Use the severities from the vendor profile prof when displaying tags. If the profile name does not contain a slash, the default profile for than vendor is chosen. If not specified, lintian-info loads the best profile for the current vendor. Please Refer to the Lintian User Manual for the full documentation of profiles. -t, --tags Rather than treating them as log file names, treat any command-line options as tag names and display the descriptions of each tag. EXIT STATUS
If -t or --tags was given and one or more of the tags specified were unknown, this command returns the exit code 1. Otherwise, it always returns with exit code 0. SEE ALSO
lintian(1) AUTHORS
Niels Thykier <niels@thykier.net> Richard Braakman <dark@xs4all.nl> Christian Schwarz <schwarz@monet.m.isar.de> perl v5.14.2 2013-02-16 LINTIAN-INFO(1)