10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I need all your help to achieve the below functionality.
I have a big 2 GB file and inside the file we need to identify, whether having a comma(,) or pipe(|) or tab or fixed position or semicolon(;) delimiter. If any of those delimiter found need to replace the file with pipe(|)... (1 Reply)
Discussion started by: lkeswar
1 Replies
2. UNIX for Advanced & Expert Users
Hello guys,
I have a problem where I need to add a delimiter, that can be | for example, after each 28000 chars.
The problem is that sometimes 1 row, which should contain 28000 chars is split in 2, so I want to put the delimiter after each 28000 so I will know the end of each row.
Please... (2 Replies)
Discussion started by: Diogo R Jesus
2 Replies
3. Shell Programming and Scripting
Hi,
I have file
#cat drivers.txt
fcs0
fcs1
vscsi1
vscsi2
In this i need to check the availabality of "fcs" or "vscsi" alone not vscsi0,fcs1
I tried with "if condition" but it is not working.
cat drivers.txt| while read ADAP
do
echo "Checking for $ADAP"
if ;then
echo "FC... (9 Replies)
Discussion started by: ksgnathan
9 Replies
4. Shell Programming and Scripting
I have a file with multiple lines. From each line I want to get all strings that starts with '+' and ends with '/'. Then I want the strings to be separated by ' + '
Example input:
+$A$/NOUN+At/NSUFF_FEM_PL+K/CASE_INDEF_ACC
Sample output:
$A$ + At + K (20 Replies)
Discussion started by: Viernes
20 Replies
5. UNIX for Dummies Questions & Answers
I was trying to run a code to check if a fax number is empty or not.
for that, I've written the following code which is throwing an error.
#!/bin/ksh
fax= "999-999-9999"
if ; then
fax_no="000-000-0000"
else
fax_no=$fax
fi
echo $fax_no
And I get the... (7 Replies)
Discussion started by: hooaamai
7 Replies
6. Shell Programming and Scripting
I know this should be simple, but I've been manning sed awk grep and find and am stupidly stumped :(
I'm trying to use sed (or awk, find, etc) to find 4 characters on the second line of a file.txt 44-47 characters in. I can find lots of sed things for lines, but not characters. (4 Replies)
Discussion started by: unclecameron
4 Replies
7. Shell Programming and Scripting
I was using the following bash command inside the emacs compile command to search C++ source code:
grep -inr --include='*.h' --include='*.cpp' '"' * | sed "/include/d" | sed "/_T/d" | sed '/^ *\/\//d' | sed '/extern/d'
Emacs will then position me in the correct file and at the correct line... (0 Replies)
Discussion started by: siegfried
0 Replies
8. Shell Programming and Scripting
here is my simple script to show process and owners except me:
ps `-ef |grep xterm |grep -v aucar` | while read a1 a2 a3 a4 a5 a6 a7 a8
do
echo KILL..\($a1\).. $a2 |more
done
how can I pass values from command "ps -ef |grep xterm|grep -v aucar" to ?
because above command... (2 Replies)
Discussion started by: xramm
2 Replies
9. Shell Programming and Scripting
Hi,
I need some advise on treating non printable chars over ascii value 126
Case 1 :
On some fields in the text , I need to retiain then 'as-is' and load to a database.I understand it also depends on database codepage.
but i just wanna know how do i ensure it do not change while loading... (1 Reply)
Discussion started by: braindrain
1 Replies
10. UNIX for Advanced & Expert Users
Hi,
One of our application is producing log files. But if we open the log file in vi or less or view mode, it shows all the special characters in it. The 'cat' shows correctly but it shows only last page. If I do 'cat' <file_name> | more, then again it shows special characters.
... (1 Reply)
Discussion started by: divakarp
1 Replies
uniq(1) User Commands uniq(1)
NAME
uniq - report or filter out repeated lines in a file
SYNOPSIS
/usr/bin/uniq
/usr/bin/uniq [-c | -d | -u] [-f fields] [-s char]
[input_file [output_file]]
/usr/bin/uniq [-c | -d | -u] [-n] [+ m] [input_file [output_file]]
ksh93
uniq [-cdiu] [-D[delimit]] [-f fields] [-s chars] [-w chars]
[input_file [output_file]]
uniq [-cdiu] [-D[delimit]] [-n] [+m] [-w chars] [input_file [output_file]]
DESCRIPTION
/usr/bin/uniq
The uniq utility reads an input file comparing adjacent lines and writes one copy of each input line on the output. The second and succeed-
ing copies of repeated adjacent input lines are not written.
Repeated lines in the input are not detected if they are not adjacent.
ksh93
The uniq built-in in ksh93 is associated with the /bin or /usr/bin path. It is invoked when uniq is executed without a pathname prefix and
the pathname search finds a /bin/uniq or /usr/bin/uniq executable.
uniq reads an input, comparing adjacent lines, and writing one copy of each input line on the output. The second and succeeding copies of
the repeated adjacent lines are not written.
If output_file is not specified, uniq writes to standard output. If input_file is not specified, or if input_file is -, uniq reads from
standard input, and the start of the file is defined as the current offset.
OPTIONS
/usr/bin/uniq
The following options are supported by /usr/bin/uniq:
-c Precedes each output line with a count of the number of times the line occurred in the input.
-d Suppresses the writing of lines that are not repeated in the input.
-f fields Ignores the first fields fields on each input line when doing comparisons, where fields is a positive decimal integer. A field
is the maximal string matched by the basic regular expression:
[[:blank:]]*[^[:blank:]]*
If fields specifies more fields than appear on an input line, a null string is used for comparison.
+m Equivalent to -s chars with chars set to m.
-n Equivalent to -f fields with fields set to n.
-s chars Ignores the first chars characters when doing comparisons, where chars is a positive decimal integer. If specified in conjunc-
tion with the -f option, the first chars characters after the first fields fields is ignored. If chars specifies more charac-
ters than remain on an input line, a null string is used for comparison.
-u Suppresses the writing of lines that are repeated in the input.
ksh93
The following options are supported by the uniq built-in command is ksh93:
-c Outputs the number of times each line occurred along with the line.
--count
-d Outputs only duplicate lines.
--repeated | duplicates
-D Outputs all duplicate lines as a group with an empty line delimiter specified by delimit.
--all-repeated[=delimit]
Specify delimit as one of the following:
none Do not delimit duplicate groups.
prepend Prepend an empty line before each group.
separate Separate each group with an empty line.
The value for delimit can be omitted. The default value is none.
-f Skips over fields number of fields before checking for uniqueness. A field is the minimal string matching the
--skip-fields=fields BRE [[:blank:]]*[^[:blank:]]*.
-i Ignore case in comparisons.
--ignore-case
+m Equivalent to the -s chars option, with chars set to m.
-n Equivalent to the -f fields option, with fields set to n.
-s Skips over chars number of characters before checking for uniqueness.
--skip-chars=chars
If specified with the -f option, the first chars after the first fields are ignored. If the chars specifies
more characters than are on the line, an empty string is used for comparison.
-u Outputs unique lines.
--uniq
-w Skips over any specified fields and characters, then compares chars number of characters.
--check-chars=chars
OPERANDS
The following operands are supported:
input_file A path name of the input file. If input_file is not specified, or if the input_file is -, the standard input is used.
output_file A path name of the output file. If output_file is not specified, the standard output is used. The results are unspecified if
the file named by output_file is the file named by input_file.
EXAMPLES
Example 1 Using the uniq Command
The following example lists the contents of the uniq.test file and outputs a copy of the repeated lines.
example% cat uniq.test
This is a test.
This is a test.
TEST.
Computer.
TEST.
TEST.
Software.
example% uniq -d uniq.test
This is a test.
TEST.
example%
The next example outputs just those lines that are not repeated in the uniq.test file.
example% uniq -u uniq.test
TEST.
Computer.
Software.
example%
The last example outputs a report with each line preceded by a count of the number of times each line occurred in the file:
example% uniq -c uniq.test
2 This is a test.
1 TEST.
1 Computer.
2 TEST.
1 Software.
example%
ENVIRONMENT VARIABLES
See environ(5) for descriptions of the following environment variables that affect the execution of uniq: LANG, LC_ALL, LC_CTYPE, LC_MES-
SAGES, and NLSPATH.
EXIT STATUS
The following exit values are returned:
0 Successful completion.
>0 An error occurred.
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
/usr/bin/uniq
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWesu |
+-----------------------------+-----------------------------+
|CSI |Enabled |
+-----------------------------+-----------------------------+
|Interface Stability |Committed |
+-----------------------------+-----------------------------+
|Standard |See standards(5). |
+-----------------------------+-----------------------------+
ksh93
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWcsu |
+-----------------------------+-----------------------------+
|Interface Stability |See below. |
+-----------------------------+-----------------------------+
The ksh93 built-in binding to /bin and /usr/bin is Volatile. The built-in interfaces are Uncommitted.
SEE ALSO
comm(1), ksh93(1), , pcat(1), sort(1), uncompress(1), attributes(5), environ(5), standards(5)
SunOS 5.11 13 Mar 2008 uniq(1)