12-03-2011
Find redundant text in a file
I want to find which pattern or strings have occurred more than one time so that I can remove unnecessary redundancy.
For example:
If I have the sentence:
A quick brown brown fox jumps jumps jumps over the lazy dog
in a file, then I want to know that
1. the word "brown" has occurred 2 times.
2. the word "jump" has occurred 3 times.
in the above mentioned sentence.
Note that I have no idea which words have been repeated.
So I cannot make a pattern match search.
So I just need to know what are the texts/strings are redundant in a file. Is it possible?
Thanks.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hi
i have a very simple problem
iam moving files from download to archive folder
but before such a transfer want to make sure no two file of same
are present in my download directory
how to check for redundant file names
i thought of using WC but it counts inside the file (lines and... (5 Replies)
Discussion started by: maverick
5 Replies
2. Shell Programming and Scripting
Hi all
pls help me by providing soln for my problem
I'm having a text file which contains duplicate records .
Example:
abc 1000 3452 2463 2343 2176 7654 3452 8765 5643 3452
abc 1000 3452 2463 2343 2176 7654 3452 8765 5643 3452
tas 3420 3562 ... (1 Reply)
Discussion started by: G.Aavudai
1 Replies
3. UNIX for Dummies Questions & Answers
I have file named shortlist , and it contains this:
2233|charles harris |g.m. |sales |12/12/52| 90000
9876|bill johnson |director |production|03/12/50|130000
5678|robert dylan |d.g.m. |marketing |04/19/43| 85000
2365|john woodcock |director |personnel... (1 Reply)
Discussion started by: Cecko
1 Replies
4. Shell Programming and Scripting
Hi
Could you please help me out by solving teh below problem ?
I have a file with as below
source1|target1|yes
source2|target2|no
source1 is file in which i have to place some code under the <head> tag in it.
What code i have to place in source1 is something like this "abcd.....<target1>... (5 Replies)
Discussion started by: Tasha_T
5 Replies
5. Shell Programming and Scripting
Hi Everybody,
I have an unknown number of files that for some reason contain the ^Z character. I would need a command that helps me identifying these files.
Here is an example of a line:
JUAN HERN^ZNDEZ
I would greatly appreciate your help.
Thanks in advance,
Sebastian (3 Replies)
Discussion started by: hhoosscchhii
3 Replies
6. Shell Programming and Scripting
Hello!
Please, help me to write such script.
I have some text file with name filename.txt
I must check if this file contains string "test-string-first", I must cut from this file string which follows string "keyword-string:" and till first white-space and save it to some variable.
For... (3 Replies)
Discussion started by: optik77
3 Replies
7. Shell Programming and Scripting
Hi
I have a text file with rows like this:
7 Herman ASI-40 Jungle (L) Blueprint (L) Weapon Herman ASI-40 Jungle (L) 215.00 57 65.21 114.41
and
9 Herman CAP-505 (L) Blueprint (L) Weapon Herman CAP-505 (L) 220.00 46.84 49.1 104.82
and
2 ClericDagger 1C blueprint Melee - Shortblade... (2 Replies)
Discussion started by: pesa
2 Replies
8. UNIX for Dummies Questions & Answers
Hello i a script:
#!/bin/sh
count=0
for iname in `cat mysong`
do
for cname in `cat mysong`
do
if
then
count=`expr $count + 1`
fi
done
echo "word: $iname - found in the text: $count times"
count=0
donethe proplem: how i... (2 Replies)
Discussion started by: levitmic
2 Replies
9. Shell Programming and Scripting
Dear All,
I have to reduce the redundancy of a file that is like this:
a b 0
a c 0
a f 1
b a 1
b a 0
b c 1
d f 0
g h 1
f d 1
Basically, this file describe a network with relative nodes and edges.
The nodes are the different letters and the edges are represented by the numbers (in... (7 Replies)
Discussion started by: giuliangiuseppe
7 Replies
10. UNIX for Beginners Questions & Answers
Dear all,
I want to find all the "," in my text file and then replace the commas to a tab. I found a script online but I don't know how to modify the script for my case. Any one can help? Thank you.
@echo off &setlocal
set "search=%1"
set "replace=%2"
set "textfile=Input.txt"
set... (2 Replies)
Discussion started by: forevertl
2 Replies
LEARN ABOUT HPUX
dteditorsetcontents
DtEditorSetContents(library call) DtEditorSetContents(library call)
NAME
DtEditorSetContents -- place data into a DtEditor widget
SYNOPSIS
#include <Dt/Editor.h>
DtEditorErrorCode DtEditorSetContents(
Widget widget,
DtEditorContentRec *data);
DESCRIPTION
The DtEditorSetContents function places a NULL-terminated string, wide character string or sized buffer into a DtEditor widget. Any data
currently in the DtEditor widget is lost. The data is transferred to the DtEditor widget using a DtEditorContentRec, which indicates the
type of data being transferred along with the actual data. After the data is placed into the DtEditor widget, the insertion cursor is
positioned at the first character.
The widget argument specifies the DtEditor widget ID.
The data argument is a pointer to a data structure containing the new contents of widget.
For a complete definition of the DtEditor widget and its associated resources, see DtEditor(3).
For a complete definition of DtEditorContentRec, see Dt/Editor.h - DtEditor(5).
RETURN VALUE
Upon successful completion, the DtEditorSetContents function returns one of the following values:
DtEDITOR_NO_ERRORS
The data was loaded sucessfully.
DtEDITOR_NULLS_REMOVED
NULL characters were found and removed from the data.
Otherwise, if the DtEditorSetContents function cannot load the data in the DtEditor widget, it returns one of the following values:
DtEDITOR_INVALID_TYPE
The Type field is unrecognized.
DtEDITOR_ILLEGAL_SIZE
The size of the buffer passed in is negative.
DtEDITOR_NULL_ITEM
The buffer is NULL.
DtEDITOR_INSUFFICIENT_MEMORY
Not enough system memory is available to load the data.
EXAMPLES
The following code segment sets the contents of a DtEditor widget to ``The quick brown fox.''
Widget editor;
DtEditorContentRec cr;
DtEditorErrorCode status;
char *sampleString="The quick brown fox";
cr.type = DtEDITOR_TEXT;
cr.value.string = sampleString;
status = DtEditorSetContents(editor, &cr);
if (status != DtEDITOR_NO_ERRORS && status != DtEDITOR_NULLS_REMOVED) {
printf("Unable to set contents of the widget
");
APPLICATION USAGE
If the data is in a disk file, rather than in memory, the application should use DtEditorSetContentsFromFile(3).
SEE ALSO
Dt/Editor.h - DtEditor(5), DtEditor(3), DtEditorAppend(3), DtEditorAppendFromFile(3), DtEditorGetContents(3), DtEditorInsert(3), DtEdi-
torInsertFromFile(3), DtEditorReplace(3), DtEditorReplaceFromFile(3), DtEditorSaveContentsToFile(3), DtEditorSetContentsFromFile(3).
DtEditorSetContents(library call)