09-07-2009
need help sorting/deleting non-unique things
I don't really know much about UNIX commands, so if someone could help me understand how to do this, I'd really appreciate it.
I have a text file with data that looks like this (filename: numbers.txt):
1 1 1 1 1 1 1 1 1 2 1 1_2 2_1
1 1 1 1 1 1 1 1 2 1 2 1_2 2_1
1 1 1 1 1 1 1 1 2 1 2 1_2 2_1
1 1 1 1 1 1 1 1 3 1 1 1_3 3_1
1 1 1 1 1 1 1 2 1 2 1 1_2 2_1
1 1 1 1 1 1 1 2 2 1 2 1_2 2_1
1 1 1 1 1 1 1 3 1 3 1 1_3 3_1
1 1 1 1 1 1 1 3 1 1 3 1_3 3_1
1 1 1 1 1 1 1 4 1 1 1 1_4 4_1
1 1 1 1 1 1 2 1 2 1 1 1_2 2_1
11 integers followed by an unspecified number of entries in the form "x_y".
What I want to do is this:
1) look at ONLY the x_y portions of each line, determining which lines are unique AFTER the 11 integers. In the above text, only the second-to-last line meets those criteria (1_4 4_1 doesn't appear anywhere else on the list).
2) Take those (partially) unique lines and write them to a new text file called new_numbers.txt.
(In my above example, new_numbers.txt would have only one line of text: 1 1 1 1 1 1 1 4 1 1 1 1_4 4_1)
If anyone can help me understand how to do this, I'd be very grateful! Thank you so much for your time and help!
---------- Post updated at 05:02 PM ---------- Previous update was at 04:59 PM ----------
If it's helpful, I should mention that the file (numbers.txt) is a file I've created myself, so if it would be easier to complete my task if the text were formatted differently, I can do that easily. (Like, if it would be better to have some sort of special character between the 11 integers and the x_y numbers, or if the x_y numbers should come at the beginning of the line, etc)
Thanks!
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
hello everyone..
I was wondering is there a effective way to sort file that contains colomns and numeric one.
file
218900012192 8938929 8B8DF3664 1E7E2D59D5 0000 26538 1234 74024415
218900012979 8938929 8B8DF3664 1E7E2D59D5 0000 26538 1234 74024415
218900012992 8938929 8B8DF3664... (2 Replies)
Discussion started by: amon
2 Replies
2. UNIX for Dummies Questions & Answers
Hi power user,
if I have this file:
file1.txt:
1111
1111
2222
2222
3333
3333
3333
4444
4444
4444
when I run the
sort file1.txt | uniq > data1.txt
the result is (2 Replies)
Discussion started by: anjas
2 Replies
3. Shell Programming and Scripting
I have an archive file that holds a batch of statements. I would like to be able to extract a certain statement based on the unique customer # (ie. 123456). The end for each statement is noted by "ENDSTM".
I can find the line number for the beginning of the statement section with sed.
... (5 Replies)
Discussion started by: andrewsc
5 Replies
4. Shell Programming and Scripting
Hi Guys,
I have two files that I am using:
File1 is as follows:
wwe
khfgv
jfo
jhgfd
hoaha
hao
lkahe
This is like a master file which has entries in the order which I want. (4 Replies)
Discussion started by: npatwardhan
4 Replies
5. Shell Programming and Scripting
So I have two files:
File1
pictures.txt 1.1 1.3
dance.txt 1.2 1.4
treehouse.txt 1.3 1.5
File2
pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244
dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2 ref4948 1.1
treehouse.txt 1.6 ref8573 1.5 ref3284 1.4 ref5838... (24 Replies)
Discussion started by: linuxkid
24 Replies
6. UNIX for Dummies Questions & Answers
I have a file that looks some like this:
I need to delete most of the information and sort the rest in such way that I get the following output file
Any help will be greatly appreciated (3 Replies)
Discussion started by: Xterra
3 Replies
7. Shell Programming and Scripting
I have 84 files with the following names splitseqs.1, spliseqs.2 etc.
and I want to change the .number to a unique filename.
E.g.
change splitseqs.1 into splitseqs.7114_1#24
and
change spliseqs.2 into splitseqs.7067_2#4
So all the current file names are unique, so are the new file names.... (1 Reply)
Discussion started by: avonm
1 Replies
8. UNIX for Dummies Questions & Answers
Hi all,
I wanted to save the values of a file that contains unique entries based on a specific column (column 4). my sample file looks like the following:
input file: 200006-07file.txt
145 35 10 3
147 35 12 4
146 36 11 3
145 34 12 5
143 31 15 4
146 30 14 5
desired output files:... (5 Replies)
Discussion started by: ida1215
5 Replies
9. Shell Programming and Scripting
Hi ,
i have a belwo script which is used to get sectors per track value extarcted from Solaris machine:
for DISK in /dev/dsk/c*t*d*s*; do value=`prtvtoc "$DISK" | sed -n -e '/Dimensions/,/Flags/{/Dimensions/d; /Flags/d; p; }' | sed -n -e '/sectors\/track/p'`; if ; then echo... (4 Replies)
Discussion started by: omkar.jadhav
4 Replies
10. Shell Programming and Scripting
I am trying to sort, do uniq by 1st column and report this 4 columns tab delimiter table , eg
chr10:112174128 rs2255141 2E-10 Cholesterol, total
chr10:112174128 rs2255141 7E-16 LDL
chr10:17218291 rs10904908 3E-11 HDL Cholesterol
chr10:17218291 rs970548 8E-9 TG... (4 Replies)
Discussion started by: fat
4 Replies
LEARN ABOUT CENTOS
wrjpgcom
WRJPGCOM(1) General Commands Manual WRJPGCOM(1)
NAME
wrjpgcom - insert text comments into a JPEG file
SYNOPSIS
wrjpgcom [ -replace ] [ -comment text ] [ -cfile name ] [ filename ]
DESCRIPTION
wrjpgcom reads the named JPEG/JFIF file, or the standard input if no file is named, and generates a new JPEG/JFIF file on standard output.
A comment block is added to the file.
The JPEG standard allows "comment" (COM) blocks to occur within a JPEG file. Although the standard doesn't actually define what COM blocks
are for, they are widely used to hold user-supplied text strings. This lets you add annotations, titles, index terms, etc to your JPEG
files, and later retrieve them as text. COM blocks do not interfere with the image stored in the JPEG file. The maximum size of a COM
block is 64K, but you can have as many of them as you like in one JPEG file.
wrjpgcom adds a COM block, containing text you provide, to a JPEG file. Ordinarily, the COM block is added after any existing COM blocks;
but you can delete the old COM blocks if you wish.
OPTIONS
Switch names may be abbreviated, and are not case sensitive.
-replace
Delete any existing COM blocks from the file.
-comment text
Supply text for new COM block on command line.
-cfile name
Read text for new COM block from named file.
If you have only one line of comment text to add, you can provide it on the command line with -comment. The comment text must be sur-
rounded with quotes so that it is treated as a single argument. Longer comments can be read from a text file.
If you give neither -comment nor -cfile, then wrjpgcom will read the comment text from standard input. (In this case an input image file
name MUST be supplied, so that the source JPEG file comes from somewhere else.) You can enter multiple lines, up to 64KB worth. Type an
end-of-file indicator (usually control-D) to terminate the comment text entry.
wrjpgcom will not add a COM block if the provided comment string is empty. Therefore -replace -comment "" can be used to delete all COM
blocks from a file.
EXAMPLES
Add a short comment to in.jpg, producing out.jpg:
wrjpgcom -c "View of my back yard" in.jpg > out.jpg
Attach a long comment previously stored in comment.txt:
wrjpgcom in.jpg < comment.txt > out.jpg
or equivalently
wrjpgcom -cfile comment.txt < in.jpg > out.jpg
SEE ALSO
cjpeg(1), djpeg(1), jpegtran(1), rdjpgcom(1)
AUTHOR
Independent JPEG Group
15 June 1995 WRJPGCOM(1)