03-13-2012
Print specific lines of a repeated set of data
I have a file that needs 1st line, 2nd line, and 26th line printed from every chunk of data. Each chunk of data contains 26 lines (#line+%line+24 data lines = 26 lines of data repeated).
Input file:
# This is a data file used for blockA (chunk 1).
% 10576 A 10 0 1
04 (data1)
03 (data2)
F2 (data3)
8B (data4)
.... (data xyz)
CF (data 24)
# This is a data file used for blockA (chunk 2).
% 10576 B 20 1 2
FF
FE
FD
FC
..
AA
# This is a data file used for blockA (chunk 3).
% 10576 C 30 2 3
11
22
33
44
..
7F
Output file should look like this, where lines 1, lines 2, and lines 26 of a chuck of data have been printed to a file:
# This is a data file used for blockA.
% 10576 A 10 0 1
CF
# This is a data file used for blockA.
% 10576 B 20 1 2
AA
# This is a data file used for blockA.
% 10576 C 30 2 3
7F
---------
I tried using sed -n -e '1,2p;26p' inputfile.txt but that only prints the 1st, 2nd, and 26th line of chunk1. It doesn't output the data every chunk.
I also tried sed -n '0~26p' inputfile.txt, but that only prints the 26th line of every chunk.
Thanks for your help
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi!
How can I print out a specific range of rows, like "cat file | awk NR==5,NR==9", but in the END-statement?
I have a small awk-script that finds specific rows in a file and saves the line number in an array, like this:
awk '
BEGIN { count=0}
/ZZZZ/ {
list=NR
... (10 Replies)
Discussion started by: Bugenhagen
10 Replies
2. Shell Programming and Scripting
I have a text file made of different blocks separated by blank lines. I need to print the blocks with odd indexes. How can I get it with awk?
For example i need to print the first and the third block of a file like this:
asgdg sadsd ssgsdgd
ass uff fedd sddddso
ieeduydd dddee deeo
ssancnc... (4 Replies)
Discussion started by: littleboyblu
4 Replies
3. Shell Programming and Scripting
abc.dat
tty cpu
tin tout us sy wt id
0 0 7 3 19 71
extended device statistics
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 133.2 0.0 682.9 0.0 1.0 0.0 7.2 0 79 c1t0d0
0.2 180.4 0.1 5471.2 3.0 2.8 16.4 15.6 15 52 aaaaaa1-xx
I want to skip first 5 line... (4 Replies)
Discussion started by: kchinnam
4 Replies
4. Shell Programming and Scripting
Hi everyone,
I have a program that generates logs that contains sections like this:
IMAGE INPUT
81 0 0.995 2449470 0 1726 368 1 0.0635 0.3291
82 0 1.001 2448013 0 1666 365 1 0.0649 0.3235
83 0 1.009 2444822 0 1697 371 1 ... (3 Replies)
Discussion started by: euval
3 Replies
5. Shell Programming and Scripting
Hi,
I have one file, say file 1, that has data like below where 19900107 is the date,
19900107 12 144 129 0.7380047
19900108 12 168 129 0.3149017
19900109 12 192 129 3.2766666E-02
... (3 Replies)
Discussion started by: Wynner
3 Replies
6. Shell Programming and Scripting
Hello all,
I have thousand file input like this:
file1:
$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
$$ | | | |$$
$$ UERT | TTYH | TAFE | FRFG |$$
$$______|______|________|______|$$
$$ | | | |$$
$$ 1 | DISK | TR1311 | 1 |$$
$$ 1 |... (4 Replies)
Discussion started by: attila
4 Replies
7. Shell Programming and Scripting
Hi all,
I have a file that looks like this:
uid=bessemsj
version: 1
dn: cn=Desk SpecialAdminDesk, ou=Desks, dc=DSS,c=nl,o=Vodafone
dn: cn=DSS Advisors, ou=Groups, dc=DSS,c=nl,o=Vodafone
dn: cn=DSS Dispatcher,ou=Groups,dc=DSS,c=nl,o=Vodafone
dn: cn=Desk Retention Desk,ou=Desks,... (13 Replies)
Discussion started by: Eman_in_forum
13 Replies
8. Shell Programming and Scripting
Hello All, I have a file which has repeated lines. I want to print the lines which are repeated three times.
Please help. (3 Replies)
Discussion started by: ailnilanjan
3 Replies
9. Shell Programming and Scripting
I need to print specific lines 5,100,67,123 in a file.
file name: today.csv (3 Replies)
Discussion started by: ramkumar15
3 Replies
10. UNIX for Beginners Questions & Answers
Hi, I need to print lines which are matching with start pattern "SELECT" and END PATTERN ";" and only select the last "select" statement including the ";" .
I have attached sample input file and the desired input should be as:
INPUT FORMAT:
SELECT
ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,... (5 Replies)
Discussion started by: nani2019
5 Replies
UNIQ(1) BSD General Commands Manual UNIQ(1)
NAME
uniq -- report or filter out repeated lines in a file
SYNOPSIS
uniq [-c | -d | -u] [-i] [-f num] [-s chars] [input_file [output_file]]
DESCRIPTION
The uniq utility reads the specified input_file comparing adjacent lines, and writes a copy of each unique input line to the output_file. If
input_file is a single dash ('-') or absent, the standard input is read. If output_file is absent, standard output is used for output. The
second and succeeding copies of identical adjacent input lines are not written. Repeated lines in the input will not be detected if they are
not adjacent, so it may be necessary to sort the files first.
The following options are available:
-c Precede each output line with the count of the number of times the line occurred in the input, followed by a single space.
-d Only output lines that are repeated in the input.
-f num Ignore the first num fields in each input line when doing comparisons. A field is a string of non-blank characters separated from
adjacent fields by blanks. Field numbers are one based, i.e., the first field is field one.
-s chars
Ignore the first chars characters in each input line when doing comparisons. If specified in conjunction with the -f option, the
first chars characters after the first num fields will be ignored. Character numbers are one based, i.e., the first character is
character one.
-u Only output lines that are not repeated in the input.
-i Case insensitive comparison of lines.
ENVIRONMENT
The LANG, LC_ALL, LC_COLLATE and LC_CTYPE environment variables affect the execution of uniq as described in environ(7).
EXIT STATUS
The uniq utility exits 0 on success, and >0 if an error occurs.
COMPATIBILITY
The historic +number and -number options have been deprecated but are still supported in this implementation.
SEE ALSO
sort(1)
STANDARDS
The uniq utility conforms to IEEE Std 1003.1-2001 (``POSIX.1'') as amended by Cor. 1-2002.
HISTORY
A uniq command appeared in Version 3 AT&T UNIX.
BSD
December 17, 2009 BSD