08-12-2016
Uhm where is the problem to try it with a short example like you have already given? It comes to principle about the problem, not to process an 8GB file...
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a m X n matrix written out to file, say like this:
1,2,3,4,5,6
2,6,3,10,34,67
1,45,6,7,8,8
I want to calculate the column averages in the MINIMUM amount of code or processing possible. I would have liked to use my favorite tool, "AWK" but since it processes rowwise, getting the... (5 Replies)
Discussion started by: Abhishek Ghose
5 Replies
2. Shell Programming and Scripting
hi
i have file which hav following entries
1501,AAA,2.00
1525,AAA,2.00
1501,AAA,2.00
1525,AAA,2.00
1501,AAA,3.00
1525,AAA,3.00
1525,AAA,3.00
1501,AAA,3.00
1501,AAA,3.00
i want to have a o/p coloum wise
like
1501,AAA,13
1525,AAA,10
here 13 comes as a sum of last colum value... (6 Replies)
Discussion started by: aaysa123
6 Replies
3. Shell Programming and Scripting
Shell script for the below operation :
File "A" contains :
SEQ++1'
MOA+9:000,00:ABC'
RFF+AIK:000000007'
FII+PH+0170++AA'
NAD+PL+++XXXXXXXXXXX XXXXXXX XX++XXX XXXX XXXX X.X. XXXXXXXXX+++NL'
SEQ++2'
MOA+9:389,47:ABC'
RFF+AIK:02110300000008'
FII+PH+0PSTBNL2A:25:5+BB'... (5 Replies)
Discussion started by: navojit dutta
5 Replies
4. Solaris
Hi,
I have two files. Want to make an addition of the fifth column of from both the files and redirect it to a third file.
Both files have same records except fifth field and same record should be inserted into new file having fifth field as addition of fifth fields of both files.
for... (2 Replies)
Discussion started by: sanjay1979
2 Replies
5. UNIX for Advanced & Expert Users
Hi All,
I have two txt files like this
File1:
no name
----------
12 aaaa
23 bbbb
55 cccc
File2
dname dno
------------
civil 33
mech 55
arch 66
Now i want to compare col1 from File and col2 from File2, if its match i want fetch all columns from... (3 Replies)
Discussion started by: psiva_arul
3 Replies
6. Shell Programming and Scripting
Hello All ,
I have a problem with summing of column by group
Input File -
COL_1,COL_2,COL_3,COL_4,COL_5,COL_6,COL_7,COL_8,COL_9,COL_10,COL_11
3010,21,1923D ,6,0,0.26,0,0.26,-0.26,1,200807
3010,21,192BI ,6,24558.97,1943.94,0,1943.94,22615.03,1,200807
3010,21,192BI... (8 Replies)
Discussion started by: jambesh
8 Replies
7. Shell Programming and Scripting
i have a file which has a column that is unique
i am intending to serach it and if it is there to remove the row.
the file looks like
ROLLNO,NAME ,SUB1,SUB2,SUB3,TOTAL,PERCENTAGE,RESULT
15 ,rig ,34 ,56 ,87 ,177 ,59 % ,PASS
23 ,wel ,45 ,76 ,56 ,177 ,59 % ... (0 Replies)
Discussion started by: gotam
0 Replies
8. Shell Programming and Scripting
Scottn, m really sorry but i have not got my answer yet.
my concern is how to delete the row !!!
i have a file which has a column that is unique
i am intending to serach it and if it is there to remove the row.
the file looks like
ROLLNO,NAME ,SUB1,SUB2,SUB3,TOTAL,PERCENTAGE,RESULT... (9 Replies)
Discussion started by: gotam
9 Replies
9. Shell Programming and Scripting
awk '{ gsub(/....=/,""); print }' want.dat >final.dat
the above awk command which removes all the chars before and including '=' on the entire row. --thats what it meant be.:)
but i need to remove text on column-wise on each row.
many thanks,
EM
---------- Post updated at 10:00 AM... (4 Replies)
Discussion started by: elamurugu
4 Replies
10. Shell Programming and Scripting
Hi I have pasted sample data as below:- in data.txt
Please suggest any way out: as the 3rd field is
cat data.txt
22:37:34 STARTING abc
22:37:40 FAILURE sadn
00:06:42 STARTING asd
00:06:51 FAILURE ad
02:06:38 STARTING acs
02:06:46 FAILURE cz
04:06:35 STARTING xzc... (1 Reply)
Discussion started by: Gaurav198
1 Replies
PIPE(2) System Calls Manual PIPE(2)
NAME
pipe - create an interprocess channel
SYNOPSIS
#include <u.h>
#include <libc.h>
int pipe(int fd[2])
DESCRIPTION
Pipe creates a buffered channel for interprocess I/O communication. Two file descriptors are returned in fd. Data written to fd[1] is
available for reading from fd[0] and data written to fd[0] is available for reading from fd[1].
After the pipe has been established, cooperating processes created by subsequent fork(2) calls may pass data through the pipe with read and
write calls. The bytes placed on a pipe by one write are contiguous even if many processes are writing. Write boundaries are preserved:
each read terminates when the read buffer is full or after reading the last byte of a write, whichever comes first.
The number of bytes available to a read(2) is reported in the Length field returned by fstat or dirfstat on a pipe (see stat(2)).
When all the data has been read from a pipe and the writer has closed the pipe or exited,
read(2) will return 0 bytes. Writes to a pipe with no reader will generate a note sys: write on closed pipe.
SOURCE
/sys/src/libc/9syscall
SEE ALSO
intro(2), read(2), pipe(3)
DIAGNOSTICS
Sets errstr.
BUGS
If a read or a write of a pipe is interrupted, some unknown number of bytes may have been transferred.
When a read from a pipe returns 0 bytes, it usually means end of file but is indistinguishable from reading the result of an explicit write
of zero bytes.
PIPE(2)