Help with pipe count in a flat file!!!

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Oracle table extract: all columns are not converting into pipe delimited in flat file

Hi All, I am writing a shell script to extract oracle table into a pipe dilemited flat file. Below is my code and I have attached two files that I have abled to generate so far. 1. Table.txt ==> database extract file 2. flat.txt ==> pipe delimited after some manipulation of the original db...

2. Shell Programming and Scripting

How to ignore Pipe in Pipe delimited file?

Hi guys, I need to know how i can ignore Pipe '|' if Pipe is coming as a column in Pipe delimited file for eg: file 1: xx|yy|"xyz|zzz"|zzz|12... using below awk command awk 'BEGIN {FS=OFS="|" } print $3 i would get xyz But i want as : xyz|zzz to consider as whole column...

3. Shell Programming and Scripting

Unique count from flat file

Hello Guys I have a flat file with '|~|' delimited When I use to record count using below command awk -FS"+" ' {print $colno}' filename | wc -l the count is fine But when I am trying to find the unique number of record the o/p is always 1 awk -FS"+" ' {print $colno}'...

4. Shell Programming and Scripting

count of null in pipe delimited txt file

Hi, I have a pipe delimited txt file which contains 17 fields per line/row. 16th field contains email id. I want to count the number of lines/rows that contains null in the 16th field. Plz find attached example data file. I'm looking for a command line/script which achieves this. ...

5. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as...

6. UNIX for Dummies Questions & Answers

Grep char count & pipe to sed command

Hi I am having a 'grep' headache Here is the contents of my file: (PBZ,CP,(((ME,PBZ,BtM),ON),((ME,((PBZ,DG),(CW9,PG11))),CW9,TS2,RT1))) I would like to count out how many times 'PBZ' occurs and then place that number in the line above 3...

7. Shell Programming and Scripting

count alphabets in a flat file and print

I have a text file with a huge dataset, and each row in that dataset has some data(65479 rows). In that file I need to find the number of times a-z & A-Z Appears. How Can I Initialise Array into an Array to parse the count also I need to parse a,A into a single array preferably. example of...

8. Shell Programming and Scripting

Getting Sum, Count and Distinct Count of a file

Hi all this is a UNIX question. I have a large flat file with millions of records. col1|col2|col3 1|a|b 2|c|d 3|e|f 3|g|h footer**** I am supposed to calculate the sum of col1 1+2+3+3=9, count of col1 1,2,3,3=4, and distinct count of col1 1,2,3=c3 I would like it if you avoid...

9. Programming

compare XML/flat file with UNIX file system structure

Before i start doing something, I wanted to know whether the approach to compare XML file with UNIX file system structure. I have a pre-configured file(contains a list of paths to executables) and i need to check against the UNIX directory structure. what are the various approches should i use ? I...

10. UNIX for Dummies Questions & Answers

How to count the record count in an EBCDIC file.

How do I get the record count in an EBCDIC file on a Linux Box. :confused:

LEARN ABOUT FREEBSD

pipe

PIPE(2) 						      BSD System Calls Manual							   PIPE(2)

NAME

     pipe, pipe2 -- create descriptor pair for interprocess communication

LIBRARY

     Standard C Library (libc, -lc)

SYNOPSIS

     #include <unistd.h>

     int
     pipe(int fildes[2]);

     int
     pipe2(int fildes[2], int flags);

DESCRIPTION

     The pipe() system call creates a pipe, which is an object allowing bidirectional data flow, and allocates a pair of file descriptors.

     The pipe2() system call allows control over the attributes of the file descriptors via the flags argument.  Values for flags are constructed
     by a bitwise-inclusive OR of flags from the following list, defined in <fcntl.h>:

     O_CLOEXEC	 Set the close-on-exec flag for the new file descriptors.

     O_NONBLOCK  Set the non-blocking flag for the ends of the pipe.

     If the flags argument is 0, the behavior is identical to a call to pipe().

     By convention, the first descriptor is normally used as the read end of the pipe, and the second is normally the write end, so that data
     written to fildes[1] appears on (i.e., can be read from) fildes[0].  This allows the output of one program to be sent to another program: the
     source's standard output is set up to be the write end of the pipe, and the sink's standard input is set up to be the read end of the pipe.
     The pipe itself persists until all its associated descriptors are closed.

     A pipe that has had an end closed is considered widowed.  Writing on such a pipe causes the writing process to receive a SIGPIPE signal.
     Widowing a pipe is the only way to deliver end-of-file to a reader: after the reader consumes any buffered data, reading a widowed pipe
     returns a zero count.

     The bidirectional nature of this implementation of pipes is not portable to older systems, so it is recommended to use the convention for
     using the endpoints in the traditional manner when using a pipe in one direction.

RETURN VALUES

     The pipe() function returns the value 0 if successful; otherwise the value -1 is returned and the global variable errno is set to indicate
     the error.

ERRORS

     The pipe() and pipe2() system calls will fail if:

     [EMFILE]		Too many descriptors are active.

     [ENFILE]		The system file table is full.

     [ENOMEM]		Not enough kernel memory to establish a pipe.

     The pipe2() system call will also fail if:

     [EINVAL]		The flags argument is invalid.

SEE ALSO

     sh(1), fork(2), read(2), socketpair(2), write(2)

HISTORY

     The pipe() function appeared in Version 3 AT&T UNIX.

     Bidirectional pipes were first used on AT&T System V Release 4 UNIX.

     The pipe2() function appeared in FreeBSD 10.0.

BSD
								    May 1, 2013 							       BSD

Shell Programming and Scripting