Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Record count of a csv file
Top Forums Shell Programming and Scripting Record count of a csv file Post 302215965 by ajaykk on Thursday 17th of July 2008 03:43:00 PM
Old 07-17-2008
Quote:
Originally Posted by joeyg
1) cat file | grep "^[0-9][0-9]" | wc -l
Or similar, if the normal file has numbers in the first couple character positions as user id or other identifier

2) cat file | cut -c1 | grep '"'
Assuming that the first field begins with a "

3) cat sample | tr "\n" " " | tr '"' "\n" | wc -l
Will produce a number. If normally three fields with " for each valid record, then take the resulting number from the command and divide by (twice the normal # fields).
The command above showed me 12 for my sample file, and I knew my sample has three fields with ". So 12/(3*2) = 2 records


p.s.
Be cautious of the "bump" to move a question. I always scan questions for those with zero responses - to work on first. Then, time permitting, go back to others that I previously skipped over. Therefore, your "bump" can have the reverse effect.

Thanks Joey..
cat sample | tr "\n" " " | tr '"' "\n" | wc -l..seems to be working..
when I tried..found an issue..for one of the record the data has multiple double quotes ..("xyz","abc","toys ""R"" us", "def", "hij","....)..
coz of this I'm not getting a round value count..how do I handle this?
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to delete a record from a csv file

Hi Guys I have downloaded a table from oracle database in .csv format. it has many fields as Title, First Name, Last Name etc. I have to download distinct titles from database and now i have to check all those titles from data of First Name one by one. and then i have to delete matched record.... (1 Reply)
Discussion started by: Rajeev Agrawal
1 Replies

2. UNIX for Dummies Questions & Answers

How to count the record count in an EBCDIC file.

How do I get the record count in an EBCDIC file on a Linux Box. :confused: (1 Reply)
Discussion started by: oracle8
1 Replies

3. UNIX for Dummies Questions & Answers

how to get a file name & record count of csv file

HI , I am new to shell scripting , I have a requirement that I send a file for data quality ( original.csv) & i will be getting 4 files daily into a particular directory in return with cleansed data . the files may be clean.csv, unclean.csv , ... (2 Replies)
Discussion started by: sirik
2 Replies

4. Shell Programming and Scripting

replaying a record count with another record count

i use unix command to take the record count for a file1 awk 'END{print NR}' filename i already have a file2 which conatin the count like ... .. rec_cnt=100 .. .. I want to replace the record in the file2 using the record i take from file1. suggest me some simple ways of doing it... (2 Replies)
Discussion started by: er_zeeshan05
2 Replies

5. Shell Programming and Scripting

Split long record into csv file

Hi I receive a mainframe file which has very long records (1100 chars) with no field delimiters. I need to parse each record and output a comma delimited (csv) file. The record layout is fixed. If there weren't so many fields and records I would read the file into Excel, as a "fixed width"... (10 Replies)
Discussion started by: wvdeijk
10 Replies

6. Shell Programming and Scripting

csv file - adding total to a trailer record

Hi, I have a script which creates and modifies a csv file. I have managed to do everything I need to do apart from 1 thing. I need to append a trailer record to the file. I need this line to hold the total of an entire column of the csv file (skipping the 1st line which is a header). Can... (2 Replies)
Discussion started by: mcclunyboy
2 Replies

7. Shell Programming and Scripting

Print record count of a file using shell script

HI, I need to print the record count of a file using shell script. If the record count of a file excluding header and trailer record if greater than zero then print 'Record count of a file is xxxx records'. If the record count is zero print 'zero records' Thanks Mahendra (1 Reply)
Discussion started by: mmeda
1 Replies

8. Shell Programming and Scripting

Output first unique record in csv file

Hi, I have to output a new csv file from an input csv file with first unique value in the first column. input csv file color product id status green 102 pass yellow 201 hold yellow 202 keep green 101 ok green 103 hold yellow 203 ... (5 Replies)
Discussion started by: Chris LAU
5 Replies

9. Shell Programming and Scripting

Shell script for field wise record count for different Files .csv files

Hi, Very good wishes to all! Please help to provide the shell script for generating the record counts in filed wise from the .csv file My question: Source file: Field1 Field2 Field3 abc 12f sLm 1234 hjd 12d Hyd 34 Chn My target file should generate the .csv file with the... (14 Replies)
Discussion started by: Kirands
14 Replies

10. Shell Programming and Scripting

Total record count of all the file present in a directory

Hi All , We need one help on the below requirement.We have multiple pipe delimited .txt file(around 100 .txt files) present on one directory.We need the total record count of all the files present in that directory without header.File format as below : ... (8 Replies)
Discussion started by: STCET22
8 Replies

LEARN ABOUT SUNOS

auditstat

auditstat(1M)						  System Administration Commands					     auditstat(1M)

NAME

       auditstat - display kernel audit statistics

SYNOPSIS

       auditstat [-c count] [-h numlines] [-i interval] [-n] [-v]

DESCRIPTION

       auditstat displays kernel audit statistics. The fields displayed are as follows:

       aud	The total number of audit records processed by the audit(2) system call.

       ctl	This field is obsolete.

       drop	The  total  number  of	audit  records that have been dropped. Records are dropped according to the kernel audit policy. See audi-
		ton(2), AUDIT_CNT policy for details.

       enq	The total number of audit records put on the kernel audit queue.

       gen	The total number of audit records that have been constructed (not the number written).

       kern	The total number of audit records produced by user processes (as a result of system calls).

       mem	The total number of Kbytes of memory currently in use by the kernel audit module.

       nona	The total number of non-attributable audit records that have been constructed. These are audit records that are  not  attributable
		to any particular user.

       rblk	The total number of times that auditsvc(2) has blocked waiting to process audit data.

       tot	The total number of Kbytes of audit data written to the audit trail.

       wblk	The total number of times that user processes blocked on the audit queue at the high water mark.

       wrtn	The  total  number of audit records written. The difference between enq and wrtn is the number of outstanding audit records on the
		audit queue that have not been written.

OPTIONS

       -c count        Display the statistics a total of count times. If count is equal to zero, statistics are displayed  indefinitely.   A  time
		       interval must be specified.

       -h numlines     Display	a  header  for every  numlines of statistics printed. The default is to display the header every 20 lines. If num-
		       lines is equal to zero, the header is never displayed.

       -i interval     Display the statistics every interval where interval is the number of seconds to sleep between each collection.

       -n	       Display the number of kernel audit events currently configured.

       -v	       Display the version number of the kernel audit module software.

EXIT STATUS

       auditstat returns 0 upon success and 1 upon failure.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWcsu			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       auditconfig(1M), praudit(1M), bsmconv(1M), audit(2), auditon(2), auditsvc(2), attributes(5)

NOTES

       The functionality described in this man page is available only if the Basic Security Module (BSM) has been enabled.  See   bsmconv(1M)  for
       more information.

SunOS 5.10							    6 May 1993							     auditstat(1M)
All times are GMT -4. The time now is 06:07 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy