Sponsored Content
Top Forums Shell Programming and Scripting Calculating number of records by field Post 302435322 by raghavendra.cse on Wednesday 7th of July 2010 05:07:52 AM
Old 07-07-2010
Calculating number of records by field

Hi,

I have CSV file which looks like below, i want to calulate number of records for each brand say SOLO_UNBEATABLE E and SOLO_UNBEATABLE F combined and record count is say 20 . i want to calculate for each brand, and here only first record will have all data and rest of record for the brand is with only two fields displayed.
Let me know how i can number of records for such situation ?

Code:
SOLO_UNBEATABLE	E	7	5/1/2010 13:00	5/6/2010 18:00	12:30	17:00	2263881188	Y	41216		Free Solo msg: Your monthly charge is past due. Top up now to reinstate your plan & avoid pay per use charges. Visit solomobile.ca/top-up. 						Sorry	 this address cannot receive incoming messages. Thank you for choosing Solo. To contact us	 visit solomobile.ca/contact-us	
							2263881964	Y												
							2263884224	Y												
							2263884246	Y
SOLO_UNBEATABLE	F	7	5/1/2010 13:00	5/6/2010 18:00	12:30	17:00	4162005872	Y	41216		Mess grat de Solo: Frais mensuels échus. Réapprovisionnez votre compte & éviter de payer à l'util. Détails: solomobile.ca/reapprovisionner. 						Désolé. Cette adresse ne peut recevoir de messages. Merci d'avoir choisi Solo. Visitez solomobile.ca/contactez-nous
							4183329551	Y									
							4184807455	Y									
							4185169291	Y									
							4185701898	Y									
							4185717607	Y									
Bell_BB	E	7	5/1/2010 13:00	5/6/2010 18:00	12:30	17:00	2506503556	Y	41216		Free Bell Msg: Your monthly payment is past due. Top up to reinstate your BlackBerry feature (may take 24 hrs). Visit bell.ca/topup						Sorry	 this address cannot receive incoming messages. Thank you for choosing Solo. To contact us	 visit solomobile.ca/contact-us
							2509368323	Y											
							2509475405	Y											
							2892609313	Y											
							2893562015	Y											
							4034781779	Y											
							4038210219	Y											
							5196517632	Y											
							6047039761	Y											
							6133189211	Y											
							6134309448	Y											
							9022473696	Y											
							9053517625	Y											
							9059121573	Y											
Bell_BB	F	7	5/1/2010 13:00	5/6/2010 18:00	12:30	17:00	5147182000	Y	41216		Mess grat Bell : Paiement mensuel en retard. Réapp. à bell.ca/reapprovisionnement pour rétablir votre option BlackBerry (peut prendre 24 h). 						Désolé. Cette adresse ne peut recevoir de messages. Merci d'avoir choisi Solo. Visitez solomobile.ca/contactez-nous		
Bell_MONTHLY	E	7	5/1/2010 13:00	5/6/2010 18:00	12:30	17:00	2263883220	Y	41216		Free Bell msg: Your monthly charge is past due. Top up now to reinstate your plan & avoid pay per use charges. Visit bell.ca/topup. 						Sorry	 this address cannot receive incoming messages. Thank you for choosing Solo. To contact us	 visit solomobile.ca/contact-us
							2267475054	Y											
							2267477589	Y											
							2267484229	Y											
							2267488725	Y											
							2267489010	Y											
							2267493332	Y											
Bell_MONTHLY	F	7	5/1/2010 13:00	5/6/2010 18:00	12:30	17:00	4183343530	Y	41216		Mess grat de Bell: Frais mensuels échus. Réapprovisionnez votre compte & éviter de payer à l'util. Détails: bell.ca/reapprovisionnement						Désolé. Cette adresse ne peut recevoir de messages. Merci d'avoir choisi Solo. Visitez solomobile.ca/contactez-nous
							4187142083	Y									
							4188127848	Y									
							4189051790	Y									
							4189529341	Y									
							4189575309	Y									
							4189604983	Y									
							4505613682	Y									
							4505664580	Y

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Calculating field using AWK, or GAWK script

Hello all, I'm totally new to UNIX/Linux but I'm taking a course in it at my local JC. My question: I have been tasked with writing a gawk script that will create a nicely formatted report. That part I've done ok on...however, the very last thing that must be done is a calculation of a... (4 Replies)
Discussion started by: Trellot
4 Replies

2. Shell Programming and Scripting

calculating a number

Hello all :) I need some help; I'm running the sp_spaceused command on various tables and saving the output to a file. So, I have an input file that has 3 rows - each row has 7 columns. I would like to 1) sort the file on the 4th column, 2) take the 4th column in the first row and add 25% to... (2 Replies)
Discussion started by: stonemonolith
2 Replies

3. UNIX for Dummies Questions & Answers

Calculating the Number of Rows and Average

Hi All I like to know how can we calculate the number of rows and the average of the values present in the file. I will not know what will be the rowcount, which will be dynamic in nature of the file. eg. 29 33 48 30 28 (6 Replies)
Discussion started by: pk_eee
6 Replies

4. Shell Programming and Scripting

Sorting on two fields time field and number field

Hi, I have a file that has data in it that says 00:01:48.233 1212 00:01:56.233 345 00:09:01.221 5678 00:12:23.321 93444 The file has more line than this but i just wanted to put in a snippet to ask how I would get the highest number with time stamp into another file. So from the above... (2 Replies)
Discussion started by: pat4519
2 Replies

5. Shell Programming and Scripting

Counting non empty fields and calculating with that number

Hello all, I have a problem with a skript of mine: My input has the following format 1,33296 transcript_id"ENSRNOT00000018629" 0 1,33296 0 0 transcript_id"ENSRNOT00000029014" 0 0,907392 transcript_id"ENSRNOT00000016905" 0,907392 0 transcript_id"ENSRNOT00000053370" 0 0... (0 Replies)
Discussion started by: DerSeb
0 Replies

6. Shell Programming and Scripting

AWK print number of records, divide this number

I would like to print the number of records of 2 files, and divide the two numbers awk '{print NR}' file1 > output1 awk '{print NR}' file2 > output2 paste output1 output2 > output awl '{print $1/$2}' output > output_2 is there a faster way? (8 Replies)
Discussion started by: programmerc
8 Replies

7. Shell Programming and Scripting

Compare two files with different number of records and output only the Extra records from file1

Hi Freinds , I have 2 files . File 1 |nag|HYd|1|Che |esw|Gun|2|hyd |pra|bhe|3|hyd |omu|hei|4|bnsj |uer|oeri|5|uery File 2 |nag|HYd|1|Che |esw|Gun|2|hyd |uer|oi|3|uery output : (9 Replies)
Discussion started by: i150371485
9 Replies

8. Shell Programming and Scripting

Trouble calculating difference in number of days

Hi all, I have a requirement to calculate the difference of number of days of time stamp of a file and system date and if the difference is greater than 15 days it should prompt as previous month file otherwise current month file. Below is the code i used and it is working fine till now. (You... (2 Replies)
Discussion started by: Ravindra Swan
2 Replies

9. Shell Programming and Scripting

Performance of calculating total number of matching records in multiple files

Hello Friends, I've been trying to calculate total number of a certain match in multiple data records files (DRs). Let say I have a daily created folders for each day since the beginning of july like the following drwxrwxrwx 2 mmsuper med 65536 Jul 1 23:59 20150701 drwxrwxrwx 2 mmsuper... (1 Reply)
Discussion started by: EAGL€
1 Replies

10. Solaris

Calculating number of CPUs in Solaris-8

Hello, I have few old V210/V240, running Solaris-8. I am trying to find, number of physical CPUs, number of cores and number of virtual processors. psrinfo is giving me confusing status. It looks like, there are 2 physical CPUs, but psrinfo -p shows me just 1 bash-2.03$ psrinfo -v Status of... (4 Replies)
Discussion started by: ron323232
4 Replies
srec_signetics(5)						File Formats Manual						 srec_signetics(5)

NAME
srec_signetics - Signetics file format DESCRIPTION
The Signetics file format is not often used. The major disadvantage in modern applications is that the addressing range is limited to only 64kb. Records All data lines are called records, and each record contains the following 5 fields: +--+------+----+----+----+----+ |: | aaaa | cc | as | dd | ss | The field are defined as follows: +--+------+----+----+----+----+ : Every record starts with this identifier. aaaa The address field. A four digit (2 byte) number representing the first address to be used by this record. cc The byte-count. A two digit value (1 byte), counting the actual data bytes in the record. as Address checksum. Covers 2 address bytes and the byte count. dd The actual data of this record. There can be 1 to 255 data bytes per record (see cc) ss Data Checksum. Covers only all the data bytes of this record. Record Begin Every record begins with a colon ":[rq] character. Records contain only ASCII characters. No spaces or tabs are allowed in a record. In fact, apart from the 1st colon, no other characters than 0..9 and A..F are allowed in a record. Interpretation of a record should be case less, it does not matter if you use a..f or A..F. Unfortunately the colon was chosen for the Signetics file format, similar to the Intel format (see srec_intel(5) for more information). However, SRecord is able to automatically detect the dofference between the two format, when you use the -Guess format specifier. Address Field This is the address where the first data byte of the record should be stored. After storing that data byte, the address is incremented by 1 to point to the address for the next data byte of the record. And so on, until all data bytes are stored. The address is represented by a 4 digit hex number (2 bytes), with the MSD first. The order of addresses in the records of a file is not important. The file may also contain address gaps, to skip a portion of unused memory. Byte Count The byte count cc counts the actual data bytes in the current record. Usually records have 32 data bytes, but any number between 1 and 255 is possible. A value of 0x00 for cc indicates the end of the file. In this case not even the address checksum will follow! The record (and file) are terminated immediately. It is not recommended to send too many data bytes in a record for that may increase the transmission time in case of errors. Also avoid sending only a few data bytes per record, because the address overhead will be too heavy in comparison to the payload. Address Checksum This is not really a checksum anymore, it looks more like a CRC. The checksum can not only detect errors in the values of the bytes, but also bytes out of order can be detected. The checksum is calculated by this algorithm: checksum = 0 for i = 1 to 3 checksum = checkum XOR byte ROL checksum next i For the Address Checksum we only need 2 Address bytes and 1 Byte Count byte to be added. That's why we count to 3 in the loop. Every byte is XORed with the previous result. Then the intermediate result is rolled left (carry rolls back into b0). This results in a very reliable checksum, and that for only 3 bytes! The last record of the file does not contain any checksums! So the file ends right after the Byte Count of 0. Data Field The payload of the record is formed by the Data field. The number of data bytes expected is given by the Byte Count field. The last record of the file may not contain a Data field. Data Checksum This checksum uses the same algorithm as used for the Address Checksum. This time we calculate the checksum with only the data bytes of this record. checksum = 0 for i = 1 to cc checksum = checksum XOR byte ROL checksum next i Note that we count to the Byte Count cc this time. Size Multiplier In general, binary data will expand in sized by approximately 2.4 times when represented with this format. EXAMPLE
Here is an example Signetics file :B00010A5576F77212044696420796F75207265617B :B01010E56C6C7920676F207468726F756768206136 :B02010256C6C20746861742074726F75626C652068 :B0300D5F746F207265616420746869733FD1 :B03D00 In the example above you can see a piece of code in Signetics format. The first 3 lines have 16 bytes of data each, which can be seen by the byte count. The 4th line has only 13 bytes, because the program is at it's end there. Notice that the last record of the file contains no data bytes, and not even an Address Checksum. SEE ALSO
http://sbprojects.fol.nl/knowledge/fileformats/signetics.htm AUTHOR
This man page was taken from the above Web page. It was written by San Bergmans <sanmail@bigfoot.com> Reference Manual SRecord srec_signetics(5)
All times are GMT -4. The time now is 05:15 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy