Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk to count occurrence of strings and loop for multiple columns
Top Forums Programming awk to count occurrence of strings and loop for multiple columns Post 302919014 by Don Cragun on Friday 26th of September 2014 04:30:39 PM
Old 09-26-2014
What OS are you using? (Show output from uname -a.)

What is the value of LINE_MAX on your system? (Show output from getconf LINE_MAX.)

The obvious way to do things like this is with awk, but the standards only define the behavior of awk on text files. On many systems, a text file cannot have any lines longer than 2048 bytes and if you have 1100 fields in your input files, you have crossed that threshold.

How many lines are in your input file? What is the total size of your input file?

The header for your desired output file:
Code:
col2 count col1 col2 count col1 col3 count col1 ...col100 count col1

shows the 1st three output fields being duplicated but if I understand what you're trying to do, shouldn't the header be?:
Code:
col2 count col1 col3 count col1 ...col100 count col1

 

10 More Discussions You Might Find Interesting

1. Linux

To find multiple strings count in a file

I need to find the line count of multiple strings in a particular file. The strings are as follows: bmgcc bmgccftp bsmsftp bulkftp cctuneftp crbtftp crmpos cso gujhr I am doing manual grep for each of the string to find the line count. The command i am using right now is: grep mark... (3 Replies)
Discussion started by: salaathi
3 Replies

2. Shell Programming and Scripting

Count occurance of multiple strings using grep command

How to grep multiple string occurance in input file using single grep command? I have below input file with many IDP, RRBE messages. Out put should have count of each messages. I have used below command but it is not working grep -cH "(sent IDP Request)(Recv RRBCSM)" *.txt ... (5 Replies)
Discussion started by: sushmab82
5 Replies

3. Shell Programming and Scripting

Copying of multiple columns of one table to another by mapping with particular strings.

Hi, I would like to copy some columns from a particular file by mapping with the string names. i am using the .csv file format. my one file consist of 100 of columns but i want only particular 4 columns such as ( First_name, Middle_name,Last_name & Stlc). but they are listed in many files... (15 Replies)
Discussion started by: dsh007
15 Replies

4. Shell Programming and Scripting

Count no of occurrence of the strings based on column value

Can anyone help me to count number of occurrence of the strings based on column value. Say i have 300 files with 1000 record length from which i need to count the number of occurrence string which is existing from 213 to 219. Some may be unique and some may be repeated. (8 Replies)
Discussion started by: zooby
8 Replies

5. Shell Programming and Scripting

How to count the number of occurrence of words from multiple files?

File 1 aaa bbb ccc File 2 aaa xxx zzz bbb File 3 aaa bbb xxx Output: (4 Replies)
Discussion started by: Misa-Misa
4 Replies

6. UNIX for Dummies Questions & Answers

Split a column into multiple columns at certain character count

Hey everyone, I have an issue with a client that is passing me a list of values in one column, and occasionally the combination of all the values results in more than an 255 character string. My DB has a 255 character limit, so I am looking to take the column (comma delimited file), and if it... (1 Reply)
Discussion started by: perekl
1 Replies

7. Shell Programming and Scripting

Count occurrence of string in a column using awk

Hi, I want to count the occurrences of strings in a column and display as in example below: Input: get1 345 789 098 get2 567 982 090 fet4 777 610 632 get1 800 544 230 get1 600 788 451 get2 892 321 243 get1 673 111 235 fet3 789 220 278 fet4 768 222 341 output: 4 get1 345 789... (7 Replies)
Discussion started by: aydj
7 Replies

8. UNIX for Dummies Questions & Answers

[Solved] Awk: count occurrence of each character for every field

Hi, let's say an input looks like: A|C|C|D A|C|I|E A|B|I|C A|T|I|B as the title of the thread explains, I am trying to get something like: 1|A=4 2|C=2|B=1|T=1 3|I=3|C=1 4|D=1|E=1|C=1|B=1 i.e. a count of every character in each field (first column of output) independently, sorted... (4 Replies)
Discussion started by: beca123456
4 Replies

9. UNIX for Dummies Questions & Answers

Count occurrence of string (based on type) in a column using awk

Hello, I have a table that looks like what is shown below: AA BB CC XY PQ RS AA BB CC XY RS I would like the total counts depending on the set they belong to: if search pattern is in {AA, BB, CC} --> count them as Type1 | wc -l (3 Replies)
Discussion started by: Gussifinknottle
3 Replies

10. UNIX for Beginners Questions & Answers

Count multiple columns and print original file

Hello, I have two tab files with headers File1: with 4 columns header1 header2 header3 header4 44 a bb 1 57 c ab 4 64 d d 5 File2: with 26 columns header1.. header5 header6 header7 ... header 22...header26 id1 44 a bb id2 57 ... (6 Replies)
Discussion started by: nans
6 Replies

LEARN ABOUT SUSE

gtk2::treestore

Gtk2::TreeStore(3)					User Contributed Perl Documentation					Gtk2::TreeStore(3)

NAME

       Gtk2::TreeStore

HIERARCHY

	 Glib::Object
	 +----Gtk2::TreeStore

INTERFACES

	 Gtk2::TreeModel
	 Gtk2::TreeDragSource
	 Gtk2::TreeDragDest
	 Gtk2::TreeSortable
	 Gtk2::Buildable

METHODS

   treestore = Gtk2::TreeStore->new (...)
       o   ... (list) of strings, package names

   treeiter = $tree_store->append ($parent)
       o   $parent (Gtk2::TreeIter or undef)

   $tree_store->clear
   $tree_store->set_column_types (...)
       o   ... (list) of strings, package names

   $tree_store->set ($iter, $col1, $val1, ...)
       o   $iter (Gtk2::TreeIter)

       o   $col1 (integer) the first column number

       o   $val1 (scalar) the first value

       o   ... (list) pairs of columns and values

   treeiter = $tree_store->insert ($parent, $position)
       o   $parent (Gtk2::TreeIter or undef)

       o   $position (integer)

   treeiter = $tree_store->insert_after ($parent, $sibling)
       o   $parent (Gtk2::TreeIter or undef)

       o   $sibling (Gtk2::TreeIter or undef)

   treeiter = $tree_store->insert_before ($parent, $sibling)
       o   $parent (Gtk2::TreeIter or undef)

       o   $sibling (Gtk2::TreeIter or undef)

   treeiter = $tree_store->insert_with_values ($parent, $position, ...)
       o   $parent (Gtk2::TreeIter or undef)

       o   $position (integer) position to insert the new row

       o   ... (list) pairs of column numbers and values

       Like doing insert followed by set, except that insert_with_values emits only the row-inserted signal, rather than row-inserted, row-
       changed, and, if the store is sorted, rows-reordered as in the multiple-operation case.	Since emitting the rows-reordered signal
       repeatedly can affect the performance of the program, insert_with_values should generally be preferred when inserting rows in a sorted tree
       store.

       Since: gtk+ 2.10

   boolean = $tree_store->is_ancestor ($iter, $descendant)
       o   $iter (Gtk2::TreeIter)

       o   $descendant (Gtk2::TreeIter)

   integer = $tree_store->iter_depth ($iter)
       o   $iter (Gtk2::TreeIter)

   boolean = $tree_store->iter_is_valid ($iter)
       o   $iter (Gtk2::TreeIter)

       Since: gtk+ 2.2

   $tree_store->move_after ($iter, $position)
       o   $iter (Gtk2::TreeIter)

       o   $position (Gtk2::TreeIter or undef)

       Since: gtk+ 2.2

   $tree_store->move_before ($iter, $position)
       o   $iter (Gtk2::TreeIter)

       o   $position (Gtk2::TreeIter or undef)

       Since: gtk+ 2.2

   treeiter = $tree_store->prepend ($parent)
       o   $parent (Gtk2::TreeIter or undef)

   boolean = $tree_store->remove ($iter)
       o   $iter (Gtk2::TreeIter)

   $tree_store->reorder ($parent, ...)
       o   $parent (Gtk2::TreeIter or undef)

       o   ... (list) of integer's, the new_order

       Since: gtk+ 2.2

   $tree_store->swap ($a, $b)
       o   $a (Gtk2::TreeIter)

       o   $b (Gtk2::TreeIter)

       Since: gtk+ 2.2

   $tree_store->set_value ($iter, $col1, $val1, ...)
       o   $iter (Gtk2::TreeIter)

       o   $col1 (integer) the first column number

       o   $val1 (scalar) the first value

       o   ... (list) pairs of columns and values

       Alias for Gtk2::TreeStore::set().

SEE ALSO

       Gtk2, Glib::Object

COPYRIGHT

       Copyright (C) 2003-2008 by the gtk2-perl team.

       This software is licensed under the LGPL.  See Gtk2 for a full notice.

perl v5.12.1							    2010-07-05							Gtk2::TreeStore(3)
All times are GMT -4. The time now is 07:52 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy