Bitwise comparison of cols Post: 302872153

Sponsored Content

Top Forums Shell Programming and Scripting Bitwise comparison of cols Post 302872153 by Chubler_XL on Thursday 7th of November 2013 07:55:28 PM

11-07-2013

Moderator

Try this

Code:

awk 'NR==1{for(cols=1;cols<=NF;cols++)H[cols]=$cols;next}
{for(i=1;i<=NF;i++)
    for(j=i+1;j<=NF;j++)
	   if($i==$j) c[i,j]++
}
END{
   for(i=1;i<cols;i++)
      for(j=i+1;j<cols;j++)
	  print H[i],H[j],0+c[i,j]
} ' infile

---------- Post updated at 10:55 AM ---------- Previous update was at 10:02 AM ----------

Quote:

I believe this will take a lot of time, is there a way of tracking progress?

Yes, my initial testing indicates it may take 3 or 4 weeks or runtime! The following logs each block to 100 lines processed to stderr:

Code:

awk 'NR==1{for(cols=1;cols<=NF;cols++)H[cols]=$cols;next}
{for(i=1;i<=NF;i++)
    for(j=i+1;j<=NF;j++)
       if($i==$j) c[i,j]++
}
!(NR%100) { printf("%cLines processed: %09d", 13, NR)> "/dev/stderr"}
END{
   for(i=1;i<cols;i++)
      for(j=i+1;j<cols;j++)
      print H[i],H[j],0+c[i,j]
} ' infile > outfile

Last edited by Chubler_XL; 11-07-2013 at 09:11 PM..

This User Gave Thanks to Chubler_XL For This Post:

Chubler_XL

View Public Profile for Chubler_XL

Find all posts by Chubler_XL

10 More Discussions You Might Find Interesting

1. Programming

Bit-fields and Bitwise operators

Hi, Is it possible to use bitwise operators in bit fields? For example: typedef struct Mystruct { unsigned char A :1 ; unsigned char B :1 ; } Mystruct; and assume struct Mystruct STR_1S, STR_2S, tempSTRS = {0}; then the following line: tempSTRS = STR_1S & STR_2S; gives the...

2. UNIX for Advanced & Expert Users

bitwise operators

can anybody write a program to divide a number by another number using bitwise operators

3. Programming

resetting counter using bitwise XOR

Hi ! How to reset a variable to 0 after a reset value, say 10 using bitwise XOR. For example, int cnt=0; if(cnt<10) cnt++; else cnt = 0; How can we achieve this by using XOR only. thanks,

4. Shell Programming and Scripting

Bitwise negation

I am taking an online course on Unix scripting. The topic is Unix arithmetic operators and the lesson is Logical and bitwise operations. It is not clear how much storage space Unix uses to represent integers that are typed. Bitwise negation caused me to question how many bits are used to...

5. Programming

bitwise and if

Hi Suppose we have these code lines: #define _IN_USE 0x001 /* set when process slot is in use */ #define _EXITING 0x002 /* set when exit is expected */ #define _REFRESHING 0x004 ... 1 main () { 2 3 unsigned r_flags =_REFRESHING; 4 5 if (r_flag &...

6. Shell Programming and Scripting

Grouping matches by cols

Dear all I have a large file w. ~ 10 million lines. The first two cols have matching partners. For example: A A A B B B or A A B A B B The matches may be separated by an unknown number of lines. My intention is to group them and add a "group" value in the last col. For...

7. Emergency UNIX and Linux Support

bitwise and between two 32 bit binaries

Hello All, i have two 16 bit binaries that in two different variables, i want to perform a bitwise AND between the two and store the result in a different variable. can anyone throw some light on doing this in a bourne shell... eg var1= 1110101010101011 ...

8. FAQ Submission Queue

Analysis in bitwise XOR

The purpose of this article is revealing the unrevealed parts of the bitwise XOR. As we aware, the truth table for the XOR operator is : A B A^B 0 0 0 0 1 1 1 0 1 1 1 0 For example , 1^2 will be calculated as given below: First the operands...

9. Shell Programming and Scripting

how to use bitwise or operator in /bin/sh

please any one can suggest me how to use bitesie || opearator to do this #initallize a=0 b=0 #condition if then a=0 else a=1 fi #bitwise or opeartion b = a || b Please view this code tag video for how to use code tags when posting code and data.

10. Programming

Bitwise operation for state machine

Hello All, I am writing basic state machine which maintains 8 different states and there is posibility that system may be in multiple states at a time (Except for state1 to state3. menas only once state can be active at a time from state1 to state3). I have declared...

10 More Discussions You Might Find Interesting

1. Programming

Bit-fields and Bitwise operators

Discussion started by: amatsaka

2. UNIX for Advanced & Expert Users

bitwise operators

Discussion started by: areef4u

3. Programming

resetting counter using bitwise XOR

Discussion started by: mrgubbala

4. Shell Programming and Scripting

Bitwise negation

Discussion started by: dLloydm

5. Programming

bitwise and if

Discussion started by: Puntino

6. Shell Programming and Scripting

Grouping matches by cols

Discussion started by: gbalsu

7. Emergency UNIX and Linux Support

bitwise and between two 32 bit binaries

Discussion started by: venu

8. FAQ Submission Queue

Analysis in bitwise XOR

Discussion started by: pandeesh

9. Shell Programming and Scripting

how to use bitwise or operator in /bin/sh

Discussion started by: Palaniappan

10. Programming

Bitwise operation for state machine

Discussion started by: anand.shah