Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Finding common entries between 10 columns Post 303002517 by Sanchari on Saturday 26th of August 2017 06:26:55 AM
Old 08-26-2017
Finding common entries between 10 columns

Hello, I need to find the intersection across 10 columns. Kindly help.

my file (INPUT.csv) looks like this
Code:
 4_R         4_S         8_R         8_S         12_R         12_S         24_R         24_S  
LOC_Os01g01010 LOC_Os01g01010 LOC_Os01g01010 LOC_Os04g48290 LOC_Os01g01010 LOC_Os01g01010 LOC_Os01g01010 LOC_Os04g48290
LOC_Os01g01019 LOC_Os01g01019 LOC_Os01g01019 LOC_Os05g39580 LOC_Os01g01019 LOC_Os01g01019 ChrSy.fgenesh.gene.29 LOC_Os05g39580
LOC_Os01g01019 LOC_Os01g01019 LOC_Os01g01019 LOC_Os05g39580 LOC_Os01g01019 LOC_Os01g01019 ChrSy.fgenesh.gene.29 LOC_Os05g39580
                                                                                   LOC_Os01g01010                                                                                            ChrSy.fgenesh.gene.29
                                                                                                                                                                                                          LOC_Os01g01010

There can be duplicate entries and the no. of entries in each column can be different.

Last edited by Scrutinizer; 08-26-2017 at 09:12 AM.. Reason: Added closing code tag
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Finding the most common entry in a column

Hi, I have a file with 3 columns in it that are comma separated and it has about 5000 lines. What I want to do is find the most common value in column 3 using awk or a shell script or whatever works! I'm totally stuck on how to do this. e.g. value1,value2,bob value1,value2,bob... (12 Replies)
Discussion started by: Donkey25
12 Replies

2. Solaris

Comparing the common columns of a table in two files

Hi, I have two text files.The first and the 2nd file have data in the same format For e.g. The first file has BOOKS COUNT: 40 BOOKS AUTHOR1 SUM:1018 MAX:47 MIN:1 AVG:25.45 BOOKS AUTHOR3 SUM:181 MAX:48 MIN:3 AVG:18.1 Note:Read it as Table columnname sum(column) max(column) min(column)... (1 Reply)
Discussion started by: ragavhere
1 Replies

3. Shell Programming and Scripting

Finding longest common substring among filenames

I will be performing a task on several directories, each containing a large number of files (2500+) that follow a regular naming convention: YYYY_MM_DD_XX.foo_bar.A.B.some_different_stuff.EXT What I would like to do is automatically discover the part of the filenames that are common to all... (1 Reply)
Discussion started by: cmcnorgan
1 Replies

4. Shell Programming and Scripting

Finding Authors in Common Across Dozens of Lists

I currently have publication lists for ~3 dozen faculty members. I need to find out how many publications are in common across all faculty members - person 1 with person 2, person 1 with person 3, person 2 with person 3, person 1 with both person 2 and person 3, etc. One person may have Last1,... (5 Replies)
Discussion started by: Peggy White
5 Replies

5. Shell Programming and Scripting

finding common numbers (contents) across 2 or 3 files

I have 3 files which are tab delimited and have numbers in it. file 1 1 2 3 4 5 6 7 File 2 3 5 7 8 File 3 1 (4 Replies)
Discussion started by: Lucky Ali
4 Replies

6. Shell Programming and Scripting

Common records after matching on different columns

Hi, I have the following files. cat 1.txt cat 2.txt output.txt The logic is as follows.... (10 Replies)
Discussion started by: jacobs.smith
10 Replies

7. Shell Programming and Scripting

Two columns-Common records - 20 files

Hi Friends, I have an input file like this cat input1 x 1 y 2 z 3 a 2 b 4 c 6 d 9 cat input2 x 7 h 8 k 9 l 5 m 9 d 12 (5 Replies)
Discussion started by: jacobs.smith
5 Replies

8. Shell Programming and Scripting

Common values in 2 columns in 2 files

Hello, Suppose I have these 2 tab delimited files, where the second column in first file contains matching values from first column of the second file, I would like to get an output like this: File A 1 A 2 B 3 C File B A Apple C Cinnabon B Banana I would like... (1 Reply)
Discussion started by: Mohamed EL Hadi
1 Replies

9. Shell Programming and Scripting

Finding out the common lines in two files using 4 fields with the help of awk and UNIX

Dear All, I have 2 files. If field 1, 2, 4 and 5 matches in both file1 and file2, I want to print the whole line of file1 and file2 one after another in my output file. File1: sc2/80 20 . A T 86 F=5;U=4 sc2/60 55 . G T ... (1 Reply)
Discussion started by: NamS
1 Replies

10. Shell Programming and Scripting

Finding most common substrings

Hello, I would like to know what is the three most abundant substrings of length 6 from col2. The file is quite large and looks like this col1 col2 EN03 typehellobyedogcatcatdog EN09 typehellobyebyebyebye EN08 dogcatcatdogbyebyebyebye EN09 catcattypehellobyebyebyebye... (9 Replies)
Discussion started by: verse123
9 Replies
SWISS::GNs(3pm) 					User Contributed Perl Documentation					   SWISS::GNs(3pm)

Name
       SWISS::GNs.pm

Description
       SWISS::GNs represents the GN lines within an SWISS-PROT + TrEMBL entry as specified in the user manual
	http://www.expasy.org/sprot/userman.html . The GNs object is a container object which holds a list of SWISS::GeneGroup objects.

Inherits from
       SWISS::ListBase.pm

Attributes
       "list"
	     Each list element is a SWISS::GeneGroup object.

       "and" (deprecated, for old format only)
	     Delimiter used between genes. Defaults to " AND ".

       "or" (deprecated, for old format only)
	     Delimiter used between gene names. Defaults to " OR ".

Methods
   Standard methods
       new
       fromText
       toText

   Reading/Writing methods
       text [($newText)]
	   Sets the text of the GN line to the parameter if it is present, and returns the (unwrapped) text of the line.  Also sets 'and' and 'or'
	   delimiters to the first occurrences of the words "OR" and "AND" in the line, conserving the case.

       lowercase (deprecated, for old format only)
	   Sets the GNs::and and GNs::or delimiters to their lower case values.

       uppercase (deprecated, for old format only)
	   Sets the GNs::and and GNs::or delimiters to their upper case values.

       getFirst()
	   Returns first gene name in gene line

       getTags($target)
	   Returns evidence tags associated with $target

	   $target is a string

       isPresent($target)
	   Returns 1 if $target is present in the GN line

	   $target is a string

       needsReCasing($target)
	   If $target is present in the GN line, but wrongly cased, method returns the matching name in its current case

	   $target is a string

       replace($newName, $target, $evidenceTag)
	   Replaces the first GN object in the GN line whose text attribute is $target with a new GN object whose text attribute is set to
	   $newName and whose evidenceTags attribute is is set using values set by splitting $evidenceTag on /, / (as name is not being changed,
	   programs should keep old tag and add new tag).  Does nothing if $target is not found.

       delete($target)
	   Removes synonym/single-member gene group matching $target. Note that if a "Name" is deleted, the first "Synonym" will be promoted to
	   "Name"

       addAsNewSynonym($newName, $target, $evidenceTag, $location)
	   Adds a new GN object (with text attribute set to new $newName, and evidenceTags attribute set to ($evidenceTag)), as a synonym to the
	   first gene group in which $target is a gene name.  Does nothing if $target is not found.  Will not add a duplicate gene name.
	   $location determines where in gene group new object is added: if $location == 1, 2, 3, ..., new object added in the 1st, 2nd, 3rd, ...
	   position; if $location == 0, new object added before $target; if $location == -1, new object added after $target (default); if
	   $location == -2, new object added at end of gene group.  Note that if the new synonym is inserted in the first postion, it will become
	   the "Name" and the previous "Name" will be downgraded to first "Synonym"

       addAsNewGeneGroup($newName, $target, $evidenceTag, $location)
	   Adds a new GeneGroup object, comprising 1 GN object (with text attribute set to new $newName, and evidenceTags attribute set to
	   ($evidenceTag)). Will not add a duplicate gene name.  $location and $target determine where in GNs line new group is added: if
	   $location == 1, 2, 3, ..., new object added in the 1st, 2nd, 3rd, ... position; if $location == 0, new object added before $target; if
	   $location == -1, new object added after $target (default); if $location == -2, new object added at end of GNs line.	Does nothing if
	   $target is not found, and $location == 0 or -1; otherwise $target does not need to be set.

       replaceGeneGroup($newGeneGroup, $target)
	   Replaces the first gene group containing $target with $newGeneGroup.  Creating the $newGeneGroup correctly is the user's responsibility

       getGeneGroup($target)
	   Returns the first gene group that contains $target

       setToOr()
	   Retruns a new GNs object, but with all GNs objects in a single gene group.  Needed when adding 'C' to 'A and B', when the relationship
	   of 'C' to 'A' and 'B' is unknown: the universal use of ' or ' is the default delimeter for TrEMBL entries

TRANSITION
The format of the GN line will change in 2004 from: GN (CYSA1 OR CYSA OR RV3117 OR MT3199 OR MTCY164.27) AND (CYSA2 OR GN RV0815C OR MT0837 OR MTV043.07C). to: GN Name=CysA1; Synonyms=CysA; OrderedLocusNames=Rv3117, MT3199; GN ORFNames=MtCY164.27; GN and GN Name=CysA2; OrderedLocusNames=Rv0815c, MT0837; ORFNames=MTV043.07c; This module supports both formats. To convert an entry from the old to the new format, do: $entry->GNs->is_old_format(0); perl v5.10.1 2006-01-26 SWISS::GNs(3pm)
All times are GMT -4. The time now is 04:22 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy