Sponsored Content
Top Forums Shell Programming and Scripting Getting unique sequences from multiple fasta file Post 303022716 by Ibk on Wednesday 5th of September 2018 04:13:49 PM
Old 09-05-2018
Getting unique sequences from multiple fasta file

Hi,

I have a fasta file with multiple sequences. How can i get only unique sequences from the file.

For example
my_file.fasta

Code:
>seq1
TCTCAAAGAAAGCTGTGCTGCATACTGTACAAAACTTTGTCTGGAGAGATGGAGAATCTCATTGACTTTACAGGTGTGGACGGTCTTCAGAGATGGCTCAAGCTAACATTCCCTGACACACCTATAGGGAAAGAGCTAAC

>seq2
CAATTTTGGCTCCTTCATGTCTGTTGTGCCAGACTTGAGTGAGTTTGAACTGCAAGCAAGAAAGGCAGGTTCAGACCAAGAAAAAGATGCAATATACTCCAAGGCACTGATAGCAGCCACAAGAAAGGCGGCTCCTATTG

>seq3
CGGCCTGTGCATGGACATCAAGCAACGACATGGTGACAAAAGGGCTCAAGTGGTTCGAGGATCAGATAACAAAAGAGAATCCTAAATTTATCTCTTGGCACAAGGAGTATGAATTTTTCAAAAAGAATGTGCCCACAGTT

>seq1
TCTCAAAGAAAGCTGTGCTGCATACTGTACAAAACTTTGTCTGGAGAGATGGAGAATCTCATTGACTTTACAGGTGTGGACGGTCTTCAGAGATGGCTCAAGCTAACATTCCCTGACACACCTATAGGGAAAGAGCTAAC

>seq4
AAACTGCAACTCTCACAAGCAAAGTTGTGGCACAGTTCTCAGTTCCTGGGGTCTATGTTGTTGCTGTGCAAGATATGATCAAAGACATGGTTGCCAGAAGAGGTGGAGGGCCTAAACGCGGAGTCAGTGATGAACACATC

>seq1
TCTCAAAGAAAGCTGTGCTGCATACTGTACAAAACTTTGTCTGGAGAGATGGAGAATCTCATTGACTTTACAGGTGTGGACGGTCTTCAGAGATGGCTCAAGCTAACATTCCCTGACACACCTATAGGGAAAGAGCTAAC

>seq2
CAATTTTGGCTCCTTCATGTCTGTTGTGCCAGACTTGAGTGAGTTTGAACTGCAAGCAAGAAAGGCAGGTTCAGACCAAGAAAAAGATGCAATATACTCCAAGGCACTGATAGCAGCCACAAGAAAGGCGGCTCCTATTG

Note there are 3 copies of seq1 and two copies of seq2. I want to get a new file that contain only one copy of seq1, seq2, seq3 and seq4.

Thanks

Last edited by vgersh99; 09-05-2018 at 05:20 PM.. Reason: code tags, please!
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

trying to grep -v multiple changing sequences from a file

Hello All - I am looking for help on how to solve a re-occuring problem. I have a file with certain sequences in it that need to be removed. The sequences are always different but the fix is always the same remove those sequences and leave the rest. Another team ID's the bad sequences and then I... (3 Replies)
Discussion started by: candyluv030
3 Replies

2. UNIX for Dummies Questions & Answers

Breaking a fasta formatted file into multiple files containing each gene separately

Hey, I've been trying to break a massive fasta formatted file into files containing each gene separately. Could anyone help me? I've tried to use the following code but i've recieved errors every time: for i in *.rtf.out do awk '/^>/{f=++d".fasta"} {print > $i.out}' $i done (1 Reply)
Discussion started by: Ann Mc Cartney
1 Replies

3. Shell Programming and Scripting

Shell script for changing the accession number of DNA sequences in a FASTA file

Hi, I am having a file of dna sequences in fasta format which look like this: >admin_1_45 atatagcaga >admin_1_46 atatagcagaatatatat with many such thousands of sequences in a single file. I want to the replace the accession Id "admin_1_45" similarly in following sequences to... (5 Replies)
Discussion started by: margarita
5 Replies

4. Shell Programming and Scripting

Extract sequences from a FASTA file based on another file

I have two files. File1 is shown below. >153L:B|PDBID|CHAIN|SEQUENCE RTDCYGNVNRIDTTGASCKTAKPEGLSYCGVSASKKIAERDLQAMDRYKTIIKKVGEKLCVEPAVIAGIISRESHAGKVL KNGWGDRGNGFGLMQVDKRSHKPQGTWNGEVHITQGTTILINFIKTIQKKFPSWTKDQQLKGGISAYNAGAGNVRSYARM DIGTTHDDYANDVVARAQYYKQHGY >16VP:A|PDBID|CHAIN|SEQUENCE... (7 Replies)
Discussion started by: nelsonfrans
7 Replies

5. Shell Programming and Scripting

Count and search by sequence in multiple fasta file

Hello, I have 10 fasta files with sequenced reads information with read sizes from 15 - 35 . I have combined the reads and collapsed in to unique reads and filtered for sizes 18 - 26 bp long unique reads. Now i wanted to count each unique read appearance in all the fasta files and make a table... (5 Replies)
Discussion started by: empyrean
5 Replies

6. Shell Programming and Scripting

Shorten header of protein sequences in fasta file

I have a fasta file as follows >sp|O15090|FABP4_HUMAN Fatty acid-binding protein, adipocyte OS=Homo sapiens GN=FABP4 PE=1 SV=3 MCDAFVGTWKLVSSENFDDYMKEVGVGFATRKVAGMAKPNMIISVNGDVITIKSESTFKN TEISFILGQEFDEVTADDRKVKSTITLDGGVLVHVQKWDGKSTTIKRKREDDKLVVECVM KGVTSTRVYERA >sp|L18484|AP2A2_RAT AP-2... (3 Replies)
Discussion started by: alexypaul
3 Replies

7. UNIX for Dummies Questions & Answers

Select distinct sequences from fasta file and list

Hi How can I extract sequences from a fasta file with respect a certain criteria? The beginning of my file (containing in total more than 1000 sequences) looks like this: >H8V34IS02I59VP SDACNDLTIALLQIAREVRVCNPTFSFRWHPQVKDEVMRECFDCIRQGLG YPSMRNDPILIANCMNWHGHPLEEARQWVHQACMSPCPSTKHGFQPFRMA... (6 Replies)
Discussion started by: Marion MPI
6 Replies

8. UNIX for Beginners Questions & Answers

How to count the length of fasta sequences?

I could calculate the length of entire fasta sequences by following command, awk '/^>/{if (l!="") print l; print; l=0; next}{l+=length($0)}END{print l}' unique.fasta But, I need to calculate the length of a particular fasta sequence specified/listed in another txt file. The results to to be... (14 Replies)
Discussion started by: dineshkumarsrk
14 Replies

9. Shell Programming and Scripting

Shorten header of protein sequences in fasta file to only organism name

I have a fasta file as follows >sp|Q8WWQ8|STAB2_HUMAN Stabilin-2 OS=Homo sapiens OX=9606 GN=STAB2 PE=1 SV=3 MMLQHLVIFCLGLVVQNFCSPAETTGQARRCDRKSLLTIRTECRSCALNLGVKCPDGYTM ITSGSVGVRDCRYTFEVRTYSLSLPGCRHICRKDYLQPRCCPGRWGPDCIECPGGAGSPC NGRGSCAEGMEGNGTCSCQEGFGGTACETCADDNLFGPSCSSVCNCVHGVCNSGLDGDGT... (3 Replies)
Discussion started by: jerrild
3 Replies

10. UNIX for Beginners Questions & Answers

How to add specific bases at the beginning and ending of all the fasta sequences?

Hi, I have to add 7 bases of specific nucleotide at the beginning and ending of all the fasta sequences of a file. For example, I have a multi fasta file namely test.fasta as given below test.fasta >TalAA18_Xoo_CIAT_NZ_CP033194.1:_2936369-2939570:+1... (1 Reply)
Discussion started by: dineshkumarsrk
1 Replies
Bio::Tools::pSW(3pm)					User Contributed Perl Documentation				      Bio::Tools::pSW(3pm)

NAME
Bio::Tools::pSW - pairwise Smith Waterman object SYNOPSIS
use Bio::Tools::pSW; use Bio::AlignIO; my $factory = Bio::Tools::pSW->new( '-matrix' => 'blosum62.bla', '-gap' => 12, '-ext' => 2, ); #use the factory to make some output $factory->align_and_show($seq1,$seq2,STDOUT); # make a Bio::SimpleAlign and do something with it my $aln = $factory->pairwise_alignment($seq1,$seq2); my $alnout = Bio::AlignIO->new(-format => 'msf', -fh => *STDOUT); $alnout->write_aln($aln); INSTALLATION
This module is included with the central Bioperl distribution: http://bio.perl.org/Core/Latest ftp://bio.perl.org/pub/DIST Follow the installation instructions included in the INSTALL file. DESCRIPTION
pSW is an Alignment Factory for protein sequences. It builds pairwise alignments using the Smith-Waterman algorithm. The alignment algorithm is implemented in C and added in using an XS extension. The XS extension basically comes from the Wise2 package, but has been slimmed down to only be the alignment part of that (this is a good thing!). The XS extension comes from the bioperl-ext package which is distributed along with bioperl. Warning: This package will not work if you have not compiled the bioperl-ext package. The mixture of C and Perl is ideal for this sort of problem. Here are some plus points for this strategy: Speed and Memory The algorithm is actually implemented in C, which means it is faster than a pure perl implementation (I have never done one, so I have no idea how faster) and will use considerably less memory, as it efficiently assigns memory for the calculation. Algorithm efficiency The algorithm was written using Dynamite, and so contains an automatic switch to the linear space divide-and-conquer method. This means you could effectively align very large sequences without killing your machine (it could take a while though!). FEEDBACK
Mailing Lists User feedback is an integral part of the evolution of this and other Bioperl modules. Send your comments and suggestions preferably to one of the Bioperl mailing lists. Your participation is much appreciated. bioperl-l@bioperl.org - General discussion http://bioperl.org/wiki/Mailing_lists - About the mailing lists Support Please direct usage questions or support issues to the mailing list: bioperl-l@bioperl.org rather than to the module maintainer directly. Many experienced and reponsive experts will be able look at the problem and quickly address it. Please include a thorough description of the problem with code and data examples if at all possible. Reporting Bugs Report bugs to the Bioperl bug tracking system to help us keep track the bugs and their resolution. Bug reports can be submitted via the web: https://redmine.open-bio.org/projects/bioperl/ AUTHOR
Ewan Birney, birney-at-sanger.ac.uk or birney-at-ebi.ac.uk CONTRIBUTORS
Jason Stajich, jason-at-bioperl.org APPENDIX
The rest of the documentation details each of the object methods. Internal methods are usually preceded with an underscore "_". pairwise_alignment Title : pairwise_alignment Usage : $aln = $factory->pairwise_alignment($seq1,$seq2) Function: Makes a SimpleAlign object from two sequences Returns : A SimpleAlign object Args : align_and_show Title : align_and_show Usage : $factory->align_and_show($seq1,$seq2,STDOUT) matrix Title : matrix() Usage : $factory->matrix('blosum62.bla'); Function : Reads in comparison matrix based on name : Returns : Argument : comparison matrix gap Title : gap Usage : $gap = $factory->gap() #get : $factory->gap($value) #set Function : the set get for the gap penalty Example : Returns : gap value Arguments : new value ext Title : ext Usage : $ext = $factory->ext() #get : $factory->ext($value) #set Function : the set get for the ext penalty Example : Returns : ext value Arguments : new value perl v5.14.2 2012-03-02 Bio::Tools::pSW(3pm)
All times are GMT -4. The time now is 10:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy