Duplicates and unique segregation Post: 302987683

Sponsored Content

Top Forums Shell Programming and Scripting Duplicates and unique segregation Post 302987683 by rbatte1 on Wednesday 14th of December 2016 09:20:32 AM

12-14-2016

Moderator

Welcome ajayr1982,

I have a few to questions pose in response first:-

Is this homework/assignment? There are specific forums for these.
What have you tried so far?
What output/errors do you get?
What OS and version are you using?
What are your preferred tools? (C, shell, perl, awk, etc.)
What logical process have you considered? (to help steer us to follow what you are trying to achieve)

Most importantly, What have you tried so far?

There are probably many ways to achieve most tasks, so giving us an idea of your style and thoughts will help us guide you to an answer most suitable to you so you can adjust it to suit your needs in future.

We're all here to learn and getting the relevant information will help us all.

Additionally, please wrap code, files, input & output/errors in CODE tags, like this:-

Quote:

[CODE]This is my code[/CODE]

to produce the following (fixed character width, space respected):-

Code:

This is my code

Not only does it make posts far easier to read, but CODE and ICODE sections respect multiple space and have fixed width characters, which is important for easily seeing input/output requirements. i have added some to your post. I hope I have guessed correctly.

Thanks, in advance,
Robin

rbatte1

View Public Profile for rbatte1

Visit rbatte1's homepage!

Find all posts by rbatte1

10 More Discussions You Might Find Interesting

1. HP-UX

getting duplicates

how to get duplicates in a file containing data in columns using command or scripting?

2. Shell Programming and Scripting

Non Duplicates

I have input file like below. I00789524 0213 5212 D00789524 0213 5212 I00778787 2154 5412 The first two records are same(Duplicates) except I & D in the first character. I want non duplicates(ie. 3rd line) to be output. How can we get this . Can you help. Is there any single AWK or SED...

3. Shell Programming and Scripting

get part of file with unique & non-unique string

I have an archive file that holds a batch of statements. I would like to be able to extract a certain statement based on the unique customer # (ie. 123456). The end for each statement is noted by "ENDSTM". I can find the line number for the beginning of the statement section with sed. ...

4. UNIX for Dummies Questions & Answers

Duplicates

Hi, How to eliminate the duplicate values in unix? I have a excel file which contains duplicate values. Need to use this in a script. Thanks in advance.

5. Shell Programming and Scripting

Removing duplicates

Hi, I have a file in the below format., test test (10) to to (25) see see (45) and i need the output in the format of test 10 to 25 see 45 Some one help me?

6. Shell Programming and Scripting

select unique values from duplicates in linux

I have values in the variable as so the for loop just fetches one by one params=$'$HEW_SRC_DATABASE_LIB\nprmAttunityUser\nprmAttunityPwd\nprmODBCDataSource\nprmLoadInd\nprmSrc_Lib_ATM\nprmODBCDataSource_ATM' and i have a grep command like this ret=`grep \$y $pf` ...

7. Shell Programming and Scripting

How to ID duplicates in a string

Hi guys, I am trying to identify the number of duplicate entries in a string inputed by the user. Here is a command I use: $ user_input="M T T" $echo "${user_input}" | awk '{for(i=0;i<=NF;i++) print $i }'| sort | uniq -d The above works fine for string with multiple letters. The problem is...

8. Shell Programming and Scripting

Change unique file names into new unique filenames

I have 84 files with the following names splitseqs.1, spliseqs.2 etc. and I want to change the .number to a unique filename. E.g. change splitseqs.1 into splitseqs.7114_1#24 and change spliseqs.2 into splitseqs.7067_2#4 So all the current file names are unique, so are the new file names....

9. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks.

10. Shell Programming and Scripting

Count occurrence of column one unique value having unique second column value

Hello Team, I need your help on the following: My input file a.txt is as below: 3330690|373846|108471 3330690|373846|108471 0640829|459725|100001 0640829|459725|100001 3330690|373847|108471 Here row 1 and row 2 of column 1 are identical but corresponding column 2 value are...

LEARN ABOUT DEBIAN

csv2mipe

CSV2MIPE(1)						User Contributed Perl Documentation					       CSV2MIPE(1)

NAME

       csv2mipe.pl - Generates MIPE file based on 3 tab-delimited files
	 based on MIPE version v1.1
	 arguments: * tab-delimited file with PCR-level data
		    * tab-delimited file with SNP-level data
		    * tab-delimited file with assay-level data

	 Columns in file with PCR-level data:
	   pcr_id
	   pcr_modified (might be multiple, divided by semi-colon ";")
	   pcr_project (might be multiple, divided by semi-colon ";")
	   pcr_researcher (might be multiple, divided by semi-colon ";")
	   pcr_species
	   source_type
	   source_id
	   design_seq
	   primer1_oligo
	   primer1_seq
	   primer1_tm
	   primer2_oligo
	   primer2_seq
	   primer2_tm
	   design_remark (might be multiple, divided by semi-colon ";")
	   use_seq
	   use_revcomp
	   use_remark (might be multiple, divided by semi-colon ";")
	   pcr_remark (might be multiple, divided by semi-colon ";")

	 Columns in file with SNP-level data:
	   pcr_id
	   snp_id
	   snp_pos
	   snp_amb
	   snp_remark (might be multiple, divided by semi-colon ";")

	 Columns in file with assay-level data:
	   pcr_id
	   snp_id
	   assay_id
	   assay_type
	   assay_enzyme
	   assay_oligo
	   assay_specific
	   assay_tail
	   assay_strand
	   assay_remark (might be multiple, divided by semi-colon ";")

SYNOPSIS

       csv2mipe.pl <pcr_file.csv> <snp_file.csv> <assay_file.csv>

ADDITIONAL INFO

       See http://mipe.sourceforge.net

AUTHOR

       Jan Aerts (jan.aerts@bbsrc.ac.uk)

perl v5.14.2							    2005-07-20							       CSV2MIPE(1)

10 More Discussions You Might Find Interesting

1. HP-UX

getting duplicates

Discussion started by: megh

2. Shell Programming and Scripting

Non Duplicates

Discussion started by: awk_beginner

3. Shell Programming and Scripting

get part of file with unique & non-unique string

Discussion started by: andrewsc

4. UNIX for Dummies Questions & Answers

Duplicates

Discussion started by: venkatesht