Sponsored Content
Top Forums Shell Programming and Scripting Kindly check:remove duplicates with similar data in front of it Post 302678459 by manigrover on Saturday 28th of July 2012 03:40:00 AM
Old 07-28-2012
Kindly check:remove duplicates with similar data in front of it

Hi all,

I have 2 files containing data like this:


Quote:
1 x
1 x
2 y
2 z
3 s
3 s
3 s
4 g
4 h
5 i
6 k
7 y
Quote:
1 x y z
1 x y z
2 y h f
2 z s k
3 s
3 s
3 s
4 g
4 h
5 i
6 k
7 y
so if there is same entry repeated in the column like1,2,3,4
I have to check if there is different entries column like 2,4
but similar entries for duplicatein column 2 like1,3

the output shuld be like this for first file

Quote:
1 x
2 y,z
3 s
4 g,h
5 i
6 k
7 y
Please let me know scripting regarding this.

In the same way for second file as well if data in colmn 2 is diferent print for duplicate entries arranged it like this
Quote:
1 x y z
2 y,z h,s f,k

Last edited by manigrover; 07-28-2012 at 04:52 AM..
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

remove space in front or end of each field

Hi, I have a txt file called a.txt which contain over 10,000 records and I would like to remove space before comma or after comma....like below: The input (for example two record 00001,00002): 00001,client,card limited ,02292,N ,162:41 , 192, ... (6 Replies)
Discussion started by: happyv
6 Replies

2. Shell Programming and Scripting

sh, ksh: command to remove front spaces from a string?

dear pro-coders, is there any command out there that takes out the front spaces from a string? sample strings: 4 members 5 members 3 members but it has to be like so: 4 members 5 members 3 members (3 Replies)
Discussion started by: pseudocoder
3 Replies

3. Shell Programming and Scripting

Request to check:Remove duplicates

Hi all I have a file with following kind of data I want to remove duplicates according to first column so that output contains Kindly let me scripting regading this. (4 Replies)
Discussion started by: manigrover
4 Replies

4. Shell Programming and Scripting

Request to check remove duplicates but write before it

Hi alll I have a file with following kind input I want in output duplicates should not be there but there should be numbering mentioned before that like (4 Replies)
Discussion started by: manigrover
4 Replies

5. Shell Programming and Scripting

Request to check:remove duplicates and write sytematically

Hi all I have a file with following input It contains 5 columns gene name drug drug ID disease approved Now the same gene is repeated many times with different data in column2,3 ,4,5 I want to arrange dat in such a way that there shuld be one entry in the column(no... (2 Replies)
Discussion started by: manigrover
2 Replies

6. Shell Programming and Scripting

Request to check:remove duplicates only in first column

Hi all, I have an input file like this Now I have to remove duplicates only in first column and nothing has to be changed in second and third column. so that output would be Please let me know scripting regarding this (20 Replies)
Discussion started by: manigrover
20 Replies

7. Shell Programming and Scripting

Kindly check it: Camparison of files only column1 of 2 files

Hi all, I have 2 files in which i have to find commom entries in column 1 an dif soemthing is common write other data of both files in front of it mentioned. Gene symbol and disease name column 1 column2 ARFGEF2 CAD DDEF2 CAD PSCD3 CAD PSCD4 CAD CAMK1... (15 Replies)
Discussion started by: manigrover
15 Replies

8. Shell Programming and Scripting

common entries of first column in 2 or 3 files:kindly check

Hi all, I have 3 files with such data first files second file third file I have to find common entries of first column in two ways 1) between 2 files (2 Replies)
Discussion started by: manigrover
2 Replies

9. Shell Programming and Scripting

Sort data by date first and then remove duplicates

Hi , I have below data inside a file named ref.psv . I want to create a shell script which will do the below 2 points : (1) sort the file content first based on the latest date which is the last column in the file (actual file its the 175th column) (2)after sorting the file based on latest date... (3 Replies)
Discussion started by: samrat dutta
3 Replies
osql(1) 							 FreeTDS Utilities							   osql(1)

NAME
osql - utility to test FreeTDS connections and queries SYNOPSIS
osql -S dsn -U username -P password [-I ini_dir] DESCRIPTION
osql is a diagnostic tool provided as part of FreeTDS. It is a Bourne shell script that checks and reports on your configuration files. If everything checks out OK, it invokes isql. osql works only with the isql that comes with unixODBC. OPTIONS
-S dsn the Data Source Name to which to connect, as known to odbc.ini. -U username database login name. -P password database password. -I ini_dir override odbc.ini file location. EXAMPLE
If you have an odbc.ini with a section like this: [myDSN] servername = myserver TDS_Version = 5.0 You would invoke osql as: osql -S myDSN [...] NOTES
If you can connect with "osql -S servername -U user -P passwd", your FreeTDS ODBC installation is working. osql guesses where unixODBC might look for its odbc.ini by examining the binary. This is not always an effective approach. If it doesn't work, you'll receive a report of candidate strings. Kindly pass along the output to help improve the guessing. If osql cannot intuit your odbc.ini directory, you can force the issue with the -I option. However, you're instructing osql what to test, not where unixODBC will eventually look. Your override is therefore only as good as you are. Look carefully at the error output before overriding. If you have suggestions for ways to make osql more useful as a diagnostic tool, please post them to the FreeTDS mailing list. HISTORY
osql first appeared in FreeTDS 0.65. AUTHORS
The osql utility was written by James K. Lowden doc 13 November 2011 osql(1)
All times are GMT -4. The time now is 05:42 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy