join - using *only* tab as a field separator


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting join - using *only* tab as a field separator
# 1  
Old 06-15-2009
join - using *only* tab as a field separator

I have files with tabs separating the fields but those fields values can have whitespace characters (basically a text string). I want to instruct join to not consider white spaces as separators but only tabs.


I have tried:
join -t "<Tab>" file1 file2
join -t "<tab>" file1 file2
join -t "\t" file1 file2
# 2  
Old 06-15-2009
kindly submit some input texts and the desired output text
BR
# 3  
Old 06-15-2009
can't do tabs on forums but here:

file1
abc def <Tab> X1
ghi jkl <Tab> X2

file2
abc def <Tab> Y1
ghi jkl <Tab> Y2

output
abc def <Tab> X1 <Tab> Y1
ghi jkl <Tab> X2 <Tab> Y2
# 4  
Old 06-15-2009
Code:
use this code:-

nawk  '
NR==FNR {
a[$1$2]=$3 ; next
}

{ print s=( $1$2 in a ) ? $1FS$2FS"\t"FS$3FS"\t"FS a[$1$2] :  $0 RS }

'  file2 file1

note:- if you don't have nawk use /usr/xpg4/bin/awk

BR


Last edited by ahmad.diab; 06-15-2009 at 01:28 PM..
# 5  
Old 06-15-2009
To keep the forums high quality for all users, please take the time to format your posts correctly.

First of all, use Code Tags when you post any code or data samples so others can easily read your code. You can easily do this by highlighting your code and then clicking on the # in the editing menu. (You can also type code tags [code] and [/code] by hand.)

Second, avoid adding color or different fonts and font size to your posts. Selective use of color to highlight a single word or phrase can be useful at times, but using color, in general, makes the forums harder to read, especially bright colors like red.

Third, be careful when you cut-and-paste, edit any odd characters and make sure all links are working property.

Thank You.

The UNIX and Linux Forums
# 6  
Old 06-15-2009
Code:
thanks Mr. vgersh99 for the advice..hope you can understand the code now after modification :)

# 7  
Old 06-15-2009
It seems to me the solution you propose would only work if there is only 1 space in the first expression but wouldn't if it had multiple (ie "a b cdef"). Anyways, I tried a solution of my own, which isn't that pretty, but works.


1. substitute spaces to @@@
2. substitute tab to space
3. join
4. revert space to tab
5. revert @@@ to space

Code:
sed -e 's/ /@@@/g' ./temp/file1 | sed -e 's/<tab>/ /g' > ./temp/file1.rdy2join

sed -e 's/ /@@@/g' ./temp/file2 | sed -e 's/<tab>/ /g' > ./temp/file2.rdy2join

join -t " " -1 1 -2 1 ./temp/file1.rdy2join ./temp/file2.rdy2join > ./temp/output

then I reverted with sed again.

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Inserting a field without disturbing field separator on other fields

Hi All, I have the input as below: cat input 032016002 2.891 97.109 16.605 27.172 24.017 32.207 0.233 0.021 39.810 0.077 0.026 19.644 13.882 0.131 11.646 0.102 11.449 76.265 23.735 16.991 83.009 8.840 91.160 0.020 99.980 52.102 47.898 44.004 55.996 39.963 18.625 0.121 1.126 40.189... (15 Replies)
Discussion started by: am24
15 Replies

2. Shell Programming and Scripting

Field separator

Hello All, I have a file, but I want to separate the file at a particular record with comma"," in the line Input file APPLE6SSAMSUNGS5PRICEPERPIECEDOLLAR600EACH010020340URX581949695US to Output file APPLE6S,SAMSUNGS5,PRICEPERPIECE,DOLLAR600EACH,010020340URX581949695,US This is for... (11 Replies)
Discussion started by: m6248m
11 Replies

3. Shell Programming and Scripting

Substitute newline with tab at designated field separator

Hello, I need to replace newline with tab at certain lines of the file (every four lines is a record). infile.fq: @GAIIX-300 ATAGTCAAAT + _SZS^\\\cd @GAIIX-300 CATACGACAT + hhghfdffhh @GAIIX-300 GACGACGTAT + gggfcfoutfile: @GAIIX-300 ATAGTCAAAT + _SZS^\\\cd @GAIIX-300 ... (6 Replies)
Discussion started by: yifangt
6 Replies

4. UNIX for Dummies Questions & Answers

change field separator only from nth field until NF

Hi ! input: 111|222|333|aaa|bbb|ccc 999|888|777|nnn|kkk 444|666|555|eee|ttt|ooo|ppp With awk, I am trying to change the FS "|" to "; " only from the 4th field until the end (the number of fields vary between records). In order to get: 111|222|333|aaa; bbb; ccc 999|888|777|nnn; kkk... (1 Reply)
Discussion started by: beca123456
1 Replies

5. UNIX for Dummies Questions & Answers

how to join two files using "Join" command with one common field in this problem?

file1: Toronto:12439755:1076359:July 1, 1867:6 Quebec City:7560592:1542056:July 1, 1867:5 Halifax:938134:55284:July 1, 1867:4 Fredericton:751400:72908:July 1, 1867:3 Winnipeg:1170300:647797:July 15, 1870:7 Victoria:4168123:944735:July 20, 1871:10 Charlottetown:137900:5660:July 1, 1873:2... (2 Replies)
Discussion started by: mindfreak
2 Replies

6. Shell Programming and Scripting

how to convert comma delimited file to tab separator

Hi all, How can i convert comma delimited .csv file to tab separate using sed command or script. Thanks, Krupa (4 Replies)
Discussion started by: krupasindhu18
4 Replies

7. Shell Programming and Scripting

Field separator X'1F'

Hi, I have a flat file with fields separated by a X'1F' i have to fetch 4th field from second line. please help me how to achieve it. I tried with below command and its not working. cut -f4 -d`echo -e '\x1f'` filename.txt I am using SunOS. Thanks in advance. (2 Replies)
Discussion started by: rohan10k
2 Replies

8. Shell Programming and Scripting

awk, comma as field separator and text inside double quotes as a field.

Hi, all I need to get fields in a line that are separated by commas, some of the fields are enclosed with double quotes, and they are supposed to be treated as a single field even if there are commas inside the quotes. sample input: for this line, 5 fields are supposed to be extracted, they... (8 Replies)
Discussion started by: kevintse
8 Replies

9. Shell Programming and Scripting

field separator in Perl

is there a similar parameter you can set in perl like FS in awk? I think I've read all the tutorials on the subject, but cannot get this map split and so on thing to work. I need to sort a file by columns, eg. first, third, fifth... The script I need to add this column sorting is this: use... (38 Replies)
Discussion started by: ahsog
38 Replies

10. UNIX for Dummies Questions & Answers

How do I specify tab as field separator for sort?

I'm trying to use sort on a file with tab-delimited fields. I can't figure out how to tell sort to use the tab character as the field separator. I'm trying this on both an HP Unix system and on OS X (using bash on both). Things I've tried: sort -t\t sort -t"\t" sort -t\"\t\" I've tried... (8 Replies)
Discussion started by: SSteve
8 Replies
Login or Register to Ask a Question