Making lots of assumptions about the input data, here is a solution that transposes the file, sorts it (in a hybrid manner), and re-transposes:
producing:
Best wishes ... cheers, drl
Hi,
I have a comma delimited file. I want to sort the fields alphabetically and again store them in a comma delimited file.
For example, My file looks like this.
abc,aaa,xyz,xxx,def
pqr,ggg,eee,iii,qqq
zyx,lmo,pqr,abc,fff
and I want my output to look like this, all fields sorted... (3 Replies)
I'm working on formatting some attendance data to meet a vendors requirements to upload to their system. With some help on the forums here, I have the data close. But they've since changed what they want.
The vendor wants me to submit three fields to them. Field 1 is the studentid field,... (4 Replies)
I have a large flat file with variable length fields that are pipe delimited. The file has no new line or CR/LF characters to indicate a new record. I need to parse the file and after some number of fields, I need to insert a CR/LF to start the next record.
Input file ... (2 Replies)
Gents,
I have a large file and each line of the file contains more than 200 bytes.Please let me a way to have the new line to start when the word "FIT" appears.
I was trialling with 'tr' command but i am not sure how to get it based on bytes and so it wasn't working...
Current... (3 Replies)
I'm facing a strange problem, please help me out.
Here we go.
I want to count number of fields in particular file.
filename and delimiter character will be passed through parameter.
On command prompt if i type following i get 27 as output (which is correct)
cat customer.dat | head -1 | awk... (12 Replies)
Hi,
I have a comma (,) delimited file, in which few fields are enclosed with in double quotes " ". I have to print the records in the file which donot have expected number of field with the line number.
File1
====
name,desgnation,doj,project #header#... (7 Replies)
Hi,
I need your help for below with shell scripting or perl
I/P
key, Sentence
customer1, I am David
customer2, I am Taylor
O/P
Key, Words
Customer1,I
Customer1,am
Customer1,David
Customer2,I
Customer2,am
Customer2,Taylor (4 Replies)
Hi,
I am required to arrange columns of a file i.e make the 15th column into the 1st column.
I am doing
awk 'begin {fs=ofs=","} {print $15,$1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12,$13,$14}' ad.data>ad.csv
the problem is that column 15 gets to column 1 but it is not comma separated with the... (10 Replies)
Hi, I have a rquirement in unix as below .
I have a text file with me seperated by | symbol and i need to generate a excel file through unix commands/script so that each value will go to each column.
ex:
Input Text file:
1|A|apple
2|B|bottle
excel file to be generated as output as... (9 Replies)
For an Output like below
Input : <Subject A="I" B="1039502" C="2015-06-30" D="010101010101">
Output : <Subject D="010101010101" B="1039502" C="2015-06-30" A="I">
I have been using something like below but not getting the desired output :
awk -F ' ' '/Subject/ BEGIN{OFS=" ";}... (19 Replies)
Discussion started by: arunkesi
19 Replies
LEARN ABOUT DEBIAN
tabmerge
TABMERGE(1p) User Contributed Perl Documentation TABMERGE(1p)NAME
tabmerge - unify delimited files on common fields
SYNOPSIS
tabmerge [action] [options] file1 file2 [...]
Actions:
--min Take only fields present in all files [DEFAULT]
--max Take all fields present
-f|--fields=f1[,f2] Take only the fields mentioned in the
comma-separated list
Options:
-l|--list List available fields
--fs=x Use "x" as the field separator
(default is tab " ")
--rs=x Use "x" as the record separator
(default is newline "
")
-s|--sort=f1[,f2] Sort data ASCII-betically on field(s)
--stdout Print data in original delimited format
(i.e., not in a table format)
--help Show brief help and quit
--man Show full documentation
DESCRIPTION
This program merges the fields -- not the rows -- of delimited text files. That is, if several files are almost but not quite entirely
unlike each other in their structure (in their field names, numbers or orders), this script allows you to easily unify the files into one
file with all the same fields. The output can be based on fields as determined by the three "action" flags.
For the following examples, consider three files that contain the following fields:
+------------+---------------------------------+
| File | Fields |
+------------+---------------------------------+
| merge1.tab | name, type, position |
| merge2.tab | name, type, position, lod_score |
| merge3.tab | name, position |
+------------+---------------------------------+
To list all available fields in the files and the number of times they are present:
$ tabmerge --list merge*
+-----------+-------------------+
| Field | No. Times Present |
+-----------+-------------------+
| lod_score | 1 |
| name | 3 |
| position | 3 |
| type | 2 |
+-----------+-------------------+
To merge the files on the minimum overlapping fields:
$ tabmerge merge*
+----------+----------+
| name | position |
+----------+----------+
| RM104 | 2.30 |
| RM105 | 4.5 |
| TX5509 | 10.4 |
| UU189 | 19.0 |
| Xpsm122 | 3.3 |
| Xpsr9556 | 4.5 |
| DRTL | 2.30 |
| ALTX | 4.5 |
| DWRF | 10.4 |
+----------+----------+
To merge the files and include all the fields:
$ tabmerge --max merge*
+-----------+----------+----------+--------+
| lod_score | name | position | type |
+-----------+----------+----------+--------+
| | RM104 | 2.30 | RFLP |
| | RM105 | 4.5 | RFLP |
| | TX5509 | 10.4 | AFLP |
| 2.4 | UU189 | 19.0 | SSR |
| 1.2 | Xpsm122 | 3.3 | Marker |
| 1.2 | Xpsr9556 | 4.5 | Marker |
| | DRTL | 2.30 | |
| | ALTX | 4.5 | |
| | DWRF | 10.4 | |
+-----------+----------+----------+--------+
To merge and extract just the "name" and "type" fields:
$ tabmerge -f name,type merge*
+----------+--------+
| name | type |
+----------+--------+
| RM104 | RFLP |
| RM105 | RFLP |
| TX5509 | AFLP |
| UU189 | SSR |
| Xpsm122 | Marker |
| Xpsr9556 | Marker |
| DRTL | |
| ALTX | |
| DWRF | |
+----------+--------+
To merge the files on just the "name" and "lod_score" fields and sort on the name:
$ tabmerge -f name,lod_score -s name merge*
+----------+-----------+
| name | lod_score |
+----------+-----------+
| ALTX | |
| DRTL | |
| DWRF | |
| RM104 | |
| RM105 | |
| TX5509 | |
| UU189 | 2.4 |
| Xpsm122 | 1.2 |
| Xpsr9556 | 1.2 |
+----------+-----------+
To do the same but mimic the original tab-delimited input:
$ tabmerge -f name,lod_score -s name --stdout merge*
name lod_score
ALTX
DRTL
DWRF
RM104
RM105
TX5509
UU189 2.4
Xpsm122 1.2
Xpsr9556 1.2
Why would you want to do this? Suppose you have several delimited text files with nearly the same structure and want to create just one
file from them, but the fields may be in a different order in each file and/or some files may contain more or fewer fields than others.
(As far-fetched as it may seem, it happens to the author more than he'd like.)
SEE ALSO
o Text::RecordParser
o Text::TabularDisplay
AUTHOR
Ken Youens-Clark <kclark@cpan.org>.
LICENSE AND COPYRIGHT
Copyright (C) 2006-10 Ken Youens-Clark. All rights reserved.
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; version 2.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
perl v5.10.1 2010-07-26 TABMERGE(1p)