10 More Discussions You Might Find Interesting
1. UNIX for Beginners Questions & Answers
So, I have three problems that cover this subject.
First one asks me to find the number of fields in the file that contain the substring "he". I found the number of fields, but the problem I have is that they are displaying by each record. I want to add all of the records' fields together.
With... (2 Replies)
Discussion started by: mc10
2 Replies
2. UNIX for Beginners Questions & Answers
Hi,
Below are the sample files. x.txt is from an Excel file that is a list of users from Windows and y.txt is a list of database account.
$ head -500 x.txt y.txt
==> x.txt <==
TEST01 APP_USER_PROFILE
USER03 APP_USER_PROFILE
TEST02 APP_USER_EXP_PROFILE
TEST04 APP_USER_PROFILE
USER01 ... (3 Replies)
Discussion started by: newbie_01
3 Replies
3. Shell Programming and Scripting
Hy!
I need to post-process some data files which have variable (and periodic) number of fields. For example, I need to square (data -> data*data) the folowing data file: -5.34281E-28 -3.69822E-29 8.19128E-29 9.55444E-29 8.16494E-29 6.23125E-29
4.42106E-29 2.94592E-29 1.84841E-29 ... (5 Replies)
Discussion started by: radudownload
5 Replies
4. Shell Programming and Scripting
Hi,
How to print the number of fields in each record with the line number?
Lets saw I have
3212|shipped|received|
3213|shipped|undelivered|
3214|shipped|received|delivered
I tried the code
awk -F '|' '{print NF}'
This gives me ouput as
3
3
4 (5 Replies)
Discussion started by: machomaddy
5 Replies
5. Shell Programming and Scripting
Hi,
I have a comma (,) delimited file, in which few fields are enclosed with in double quotes " ". I have to print the records in the file which donot have expected number of field with the line number.
File1
====
name,desgnation,doj,project #header#... (7 Replies)
Discussion started by: machomaddy
7 Replies
6. Shell Programming and Scripting
I have a file which is delimetered by ',' i need to filter out a file with respect to the number of fileds in each line.
a,s,d,f,g,h,j,k,l
1,2,3,3,4,5,6,7,6
a,2,3
4,5,6,7
in this
i neeed to filter out the lines with 8 column to another file and rest to another file.
so
... (3 Replies)
Discussion started by: ratheeshjulk
3 Replies
7. UNIX for Advanced & Expert Users
I'm facing a strange problem, please help me out.
Here we go.
I want to count number of fields in particular file.
filename and delimiter character will be passed through parameter.
On command prompt if i type following i get 27 as output (which is correct)
cat customer.dat | head -1 | awk... (12 Replies)
Discussion started by: vikanna
12 Replies
8. Shell Programming and Scripting
I am looking for perl code to get following o/p. If a line has more than 7 fields then value in field 7 onwards is BHA_GRP1, BHA_GRP2, BHA_GRP3, BHA_GRP4 etc.
Here is example of what I am trying to achieve.
INPUT File:
VAH NIC_TYPE CONFIG SIZE_GB PILO KOM BHA_GRP1 BHA_GRP2 BHA_GRP3......
2... (1 Reply)
Discussion started by: dynamax
1 Replies
9. Shell Programming and Scripting
Hello,
I have a file with information separated by ";" like this:
ABC;20110126000008;00-10-95-29-17-C6;2;37190292
ABC;20110126000008;00-10-95-29-17-C6;1;53140866
ABC;20110126000008;00-10-05-01-11-38;2;11182251
ABC;20110126000008;00-10-05-01-11-38;1;25952816... (3 Replies)
Discussion started by: rubber08
3 Replies
10. Shell Programming and Scripting
I'm working on formatting some attendance data to meet a vendors requirements to upload to their system. With some help on the forums here, I have the data close. But they've since changed what they want.
The vendor wants me to submit three fields to them. Field 1 is the studentid field,... (4 Replies)
Discussion started by: axo959
4 Replies
TABMERGE(1p) User Contributed Perl Documentation TABMERGE(1p)
NAME
tabmerge - unify delimited files on common fields
SYNOPSIS
tabmerge [action] [options] file1 file2 [...]
Actions:
--min Take only fields present in all files [DEFAULT]
--max Take all fields present
-f|--fields=f1[,f2] Take only the fields mentioned in the
comma-separated list
Options:
-l|--list List available fields
--fs=x Use "x" as the field separator
(default is tab " ")
--rs=x Use "x" as the record separator
(default is newline "
")
-s|--sort=f1[,f2] Sort data ASCII-betically on field(s)
--stdout Print data in original delimited format
(i.e., not in a table format)
--help Show brief help and quit
--man Show full documentation
DESCRIPTION
This program merges the fields -- not the rows -- of delimited text files. That is, if several files are almost but not quite entirely
unlike each other in their structure (in their field names, numbers or orders), this script allows you to easily unify the files into one
file with all the same fields. The output can be based on fields as determined by the three "action" flags.
For the following examples, consider three files that contain the following fields:
+------------+---------------------------------+
| File | Fields |
+------------+---------------------------------+
| merge1.tab | name, type, position |
| merge2.tab | name, type, position, lod_score |
| merge3.tab | name, position |
+------------+---------------------------------+
To list all available fields in the files and the number of times they are present:
$ tabmerge --list merge*
+-----------+-------------------+
| Field | No. Times Present |
+-----------+-------------------+
| lod_score | 1 |
| name | 3 |
| position | 3 |
| type | 2 |
+-----------+-------------------+
To merge the files on the minimum overlapping fields:
$ tabmerge merge*
+----------+----------+
| name | position |
+----------+----------+
| RM104 | 2.30 |
| RM105 | 4.5 |
| TX5509 | 10.4 |
| UU189 | 19.0 |
| Xpsm122 | 3.3 |
| Xpsr9556 | 4.5 |
| DRTL | 2.30 |
| ALTX | 4.5 |
| DWRF | 10.4 |
+----------+----------+
To merge the files and include all the fields:
$ tabmerge --max merge*
+-----------+----------+----------+--------+
| lod_score | name | position | type |
+-----------+----------+----------+--------+
| | RM104 | 2.30 | RFLP |
| | RM105 | 4.5 | RFLP |
| | TX5509 | 10.4 | AFLP |
| 2.4 | UU189 | 19.0 | SSR |
| 1.2 | Xpsm122 | 3.3 | Marker |
| 1.2 | Xpsr9556 | 4.5 | Marker |
| | DRTL | 2.30 | |
| | ALTX | 4.5 | |
| | DWRF | 10.4 | |
+-----------+----------+----------+--------+
To merge and extract just the "name" and "type" fields:
$ tabmerge -f name,type merge*
+----------+--------+
| name | type |
+----------+--------+
| RM104 | RFLP |
| RM105 | RFLP |
| TX5509 | AFLP |
| UU189 | SSR |
| Xpsm122 | Marker |
| Xpsr9556 | Marker |
| DRTL | |
| ALTX | |
| DWRF | |
+----------+--------+
To merge the files on just the "name" and "lod_score" fields and sort on the name:
$ tabmerge -f name,lod_score -s name merge*
+----------+-----------+
| name | lod_score |
+----------+-----------+
| ALTX | |
| DRTL | |
| DWRF | |
| RM104 | |
| RM105 | |
| TX5509 | |
| UU189 | 2.4 |
| Xpsm122 | 1.2 |
| Xpsr9556 | 1.2 |
+----------+-----------+
To do the same but mimic the original tab-delimited input:
$ tabmerge -f name,lod_score -s name --stdout merge*
name lod_score
ALTX
DRTL
DWRF
RM104
RM105
TX5509
UU189 2.4
Xpsm122 1.2
Xpsr9556 1.2
Why would you want to do this? Suppose you have several delimited text files with nearly the same structure and want to create just one
file from them, but the fields may be in a different order in each file and/or some files may contain more or fewer fields than others.
(As far-fetched as it may seem, it happens to the author more than he'd like.)
SEE ALSO
o Text::RecordParser
o Text::TabularDisplay
AUTHOR
Ken Youens-Clark <kclark@cpan.org>.
LICENSE AND COPYRIGHT
Copyright (C) 2006-10 Ken Youens-Clark. All rights reserved.
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; version 2.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
perl v5.10.1 2010-07-26 TABMERGE(1p)