10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
data.txt has several information like the below..
<SERVER>:WEB:MYDOM01:/tmp/cong/MYDOM01,/tmp/app/MYDOM01
<WEBER>:CANES:https-web01,https-web02:/web/apps/https-web01/config
<SERVER>:WEB:MYDOM07:/tmp/cong/MYDOM07,/tmp/app/MYDOM07... (7 Replies)
Discussion started by: mohtashims
7 Replies
2. Shell Programming and Scripting
Hi,
I am trying to extract a specific information from a file which contains more than 200 million records. Attached the input file for your reference.
My file contains information below
... (4 Replies)
Discussion started by: rramkrishnas
4 Replies
3. Shell Programming and Scripting
Bash scripting beginner here...
I have many folders, each folder representing one subject. Not all subjects have all the required files, so I need to somehow cycle through all the data and then extract the data only from subjects who have no files missing. I tried to output the ls command, but... (4 Replies)
Discussion started by: LeftoverStew
4 Replies
4. Shell Programming and Scripting
I have a csv file that I need to extract some data from depending on another field after reading info from another text file.
The text file would say have 592560 in it.
The csv file may have some data like so
Field 1 Field2 Field3 Field4 Field5 Field6
20009756 1 ... (9 Replies)
Discussion started by: GroveTuckey
9 Replies
5. Shell Programming and Scripting
Hello everybody!
I am quit new here and hope you can help me.
Using an awk script I am trying to extract data from several files. The structure of the input files is as follows:
TimeStep parameter1 parameter2 parameter3 parameter4
e.g.
1 X Y Z L
1 D H Z I
1 H Y E W
2 D H G F
2 R... (2 Replies)
Discussion started by: Daniel8472
2 Replies
6. Shell Programming and Scripting
My input:
Data name: ABC001
Data length: 1000
Detail info
Data Direction Start_time End_time Length
1 forward 10 100 90
1 forward 15 200 185
2 reverse 50 500 450
Data name: XFG110
Data length: 100
Detail info
Data Direction Start_time End_time Length
1 forward 50 100 50 ... (11 Replies)
Discussion started by: patrick87
11 Replies
7. Shell Programming and Scripting
My input:
>seq_1
DSASSTRRARRRRTPRTPSLRSRRSDVTCS
>seq_3
RMRLRRWRKSCSERS*RRSN
>seq_8
RTTGLSERPRLPTTASRSISSRWTR
>seq_10
NELPLEKGSLDSISIE
>seq_9
PNQGDAREPQAHLPRRQGPRDRPLQAYA+
QVQHRRHDHSRTQH*LCRRRQREDCDRLHR
>seq_4
DRGKGQAGCRRPQEGEALVRRCS>seq_6
FA*GLAAQDGEA*SGRG
My output: Extract all... (22 Replies)
Discussion started by: patrick87
22 Replies
8. Shell Programming and Scripting
Hi , I am having a script which will start a process and appends the process related logs to a log file. The log file writes logs with every line starting with date in the format of: date +"%Y %b %d %H:%M:%S".
So, in the script, before I start the process, I am storing the date as DATE=`date +"%Y... (5 Replies)
Discussion started by: chiru_h
5 Replies
9. HP-UX
Hello,
Below is my input file's content ( in HP-UX platform ):
ABCD120672-B21 1
ABCD142257-002 1
ABCD142257-003 1
ABCD142257-006 1
From the above, I just want to get the field of 13 characters that comes after 'ABCD' i.e '120672-B21'... . Could... (2 Replies)
Discussion started by: jansat
2 Replies
10. Shell Programming and Scripting
Hi,
I need to extract the start time value (bold, red font) under the '<LogEvent ID="Timer Start">' tag (black bold) from a file with the following pattern. There are other LogEventIDs listed in the file as well, making it harder for me to extract out the specific start time that I need.
.
.... (7 Replies)
Discussion started by: 60doses
7 Replies
TABMERGE(1p) User Contributed Perl Documentation TABMERGE(1p)
NAME
tabmerge - unify delimited files on common fields
SYNOPSIS
tabmerge [action] [options] file1 file2 [...]
Actions:
--min Take only fields present in all files [DEFAULT]
--max Take all fields present
-f|--fields=f1[,f2] Take only the fields mentioned in the
comma-separated list
Options:
-l|--list List available fields
--fs=x Use "x" as the field separator
(default is tab " ")
--rs=x Use "x" as the record separator
(default is newline "
")
-s|--sort=f1[,f2] Sort data ASCII-betically on field(s)
--stdout Print data in original delimited format
(i.e., not in a table format)
--help Show brief help and quit
--man Show full documentation
DESCRIPTION
This program merges the fields -- not the rows -- of delimited text files. That is, if several files are almost but not quite entirely
unlike each other in their structure (in their field names, numbers or orders), this script allows you to easily unify the files into one
file with all the same fields. The output can be based on fields as determined by the three "action" flags.
For the following examples, consider three files that contain the following fields:
+------------+---------------------------------+
| File | Fields |
+------------+---------------------------------+
| merge1.tab | name, type, position |
| merge2.tab | name, type, position, lod_score |
| merge3.tab | name, position |
+------------+---------------------------------+
To list all available fields in the files and the number of times they are present:
$ tabmerge --list merge*
+-----------+-------------------+
| Field | No. Times Present |
+-----------+-------------------+
| lod_score | 1 |
| name | 3 |
| position | 3 |
| type | 2 |
+-----------+-------------------+
To merge the files on the minimum overlapping fields:
$ tabmerge merge*
+----------+----------+
| name | position |
+----------+----------+
| RM104 | 2.30 |
| RM105 | 4.5 |
| TX5509 | 10.4 |
| UU189 | 19.0 |
| Xpsm122 | 3.3 |
| Xpsr9556 | 4.5 |
| DRTL | 2.30 |
| ALTX | 4.5 |
| DWRF | 10.4 |
+----------+----------+
To merge the files and include all the fields:
$ tabmerge --max merge*
+-----------+----------+----------+--------+
| lod_score | name | position | type |
+-----------+----------+----------+--------+
| | RM104 | 2.30 | RFLP |
| | RM105 | 4.5 | RFLP |
| | TX5509 | 10.4 | AFLP |
| 2.4 | UU189 | 19.0 | SSR |
| 1.2 | Xpsm122 | 3.3 | Marker |
| 1.2 | Xpsr9556 | 4.5 | Marker |
| | DRTL | 2.30 | |
| | ALTX | 4.5 | |
| | DWRF | 10.4 | |
+-----------+----------+----------+--------+
To merge and extract just the "name" and "type" fields:
$ tabmerge -f name,type merge*
+----------+--------+
| name | type |
+----------+--------+
| RM104 | RFLP |
| RM105 | RFLP |
| TX5509 | AFLP |
| UU189 | SSR |
| Xpsm122 | Marker |
| Xpsr9556 | Marker |
| DRTL | |
| ALTX | |
| DWRF | |
+----------+--------+
To merge the files on just the "name" and "lod_score" fields and sort on the name:
$ tabmerge -f name,lod_score -s name merge*
+----------+-----------+
| name | lod_score |
+----------+-----------+
| ALTX | |
| DRTL | |
| DWRF | |
| RM104 | |
| RM105 | |
| TX5509 | |
| UU189 | 2.4 |
| Xpsm122 | 1.2 |
| Xpsr9556 | 1.2 |
+----------+-----------+
To do the same but mimic the original tab-delimited input:
$ tabmerge -f name,lod_score -s name --stdout merge*
name lod_score
ALTX
DRTL
DWRF
RM104
RM105
TX5509
UU189 2.4
Xpsm122 1.2
Xpsr9556 1.2
Why would you want to do this? Suppose you have several delimited text files with nearly the same structure and want to create just one
file from them, but the fields may be in a different order in each file and/or some files may contain more or fewer fields than others.
(As far-fetched as it may seem, it happens to the author more than he'd like.)
SEE ALSO
o Text::RecordParser
o Text::TabularDisplay
AUTHOR
Ken Youens-Clark <kclark@cpan.org>.
LICENSE AND COPYRIGHT
Copyright (C) 2006-10 Ken Youens-Clark. All rights reserved.
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; version 2.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
perl v5.10.1 2010-07-26 TABMERGE(1p)