The data file is a large data file from the Federal government.
I would like to read the data using stat software packages.
The lines end with \r\n .
Field 4 is a text field. It can have a \n character embedded in it. Stat software package tends to incorrectly split a record with a \n character into two records. Commas are a legitimate part of field 4 (so I should not have had it removed in the sample output). Field 4 is all caps.
I have tried things like
extracting field 1 (the id variable) and field 4 (the value of intereset) from a file
changing "," to "comma" because lowercase letters are not in the datafile
change the pipe to a comma.
the 2nd awk statement was to reshape fields 1 and 4 so that there a line with the id variable for each field 4.
Hi,
I have an input data file :-
Test4599,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,2,0,2,2,Rain
Test90,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,1,0,Not Rain
etc....
I wanted to transpose these data to:-... (2 Replies)
Hi,
I did read a few posts on the subjects, tried out a few solutions, but did not solve my problem.
https://www.unix.com/302121568-post11.html
https://www.unix.com/shell-programming-scripting/137953-large-file-columns-into-rows-etc-4.html
Please help. Problem very similar to the second link... (15 Replies)
Hi I'm looking to transpose Linux data from a daily report that logs every 10mins like below.
After the first "comma" I need the daily total for Col2 and Col3 transposed like below.
The new transposed format below will then be exported to Microsoft Excel for Reporting.
Any help would be... (9 Replies)
Hello. very new to shell scripting and would like to know if anyone could help me.
I have data thats being pulled into a txt file and currently have to manually transpose the data which is taking a long time to do.
here is what the data looks like.
Server1 -- Date -- Other -- value... (7 Replies)
I can no longer find my commands, but I use to be able to transpose data with common fields from a single column to rows using a command line. My data is separated as follows:
NAME=BOB
ADDRESS=COLORADO
PET=CAT
NAME=SUSAN
ADDRESS=TEXAS
PET=BIRD
NAME=TOM
ADDRESS=UTAH
PET=DOG
I would... (7 Replies)
Hi I have below requirement, need help
One file contains the meta data information and other file would have the data, match the column from file1 and with file2 and extract corresponding column value and display in another file
File1:
CUSTTYPECD
COSTCENTER
FNAME
LNAME
SERVICELVL
... (1 Reply)
Hi All,
I have sort of a case to transpose data from rows to column
input data
Afghanistan|10000|1
Albania|25000|4
Algeria|25000|7
Andorra|10000|4
Angola|25000|47
Antigua and Barbuda|25000|23
Argentina|5000|3
Armenia|100000|12
Aruba|20000|2
Australia|50000|2
I need to transpose... (3 Replies)
Hi
I have the following sample of data: my full data dimention is 900,000* 1119
rs987435 C G 1 1 1 0 2
rs345783 C G 0 0 1 0 0
rs955894 G T 1 1 2 2 1
rs6088791 ... (7 Replies)
Discussion started by: marwah
7 Replies
LEARN ABOUT OSX
regexp::common::delimited
Regexp::Common::delimited(3) User Contributed Perl Documentation Regexp::Common::delimited(3)NAME
Regexp::Common::delimited -- provides a regex for delimited strings
SYNOPSIS
use Regexp::Common qw /delimited/;
while (<>) {
/$RE{delimited}{-delim=>'"'}/ and print 'a " delimited string';
/$RE{delimited}{-delim=>'/'}/ and print 'a / delimited string';
}
DESCRIPTION
Please consult the manual of Regexp::Common for a general description of the works of this interface.
Do not use this module directly, but load it via Regexp::Common.
$RE{delimited}{-delim}{-esc}
Returns a pattern that matches a single-character-delimited substring, with optional internal escaping of the delimiter.
When "-delim=S" is specified, each character in the sequence S is a possible delimiter. There is no default delimiter, so this flag must
always be specified.
If "-esc=S" is specified, each character in the sequence S is the delimiter for the corresponding character in the "-delim=S" list. The
default escape is backslash.
For example:
$RE{delimited}{-delim=>'"'} # match "a " delimited string"
$RE{delimited}{-delim=>'"'}{-esc=>'"'} # match "a "" delimited string"
$RE{delimited}{-delim=>'/'} # match /a / delimited string/
$RE{delimited}{-delim=>q{'"}} # match "string" or 'string'
Under "-keep" (See Regexp::Common):
$1 captures the entire match
$2 captures the opening delimiter (provided only one delimiter was specified)
$3 captures delimited portion of the string (provided only one delimiter was specified)
$4 captures the closing delimiter (provided only one delimiter was specified)
$RE{quoted}{-esc}
A synonym for $RE{delimited}{q{-delim='"`}{...}}
SEE ALSO
Regexp::Common for a general description of how to use this interface.
AUTHOR
Damian Conway (damian@conway.org)
MAINTAINANCE
This package is maintained by Abigail (regexp-common@abigail.be).
BUGS AND IRRITATIONS
Bound to be plenty.
For a start, there are many common regexes missing. Send them in to regexp-common@abigail.be.
LICENSE and COPYRIGHT
This software is Copyright (c) 2001 - 2009, Damian Conway and Abigail.
This module is free software, and maybe used under any of the following licenses:
1) The Perl Artistic License. See the file COPYRIGHT.AL.
2) The Perl Artistic License 2.0. See the file COPYRIGHT.AL2.
3) The BSD Licence. See the file COPYRIGHT.BSD.
4) The MIT Licence. See the file COPYRIGHT.MIT.
perl v5.16.2 2010-02-23 Regexp::Common::delimited(3)