02-05-2007
Quote:
Originally Posted by c2b2
Hi Every1,
Is there othr way to do the same, because awk will traverse each line and might become slow in case of very huge input file.
Correct me if I am wrong!
There is no way to reformat a file without reading and writing each line in the file. The awk solution would be hard to beat in speed.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I want to take a file that is generated in 132 columns from a unix based report generator and transfer it to a windows environment and preserve the column length. Any ideas how I can do this so that whatever windows based text editor that reads the document will know it should be in 132 columns?... (16 Replies)
Discussion started by: jmossman
16 Replies
2. UNIX for Dummies Questions & Answers
Hi all,
I'm a little stuck with a data file I've been collecting data in. The file contains one field of data running continuously down the file and I can't work out how to format the data into three columns.
This is a mock up of the file: Each r# is a random number and varies in length, this... (3 Replies)
Discussion started by: nistleloy
3 Replies
3. Shell Programming and Scripting
I have a file which contains data in below format:
nbkv28s MgmtReporting -> TradingDesk 1
nbkv28s RMBS -> Credits 178
nbkv28s RMBS -> PassThrough 96
nbkv28s RMBS -> Prepayment 111
nbkv28s RMBS -> RMBSHome 370
nbkv28s RMBS -> TradingStrategy 98
nbkvnze RMBS -> RMBSHome 85
nbkvugn GSF... (3 Replies)
Discussion started by: mohsin.quazi
3 Replies
4. UNIX for Dummies Questions & Answers
Hi,
I have 2 files
File 1:
1 2 3 4 5 6 .......etc until column 300K
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
1 23 21 24 12 22
.
.
etc until row 1411
File 2: (14 Replies)
Discussion started by: sogi
14 Replies
5. Shell Programming and Scripting
Hi all,
I want to read some specific rows & columns in the .xls file with my script to get the data to be manipulated. Now, I can read the .xls file correctly & i can go to the specific sheet that I want but i have a problem to specify the specific rows & columns. I mean, I want to get the info... (0 Replies)
Discussion started by: Yohannita
0 Replies
6. Shell Programming and Scripting
Hi
I have a file that is several gigs in size and basically I want to change the format of it. Obviously I cannot go through it manually.
The file looks like this:
897 2
901 2
905 2
909 2
913 2
917 2
921 2
925 2
929 2
933 2
937 2
941 2
945 2
949 0 (1 Reply)
Discussion started by: kylle345
1 Replies
7. Shell Programming and Scripting
I have two files (csv and vcf) which look exactly like this
S1.csv
func,gene,start,info
"exonic","AL","2309","het"
"exonic","NEF","6912","hom"S1.vcf
##fileinfo
#CHROM POS ID INFO
chr1 4567 rs323211 1/1:84,104,99
chr4 2309 rs346742 1/1:27,213,90
chr6 5834 ... (5 Replies)
Discussion started by: Sarah_19
5 Replies
8. Shell Programming and Scripting
I have a script that creates a file with three column output. The columns look like this:
Policy Name Name Volume
VLS-EDWARDS-ARCHIVED_FILE-WINDOWS 10 12
XLZ-BASE-CYGWIN-ARCHIVED-FILE-LINUX 2 21
ZLX-GOLD-FILES-JAPANFILERS1-LINUX 20 27
ZLX-GOLD-FILES-JAPANFILERS2-LINUX13 29... (4 Replies)
Discussion started by: newbie2010
4 Replies
9. Shell Programming and Scripting
Dear all,
Pzl let me know what is the syntax for converting the columns format to text as i have lots of values for but when i put these values in xls sheet the values are automatically converted to
and one more question i have is how to call values from shell script into perl script
eg.
... (3 Replies)
Discussion started by: sagar_1986
3 Replies
10. Shell Programming and Scripting
Hi guys,
I'm trying to create a table of aggregated data using just bash commands. My data is in three columns, for example:
2014-01-01 testA 64
2014-01-01 testB 27
2014-02-01 testA 31
2014-02-02 testB 29
2014-02-02 testC 12
And the result I am looking for is:
... (4 Replies)
Discussion started by: mccmjc
4 Replies
LEARN ABOUT OPENDARWIN
cut
CUT(1) BSD General Commands Manual CUT(1)
NAME
cut -- select portions of each line of a file
SYNOPSIS
cut -b list [-n] [file ...]
cut -c list [file ...]
cut -f list [-d delim] [-s] [file ...]
DESCRIPTION
The cut utility selects portions of each line (as specified by list) from each file and writes them to the standard output. If no file argu-
ments are specified, or a file argument is a single dash ('-'), cut reads from from the standard input. The items specified by list can be
in terms of column position or in terms of fields delimited by a special character. Column numbering starts from 1.
The list option argument is a comma or whitespace separated set of increasing numbers and/or number ranges. Number ranges consist of a num-
ber, a dash ('-'), and a second number and select the fields or columns from the first number to the second, inclusive. Numbers or number
ranges may be preceded by a dash, which selects all fields or columns from 1 to the first number. Numbers or number ranges may be followed
by a dash, which selects all fields or columns from the last number to the end of the line. Numbers and number ranges may be repeated, over-
lapping, and in any order. It is not an error to select fields or columns not present in the input line.
The options are as follows:
-b list
The list specifies byte positions.
-c list
The list specifies character positions.
-d delim
Use the first character of delim as the field delimiter character instead of the tab character.
-f list
The list specifies fields, delimited in the input by a single tab character. Output fields are separated by a single tab character.
-n Do not split multi-byte characters.
-s Suppress lines with no field delimiter characters. Unless specified, lines with no delimiters are passed through unmodified.
ENVIRONMENT
The LANG, LC_ALL and LC_CTYPE environment variables affect the execution of cut if the -n option is specified. Their effect is described in
environ(7).
EXAMPLES
Extract users' login names and shells from the system passwd(5) file as ``name:shell'' pairs:
cut -d : -f 1,7 /etc/passwd
Show the names and login times of the currently logged in users:
who | cut -c 1-16,26-38
DIAGNOSTICS
The cut utility exits 0 on success, and >0 if an error occurs.
SEE ALSO
paste(1)
STANDARDS
The cut utility conforms to IEEE Std 1003.2-1992 (``POSIX.2'').
HISTORY
A cut command appeared in AT&T System III UNIX.
BUGS
The -c option is a synonym for the -b option, which causes incorrect behaviour in locales that support multibyte characters.
When operating on fields (-f option is specified), cut does not recognise multibyte characters, and the delim character is recognised in the
middle of multibyte sequences.
BSD
June 6, 1993 BSD