Sponsored Content
Full Discussion: Cut too slow
Top Forums Shell Programming and Scripting Cut too slow Post 302193670 by drl on Saturday 10th of May 2008 12:57:21 PM
Old 05-10-2008
Hi.

It looks like you are processing one line at time. That will be inherently slow, because you will be loading cut for each line. Let cut process the entire file -- try to re-think your method on a file-based idea, preferably with a pipe, or, at the very least, writing an intermediate file like:
Code:
cut -c19-20 input-file >scratch-file-1

then process the scratch file ... cheers, drl
 

5 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File processing is very slow with cut command

Dear All, I am using the following script to find and replace the date format in a file. The field18 in the file has the following format: "01/26/2010 11:55:14 GMT+04:00" which I want to convert into the following format "20100126115514" for this purpose I am using the following lines of codes:... (5 Replies)
Discussion started by: bilalghazi
5 Replies

2. Shell Programming and Scripting

cut, sed, awk too slow to retrieve line - other options?

Hi, I have a script that, basically, has two input files of this type: file1 key1=value1_1_1 key2=value1_2_1 key4=value1_4_1 ... file2 key2=value2_2_1 key2=value2_2_2 key3=value2_3_1 key4=value2_4_1 ... My files are 10k lines big each (approx). The keys are strings that don't... (7 Replies)
Discussion started by: fzd
7 Replies

3. Shell Programming and Scripting

Cut Command error cut: Bad range

Hi Can anyone what I am doing wrong while using cut command. for f in *.log do logfilename=$f Log "Log file Name: $logfilename" logfile1=`basename $logfilename .log` flength=${#logfile1} Log "file length $flength" from_length=$(($flength - 15)) Log "from... (2 Replies)
Discussion started by: dgmm
2 Replies

4. UNIX for Beginners Questions & Answers

Cut command: can't make it cut fields

I'm a complete beginner in UNIX (and not a computer science student either), just undergoing a tutoring course. Trying to replicate the instructions on my own I directed output of the ls listing command (lists all files of my home directory ) to My_dir.tsv file (see the screenshot) to make use of... (9 Replies)
Discussion started by: scrutinizerix
9 Replies

5. Shell Programming and Scripting

Using :<<cut / cut to comment out block of bash script

I am using : << cut / cut to comment out block of code. Works fine on few lines of script, then it gives me this cryptic error when I try to comment out about 80 lines. The "warning " is at last line of script. done < results 169 echo "END read all positioning parameters" 170... (8 Replies)
Discussion started by: annacreek
8 Replies
HOZ(1)								   User Commands							    HOZ(1)

NAME
hoz - file splitter that uses the hacha file format SYNOPSIS
hoz [-pvf] [-c size[K|M]] [-o outpath] inputfname ghoz DESCRIPTION
HOZ is a file splitter, which uses the same file format as the popular 'Hacha' program. OPTIONS
-c --cut cut (file->pieces) -p --paste paste (pieces->file) -v --verbose verbose output -f --force force overwrite of file when pasting -o --outpath specify an output directory -h --help print this help, then exit --version print hoz program version number, then exit USAGE
There are two basic operations: cut and paste. Cut will 'split' a file in pieces. The size of each piece is passed as an option. Each piece will have a numeric extension, starting with 0. So for instance if you 'cut' a file called 'foo.iso', the pieces will be named 'foo.iso.0', 'foo.iso.1' and so on. Paste will 'merge' these pieces and generate and exact copy of the original file. ghoz is the graphical version of hoz, which uses a GTK GUI interface. SEE ALSO
You can find more information at http://hoz.sourceforge.net/ hoz 1.65 August 2008 HOZ(1)
All times are GMT -4. The time now is 02:25 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy