Sponsored Content
Full Discussion: Slow FFT in ksh93 and awk.
Operating Systems OS X (Apple) Slow FFT in ksh93 and awk. Post 303023185 by Corona688 on Wednesday 12th of September 2018 06:17:50 PM
Old 09-12-2018
Another thing you can do to speed it up is keep it running - feed it input and read it output at need, rather than starting and killing it all the time. How to do that depends on what your input data would look like and what you'd want for your output data.
This User Gave Thanks to Corona688 For This Post:
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

echo is too slow. HELP with Awk

Hello All, Below is a simple script i worte to find the 208th char in a file. If the char = "C" then I re-direct the line to a file called change.txt. If it is not "C" then I re-direct it to a file called delete.txt. My problem is I have a file 0f 500K lines. this script is very slow. I am... (4 Replies)
Discussion started by: eja
4 Replies

2. Shell Programming and Scripting

ksh93 deprecation...

Any means of running ksh93 in a ksh88-mode? Might sound odd, but I want/need to restrict U/Win-developed scripts to correspond to the ksh88 version on my Solaris environment(s). Thanks. (2 Replies)
Discussion started by: curleb
2 Replies

3. Shell Programming and Scripting

ksh88 or ksh93

Hi all! Does anybody know how can I check if any UNIX installation has implemented ksh88 or ksh93? Thanks in advance. Néstor. (3 Replies)
Discussion started by: Nestor
3 Replies

4. Shell Programming and Scripting

The builtin split function in AWK is too slow

I have a text file that contains 4 million lines, each line contains 2 fields(colon as field separator). as shown: 123:444,555,666,777,888,345 233:5444,555,666,777,888,345 623:454,585,664,773,888,345 ...... Here I have to split the second field(can be up to 40,000 fields) by comma into an... (14 Replies)
Discussion started by: kevintse
14 Replies

5. Shell Programming and Scripting

cut, sed, awk too slow to retrieve line - other options?

Hi, I have a script that, basically, has two input files of this type: file1 key1=value1_1_1 key2=value1_2_1 key4=value1_4_1 ... file2 key2=value2_2_1 key2=value2_2_2 key3=value2_3_1 key4=value2_4_1 ... My files are 10k lines big each (approx). The keys are strings that don't... (7 Replies)
Discussion started by: fzd
7 Replies

6. Shell Programming and Scripting

Making a faster alternative to a slow awk command

Hi, I have a large number of input files with two columns of numbers. For example: 83 1453 99 3255 99 8482 99 7372 83 175 I only wish to retain lines where the numbers fullfil two requirements. E.g: =83 1000<=<=2000 To do this I use the following... (10 Replies)
Discussion started by: s052866
10 Replies

7. UNIX for Advanced & Expert Users

Ksh93 on Linux compatible with ksh93 on AIX

Hi Experts, I have several shell scripts that have been developed on a Linux box for korn ksh93. If we want to run this software on an AIX 6.1 box that runs ksh88 by default can we just change the she-bang line to reference /bin/ksh93 which ships with AIX as its "enhanced shell" to ensure... (6 Replies)
Discussion started by: Keith Turley
6 Replies

8. OS X (Apple)

FFT for the AMIGA through ksh88 shell.

I don't know if anyone is interested but I have been meddling with FFT for the AMIGA. (Sadly we AMIGAns don't have these luxuries through any scripting language. Below is a Python snippet that uses the builtin 'cmath' module to work with the lowly Python 2.0.1 for the AMIGA. It is part of a... (0 Replies)
Discussion started by: wisecracker
0 Replies

9. AIX

Ksh93/AIX compatibility

Hi everyone ! Im trying to know from wich version of AIX KSH93 is available ? Internet tell me 6.x and 7.x AIX are available, bue what about 5.x ? Is KSH93 available on AIX 5.x ? Is it the same way to manipulate variables as KSH93 on 7.x ? Thanks for your support and have a nice day ! (2 Replies)
Discussion started by: majinfrede
2 Replies

10. OS X (Apple)

FFT for Python 2.0.x to 3.7.0.

Hi guys... This is code that was originally designed to work on an upgraded AMIGA A1200 using Python 2.0.x. Unfortunately it broke inside much later versions, NOT because of the print statement/function but other minor subtleties. So this is the final result tested on various machines including... (0 Replies)
Discussion started by: wisecracker
0 Replies
PIPEMETER(1)						      General Commands Manual						      PIPEMETER(1)

NAME
pipemeter - measure speed of data going through a pipe/redirection SYNOPSIS
pipemeter [ -alV ] [ -s size ] [ -b block_size ] [ -m max_block_size ] [ -i interval ] [ -f infile -f infile2 ] infile infile2 ... DESCRIPTION
pipemeter simply takes input on stdin, and redirects it to its stdout. While doing this, it measures how fast the data is moving through it. Alternatively, with the -s parameter, shows a progress bar as data is piped through it. All output generated by pipemeter is written to stderr. While running in progress mode, pipemeter will display the ETA (Estimated Time of Arrival). When exiting, it will change this field to show the elapsed time for the program. In rate-only mode, it will just show elapsed time. Note that as of pipemeter 0.8, Adaptive Block Sizing is used to speed up the movement of data through it. It will increase, or sometimes decrease, the block size in an attempt to find the one that works best for the combination of input and output. This also helps it deal better with, for instance, a temporarily busy disk. You can use -a to turn it off. -s, --size size Sets the size of the input, and turns on the progress bar. -b, --blocksize block_size Sets the size of blocks, in bytes, to move through the program at once. Default is 8192. A suffix of K means Kilobytes(x*1024) means Megabytes(x*1024*1024), and G means Gigabytes(x*1024*1024*1024). -m, --maxblock max_block_size Sets the maxium block size for adaptive block sizing. Default is 8M. -i, --interval interval Specify the number of seconds between updates on the speed and/or progress bar. -f, --file infile infile specifies a file to be read instead of stdin. It will also automatically turn on the progress bar if a size can be deter- mined. Multiple occurances of -f will read the files in the order they are specified on the cmdline, and sizes will be added to eachother. Note that this option remains for backward compatibility, it is far simpler to just specify the input files without options. -F, --list listfile specifies a file to read in the list of input files from. Each line is a path to a file, terminated by a newline. -r, --report report only mode. This causes the program to suppress outputting/calculating while running. It will print out only one line. -a, --autooff turn off adaptive block sizing. Sometimes ABS can use insane amounts of RAM, such as when reading and writing to RAM disks. -V, --version Prints a version number and exits. -l, --log Turns on logging mode. Uses only newlines, no returns. AUTHOR
Written by Clint Byrum <cbyrum@spamaps.org> COPYRIGHT
Copyright (C) 2006 Clint Byrum This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PAR- TICULAR PURPOSE. PIPEMETER(1)
All times are GMT -4. The time now is 05:32 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy