Sponsored Content
Full Discussion: problem in binning the data
Top Forums Shell Programming and Scripting problem in binning the data Post 302688035 by RudiC on Friday 17th of August 2012 12:46:41 PM
Old 08-17-2012
If you would like the bins to be different files called bin"n"_fruit, try this:
Code:
awk '{f=sprintf("%d", 1+$4/1000000); fn[f]="bin"f"_fruits"; print $2,$3,$4 >fn[f]}'

yielding
Code:
ls -1 bi*
bin11_fruits
bin1_fruits
bin2_fruits
bin3_fruits
bin6_fruits

Code:
 cat bin2_fruits 
grapes bananas 1000000
apples bananas 1999999

.
The number of simultaneously open files may be limited though; needs some error checking then.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Problem of Data Loading....

i am studying a script which is used for data loading. it has functions which deletes all the existing data before loading and then loads new fresh data. but i am stuck up at function Replace into table ( col 1,col 2....) Does this signify All Inserts. (1 Reply)
Discussion started by: ankitgupta
1 Replies

2. Shell Programming and Scripting

Please help !!!!Problem with data file

I have a 1 million record file and in there i have 580 bad records meaning like they were spread on to 2 lines and is making my process fail as it is expecting single line records. How can i correct this records spread into 2 lines into single line or how i can writer these records into a new... (34 Replies)
Discussion started by: dsravan
34 Replies

3. Shell Programming and Scripting

Sampling and Binning- Engineering problem

Hi everyone! Can you please help me with some shell scripting? I have an input file input.txt It has 3 columns (Time, Event, Value) Time event Value 03:38:22 A 57 03:38:23 A 56 03:38:24 B 24 03:38:25 C 51 03:38:26 B 7 03:38:26 ... (7 Replies)
Discussion started by: Needhelp2
7 Replies

4. Shell Programming and Scripting

trimming and binning rows

I could not find this on the search.. I want to know how to trim a row so lets say I have a file that looks like this: bob 88888888888888 and I want to trim column 2 (lets say 4 off the front and end) bob 888888 Also, how would I bin column 2 Lets so I want to add and average... (1 Reply)
Discussion started by: phil_heath
1 Replies

5. Shell Programming and Scripting

Binning rows while skipping the first column

Hi I have a file that I want to bin. I am using this code: awk -F'\t' -v r=40 '{for(i=r;i<=NF;i+=r){for(j=0;j<r;j++){sum+=$(i-j)}printf "%s ", sum/r;sum=0}; printf "\n"}' file1 > file2 So basically what this code does is that it will averaging every 40 columns (creating bins of 40). But... (2 Replies)
Discussion started by: phil_heath
2 Replies

6. Shell Programming and Scripting

Data problem

Hi all, suppose i have one file and in that file there are thousand of record like below . if i want to fill the bold position below with some value suppose 000000 then how it would be in shell script ... (1 Reply)
Discussion started by: aishsimplesweet
1 Replies

7. Shell Programming and Scripting

Help to data re-arrangement problem

Input file <data id>="1">\ </data>\ <data id>="2">\ </data>\ <code>="1" target="2">\ </code>\ <data id>="1">\ </data>\ <data id>="2">\ </data>\ <code>="1" target="2">\ </code>\ <data id>="1">\ </data>\ <data id>="2">\ </data>\ <code>="1" target="2">\ </code>\ (2 Replies)
Discussion started by: cpp_beginner
2 Replies

8. Shell Programming and Scripting

Problem tabbing the data.

Hi All, I'm having a problem tabbing the data. can you please help me tab the data. i used sed but it's not working. ex. BUNDLE1MB(6spaces)|Y|ng_oliv10@shellscript.com.ph(6spaces)562.60.61.20(6spaces)562.61.35 here's my code sed "s/ //g" Userid_dsl_npm.txt__200 | sed "s/ |/ /g" |... (2 Replies)
Discussion started by: nikki1200
2 Replies

9. Shell Programming and Scripting

Gnuplot 3d binning

Hello I have a text file with tens of thousands of rows The format is x y where both x and y can be anything between -100 and +100. What I would like to do is have a 3d gnuplot where there are 10,000 squared or bins and each bin will count how many rows have a value that would be... (1 Reply)
Discussion started by: garethsays
1 Replies
OB_START(3)								 1							       OB_START(3)

ob_start - Turn on output buffering

SYNOPSIS
bool ob_start NULL PHP_OUTPUT_HANDLER_STDFLAGS ([callable $output_callback], [int $chunk_size], [int $flags]) DESCRIPTION
This function will turn output buffering on. While output buffering is active no output is sent from the script (other than headers), instead the output is stored in an internal buffer. The contents of this internal buffer may be copied into a string variable using ob_get_contents(3). To output what is stored in the inter- nal buffer, use ob_end_flush(3). Alternatively, ob_end_clean(3) will silently discard the buffer contents. Warning Some web servers (e.g. Apache) change the working directory of a script when calling the callback function. You can change it back by e.g. chdir(dirname($_SERVER['SCRIPT_FILENAME'])) in the callback function. Output buffers are stackable, that is, you may call ob_start(3) while another ob_start(3) is active. Just make sure that you call ob_end_flush(3) the appropriate number of times. If multiple output callback functions are active, output is being filtered sequentially through each of them in nesting order. PARAMETERS
o $output_callback - An optional $output_callback function may be specified. This function takes a string as a parameter and should return a string. The function will be called when the output buffer is flushed (sent) or cleaned (with ob_flush(3), ob_clean(3) or similar func- tion) or when the output buffer is flushed to the browser at the end of the request. When $output_callback is called, it will receive the contents of the output buffer as its parameter and is expected to return a new output buffer as a result, which will be sent to the browser. If the $output_callback is not a callable function, this function will return FALSE. This is the callback signature: string handler (string $buffer, [int $phase]) o $buffer - Contents of the output buffer. o $phase - Bitmask of PHP_OUTPUT_HANDLER_* constants. If $output_callback returns FALSE original input is sent to the browser. The $output_callback parameter may be bypassed by passing a NULL value. ob_end_clean(3), ob_end_flush(3), ob_clean(3), ob_flush(3) and ob_start(3) may not be called from a callback function. If you call them from callback function, the behavior is undefined. If you would like to delete the contents of a buffer, return "" (a null string) from callback function. You can't even call functions using the output buffering functions like print_r($expression, true) or highlight_file($filename, true) from a callback function. Note In PHP 4.0.4, ob_gzhandler(3) was introduced to facilitate sending gz-encoded data to web browsers that support compressed web pages. ob_gzhandler(3) determines what type of content encoding the browser will accept and will return its output accordingly. o $chunk_size - If the optional parameter $chunk_size is passed, the buffer will be flushed after any output call which causes the buffer's length to equal or exceed $chunk_size. The default value 0 means that the output function will only be called when the output buf- fer is closed. Prior to PHP 5.4.0, the value 1 was a special case value that set the chunk size to 4096 bytes. o $flags - The $flags parameter is a bitmask that controls the operations that can be performed on the output buffer. The default is to allow output buffers to be cleaned, flushed and removed, which can be set explicitly via PHP_OUTPUT_HANDLER_CLEANABLE | PHP_OUT- PUT_HANDLER_FLUSHABLE | PHP_OUTPUT_HANDLER_REMOVABLE, or PHP_OUTPUT_HANDLER_STDFLAGS as shorthand. Each flag controls access to a set of functions, as described below: +-----------------------------+---------------------------------------------------+ | Constant | | | | | | | Functions | | | | +-----------------------------+---------------------------------------------------+ | | | |PHP_OUTPUT_HANDLER_CLEANABLE | | | | | | | ob_clean(3), ob_end_clean(3), and | | | ob_get_clean(3). | | | | | | | |PHP_OUTPUT_HANDLER_FLUSHABLE | | | | | | | ob_end_flush(3), ob_flush(3), and | | | ob_get_flush(3). | | | | | | | |PHP_OUTPUT_HANDLER_REMOVABLE | | | | | | | ob_end_clean(3), ob_end_flush(3), and | | | ob_get_flush(3). | | | | +-----------------------------+---------------------------------------------------+ RETURN VALUES
Returns TRUE on success or FALSE on failure. CHANGELOG
+--------+---------------------------------------------------+ |Version | | | | | | | Description | | | | +--------+---------------------------------------------------+ | 7.0.0 | | | | | | | In case ob_start(3) is used inside an output | | | buffer callback, this function will no longer | | | issue an E_ERROR but instead an E_RECOVER- | | | ABLE_ERROR, allowing custom error handlers to | | | catch such errors. | | | | | 5.4.0 | | | | | | | The third parameter of ob_start(3) changed from | | | a boolean parameter called $erase (which, if set | | | to FALSE, would prevent the output buffer from | | | being deleted until the script finished execut- | | | ing) to an integer parameter called $flags. | | | Unfortunately, this results in an API compatibil- | | | ity break for code written prior to PHP 5.4.0 | | | that uses the third parameter. See the flags | | | example for an example of how to handle this with | | | code that needs to be compatible with both. | | | | | 5.4.0 | | | | | | | A chunk size of 1 now results in chunks of 1 | | | byte being sent to the output buffer. | | | | | 4.3.2 | | | | | | | This function was changed to return FALSE in | | | case the passed $output_callback can not be exe- | | | cuted. | | | | +--------+---------------------------------------------------+ EXAMPLES
Example #1 User defined callback function example <?php function callback($buffer) { // replace all the apples with oranges return (str_replace("apples", "oranges", $buffer)); } ob_start("callback"); ?> <html> <body> <p>It's like comparing apples to oranges.</p> </body> </html> <?php ob_end_flush(); ?> The above example will output: <html> <body> <p>It's like comparing oranges to oranges.</p> </body> </html> Example #2 Creating an uneraseable output buffer in a way compatible with both PHP 5.3 and 5.4 <?php if (version_compare(PHP_VERSION, '5.4.0', '>=')) { ob_start(null, 0, PHP_OUTPUT_HANDLER_STDFLAGS ^ PHP_OUTPUT_HANDLER_REMOVABLE); } else { ob_start(null, 0, false); } ?> SEE ALSO
ob_get_contents(3), ob_end_clean(3), ob_end_flush(3), ob_implicit_flush(3), ob_gzhandler(3), ob_iconv_handler(3), mb_output_handler(3), ob_tidyhandler(3). PHP Documentation Group OB_START(3)
All times are GMT -4. The time now is 07:42 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy