Syncsort Statistics - Work space used sometimes zero


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Syncsort Statistics - Work space used sometimes zero
# 1  
Old 05-09-2011
Syncsort Statistics - Work space used sometimes zero

I've searched previous forums but could not find the answer to my question.

What determines how the "Work space used (bytes)" line item in the SyncSort Statistics appears? For instance I have some that show:


Records read: 3,273,645 Data read (bytes): 1,132,681,170
Records sorted: 3,273,645 Data sorted (bytes): 1,132,681,170
Records output: 3,273,645 Data output (bytes): 1,132,681,170
Input record length: 346 Output record length: 346
Work space used (bytes): 0

And also this:

Records read: 17,233,653 Data read (bytes): 2,240,374,890
Records sorted: 17,233,653 Data sorted (bytes): 2,240,374,890
Records output: 17,233,653 Data output (bytes): 2,240,374,890
Input record length: 130 Output record length: 130
Work space used (bytes): 2,278,948,864

Thank You, in advance.
# 2  
Old 05-10-2011
Assuming this is for the same syncsort statement but different datasets, it is because the working memory available to the process was sufficient to complete the sort in memory. Based on the output, that may be a bad assumption.

Workspace is allocated on disk, is slower. Syncsort is optimized to choose the fastest sort method for a given dataset.
# 3  
Old 05-10-2011
Thanks Jim, that makes sense the smaller file would use the working memory.

Performance is not an issue for us however a recent process failed due with "all available work space is exhausted". The workspace directory is 12 gig so we were suprised for the failure.

We are pulling back reports to see what the workspace directory usage was during that time.

Thanks again
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. How to Post in the The UNIX and Linux Forums

How to get defined precision after arithmetic operation using syncsort?

I have to do some arithmetic operation on Field 8 which is calculated by Field 9/Field 7 Suppose i have data like : 0800123456|JAN|2017|JAN|2018|0800123456|0|0.0000|0.00| 0800234567|JAN|2017|JAN|2018|0800234567|4|2.5812|10.32| 0800666666|JAN|2017|JAN|2018|0800666666|2|1.7255|3.45|... (0 Replies)
Discussion started by: pumrao
0 Replies

2. Shell Programming and Scripting

Pwd with space paths but on the parameter don't work

hi, i'm finding to solve on the parameter: for example: directory Value 1 root@value 1 > pwd /home/user/root/value 1 root@value 1 > pwd | sed 's/ /\\ /g' /home/user/root/value\ 1 root@value 1 > test="$(pwd | sed 's/ /\\ /g')" root@value 1 > echo "$test" /home/user/root/value\ 1 ... (4 Replies)
Discussion started by: gsflash80
4 Replies

3. Shell Programming and Scripting

syncsort in shell script

hi , As of my understanding syncsort is an utility tool, that can perform sorting, merging, aggregation opertions, that can be uswd across platforms. using shell script we can call this syncsort. my qns is, what are the commands in syncsort say what does the following commands' function, ... (3 Replies)
Discussion started by: captain haddock
3 Replies

4. UNIX for Advanced & Expert Users

Alternative open source to syncsort

Hi, I am looking for an opensource alternate to replace syncsort. Can you please suggest ? (8 Replies)
Discussion started by: AmbikaValagonda
8 Replies

5. Shell Programming and Scripting

calling syncsort in shell script

Hi, pls, tell me how to use syncsort in shell script? if i have to sort a file, what are the syncsort commands i hav to use ? say abc.dat is my file and dt, Id are my key columns. (0 Replies)
Discussion started by: captain haddock
0 Replies

6. UNIX for Dummies Questions & Answers

calling syncsort in shell script

Hi, pls, tell me how to use syncsort in shell script? if i have to sort a file, what are the syncsort commands i hav to use ? say abc.dat is my file and dt, Id are my key columns. (0 Replies)
Discussion started by: captain haddock
0 Replies

7. Shell Programming and Scripting

syncsort

I have got the following error messahe in the log file while running the syncsort process in a unix script. Starting the Syncsort Process SyncSort : (KEYEXPWARN) the license key (43966) will expire on Feb 28, 2011 (TECHSVC) please contact Syncsort Technical Support SyncSort... (3 Replies)
Discussion started by: mady135
3 Replies

8. Shell Programming and Scripting

Syncsort is getting killed

Hi All, I am running synsort utility via unix scripts. As soon as the control reaches the syncsort command,Its getting killed. The error message is /proj/cdw/syncsort/dev/copay/CdwWkRvrslFileReformat.syn: 8339696 Killed . Please suggest to overcome this issue. (5 Replies)
Discussion started by: prashantnandi
5 Replies

9. UNIX for Advanced & Expert Users

alternative open source to syncsort/dfsort ?

we use syncsort only as a sorting tool . Does anyone know about a free option for sort large binary files ? Thanks Golan (0 Replies)
Discussion started by: ghadad
0 Replies

10. Shell Programming and Scripting

syncsort error

I am getting the error Syncsort: (INERR) an internal error has occurred (11 in SSTRPHDL) when i run a syncsort. The manual does not give any explanation for this. Could anyone please give what the error is like. Thanks in advance (1 Reply)
Discussion started by: vinod.thayil
1 Replies
Login or Register to Ask a Question