syncsort


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting syncsort
# 1  
Old 12-30-2010
Question syncsort

I have got the following error messahe in the log file while running the syncsort process in a unix script.
Code:
Starting the Syncsort Process
[SyncSort HP-UX/64 Rel. 3.9.0 Copyright (c) 2004 Syncsort Inc.]
SyncSort : (KEYEXPWARN) the license key (43966) will expire on Feb 28, 2011
           (TECHSVC) please contact Syncsort Technical Support
SyncSort options validated. Processing continues.
SyncSort : (EWRIT) unable to write to /test/ccps/data/ccps_cust_contr_prod_sls_sum.FIFO
           () Broken pipe
SyncSort has aborted
Error while running Summary process using Syncsort.

I don't have any idea on this....can anyone please explain.
# 2  
Old 01-03-2011
Well, a fifo is a pipe is either a special fd of the pair created by pipe() or a named pipe created by the mknod p command, but either way, syncsort is probably doing parallel processing and delivering results via pipes between processes, and some correspondent process at the other end of the pipe died. Maybe you ran out of some resource. You might run it under truss, tusc or strace to see who died of what.

Did you look at that path? Was there a pipe there?
Code:
 
ls -ld  /test/ccps/data/ccps_cust_contr_prod_sls_sum.FIFO
 
Like this:
 
$ /usr/sbin/mknod my_FIFO p
$ ls -ld my_FIFO
prw-r--r--   1 nbkodln    develop          0 Jan  3 16:39 my_FIFO
$

# 3  
Old 01-03-2011
Assuming that this is not a basic scripting error, I suspect that the user running the sort does not have permission to write to the directory /test/ccps/data/ or that the aforementioned directory is placed on a filesystem which is full.
# 4  
Old 01-03-2011
Named pipes need permission, but I believe they do not use any space when written through, as they are just place holders for a pipe() call under the covers, and the data resides in the two apps' buffers as it moves through the pipe.

Sometimes there is an option or environment variable to move such directories to a more appropriate place.

I am not syncsort expert, and it is very proprietary about it's magic, so if you have a license, I bet they are a real good source of information. Also, look in your installation directories for man dirs, html pages and txt files.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. How to Post in the The UNIX and Linux Forums

How to get defined precision after arithmetic operation using syncsort?

I have to do some arithmetic operation on Field 8 which is calculated by Field 9/Field 7 Suppose i have data like : 0800123456|JAN|2017|JAN|2018|0800123456|0|0.0000|0.00| 0800234567|JAN|2017|JAN|2018|0800234567|4|2.5812|10.32| 0800666666|JAN|2017|JAN|2018|0800666666|2|1.7255|3.45|... (0 Replies)
Discussion started by: pumrao
0 Replies

2. Shell Programming and Scripting

syncsort in shell script

hi , As of my understanding syncsort is an utility tool, that can perform sorting, merging, aggregation opertions, that can be uswd across platforms. using shell script we can call this syncsort. my qns is, what are the commands in syncsort say what does the following commands' function, ... (3 Replies)
Discussion started by: captain haddock
3 Replies

3. UNIX for Advanced & Expert Users

Alternative open source to syncsort

Hi, I am looking for an opensource alternate to replace syncsort. Can you please suggest ? (8 Replies)
Discussion started by: AmbikaValagonda
8 Replies

4. Shell Programming and Scripting

calling syncsort in shell script

Hi, pls, tell me how to use syncsort in shell script? if i have to sort a file, what are the syncsort commands i hav to use ? say abc.dat is my file and dt, Id are my key columns. (0 Replies)
Discussion started by: captain haddock
0 Replies

5. UNIX for Dummies Questions & Answers

calling syncsort in shell script

Hi, pls, tell me how to use syncsort in shell script? if i have to sort a file, what are the syncsort commands i hav to use ? say abc.dat is my file and dt, Id are my key columns. (0 Replies)
Discussion started by: captain haddock
0 Replies

6. Shell Programming and Scripting

Syncsort Statistics - Work space used sometimes zero

I've searched previous forums but could not find the answer to my question. What determines how the "Work space used (bytes)" line item in the SyncSort Statistics appears? For instance I have some that show: Records read: 3,273,645 Data read (bytes): ... (2 Replies)
Discussion started by: mango
2 Replies

7. Shell Programming and Scripting

Syncsort is getting killed

Hi All, I am running synsort utility via unix scripts. As soon as the control reaches the syncsort command,Its getting killed. The error message is /proj/cdw/syncsort/dev/copay/CdwWkRvrslFileReformat.syn: 8339696 Killed . Please suggest to overcome this issue. (5 Replies)
Discussion started by: prashantnandi
5 Replies

8. UNIX for Advanced & Expert Users

alternative open source to syncsort/dfsort ?

we use syncsort only as a sorting tool . Does anyone know about a free option for sort large binary files ? Thanks Golan (0 Replies)
Discussion started by: ghadad
0 Replies

9. Shell Programming and Scripting

syncsort error

I am getting the error Syncsort: (INERR) an internal error has occurred (11 in SSTRPHDL) when i run a syncsort. The manual does not give any explanation for this. Could anyone please give what the error is like. Thanks in advance (1 Reply)
Discussion started by: vinod.thayil
1 Replies
Login or Register to Ask a Question