Sponsored Content
Full Discussion: syncsort
Top Forums Shell Programming and Scripting syncsort Post 302484959 by DGPickett on Monday 3rd of January 2011 08:55:13 PM
Old 01-03-2011
Named pipes need permission, but I believe they do not use any space when written through, as they are just place holders for a pipe() call under the covers, and the data resides in the two apps' buffers as it moves through the pipe.

Sometimes there is an option or environment variable to move such directories to a more appropriate place.

I am not syncsort expert, and it is very proprietary about it's magic, so if you have a license, I bet they are a real good source of information. Also, look in your installation directories for man dirs, html pages and txt files.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

syncsort error

I am getting the error Syncsort: (INERR) an internal error has occurred (11 in SSTRPHDL) when i run a syncsort. The manual does not give any explanation for this. Could anyone please give what the error is like. Thanks in advance (1 Reply)
Discussion started by: vinod.thayil
1 Replies

2. UNIX for Advanced & Expert Users

alternative open source to syncsort/dfsort ?

we use syncsort only as a sorting tool . Does anyone know about a free option for sort large binary files ? Thanks Golan (0 Replies)
Discussion started by: ghadad
0 Replies

3. Shell Programming and Scripting

Syncsort is getting killed

Hi All, I am running synsort utility via unix scripts. As soon as the control reaches the syncsort command,Its getting killed. The error message is /proj/cdw/syncsort/dev/copay/CdwWkRvrslFileReformat.syn: 8339696 Killed . Please suggest to overcome this issue. (5 Replies)
Discussion started by: prashantnandi
5 Replies

4. Shell Programming and Scripting

Syncsort Statistics - Work space used sometimes zero

I've searched previous forums but could not find the answer to my question. What determines how the "Work space used (bytes)" line item in the SyncSort Statistics appears? For instance I have some that show: Records read: 3,273,645 Data read (bytes): ... (2 Replies)
Discussion started by: mango
2 Replies

5. UNIX for Dummies Questions & Answers

calling syncsort in shell script

Hi, pls, tell me how to use syncsort in shell script? if i have to sort a file, what are the syncsort commands i hav to use ? say abc.dat is my file and dt, Id are my key columns. (0 Replies)
Discussion started by: captain haddock
0 Replies

6. Shell Programming and Scripting

calling syncsort in shell script

Hi, pls, tell me how to use syncsort in shell script? if i have to sort a file, what are the syncsort commands i hav to use ? say abc.dat is my file and dt, Id are my key columns. (0 Replies)
Discussion started by: captain haddock
0 Replies

7. UNIX for Advanced & Expert Users

Alternative open source to syncsort

Hi, I am looking for an opensource alternate to replace syncsort. Can you please suggest ? (8 Replies)
Discussion started by: AmbikaValagonda
8 Replies

8. Shell Programming and Scripting

syncsort in shell script

hi , As of my understanding syncsort is an utility tool, that can perform sorting, merging, aggregation opertions, that can be uswd across platforms. using shell script we can call this syncsort. my qns is, what are the commands in syncsort say what does the following commands' function, ... (3 Replies)
Discussion started by: captain haddock
3 Replies

9. How to Post in the The UNIX and Linux Forums

How to get defined precision after arithmetic operation using syncsort?

I have to do some arithmetic operation on Field 8 which is calculated by Field 9/Field 7 Suppose i have data like : 0800123456|JAN|2017|JAN|2018|0800123456|0|0.0000|0.00| 0800234567|JAN|2017|JAN|2018|0800234567|4|2.5812|10.32| 0800666666|JAN|2017|JAN|2018|0800666666|2|1.7255|3.45|... (0 Replies)
Discussion started by: pumrao
0 Replies
SPLICE(2)						     Linux Programmer's Manual							 SPLICE(2)

NAME
splice - splice data to/from a pipe SYNOPSIS
#define _GNU_SOURCE /* See feature_test_macros(7) */ #include <fcntl.h> ssize_t splice(int fd_in, loff_t *off_in, int fd_out, loff_t *off_out, size_t len, unsigned int flags); DESCRIPTION
splice() moves data between two file descriptors without copying between kernel address space and user address space. It transfers up to len bytes of data from the file descriptor fd_in to the file descriptor fd_out, where one of the file descriptors must refer to a pipe. The following semantics apply for fd_in and off_in: * If fd_in refers to a pipe, then off_in must be NULL. * If fd_in does not refer to a pipe and off_in is NULL, then bytes are read from fd_in starting from the file offset, and the file offset is adjusted appropriately. * If fd_in does not refer to a pipe and off_in is not NULL, then off_in must point to a buffer which specifies the starting offset from which bytes will be read from fd_in; in this case, the file offset of fd_in is not changed. Analogous statements apply for fd_out and off_out. The flags argument is a bit mask that is composed by ORing together zero or more of the following values: SPLICE_F_MOVE Attempt to move pages instead of copying. This is only a hint to the kernel: pages may still be copied if the kernel cannot move the pages from the pipe, or if the pipe buffers don't refer to full pages. The initial implementation of this flag was buggy: therefore starting in Linux 2.6.21 it is a no-op (but is still permitted in a splice() call); in the future, a correct implementa- tion may be restored. SPLICE_F_NONBLOCK Do not block on I/O. This makes the splice pipe operations nonblocking, but splice() may nevertheless block because the file descriptors that are spliced to/from may block (unless they have the O_NONBLOCK flag set). SPLICE_F_MORE More data will be coming in a subsequent splice. This is a helpful hint when the fd_out refers to a socket (see also the descrip- tion of MSG_MORE in send(2), and the description of TCP_CORK in tcp(7)). SPLICE_F_GIFT Unused for splice(); see vmsplice(2). RETURN VALUE
Upon successful completion, splice() returns the number of bytes spliced to or from the pipe. A return value of 0 means end of input. If fd_in refers to a pipe, then this means that there was no data to transfer, and it would not make sense to block because there are no writers connected to the write end of the pipe. On error, splice() returns -1 and errno is set to indicate the error. ERRORS
EAGAIN SPLICE_F_NONBLOCK was specified in flags, and the operation would block. EBADF One or both file descriptors are not valid, or do not have proper read-write mode. EINVAL The target filesystem doesn't support splicing. EINVAL The target file is opened in append mode. EINVAL Neither of the file descriptors refers to a pipe. EINVAL An offset was given for nonseekable device (e.g., a pipe). EINVAL fd_in and fd_out refer to the same pipe. ENOMEM Out of memory. ESPIPE Either off_in or off_out was not NULL, but the corresponding file descriptor refers to a pipe. VERSIONS
The splice() system call first appeared in Linux 2.6.17; library support was added to glibc in version 2.5. CONFORMING TO
This system call is Linux-specific. NOTES
The three system calls splice(), vmsplice(2), and tee(2), provide user-space programs with full control over an arbitrary kernel buffer, implemented within the kernel using the same type of buffer that is used for a pipe. In overview, these system calls perform the following tasks: splice() moves data from the buffer to an arbitrary file descriptor, or vice versa, or from one buffer to another. tee(2) "copies" the data from one buffer to another. vmsplice(2) "copies" data from user space into the buffer. Though we talk of copying, actual copies are generally avoided. The kernel does this by implementing a pipe buffer as a set of reference- counted pointers to pages of kernel memory. The kernel creates "copies" of pages in a buffer by creating new pointers (for the output buf- fer) referring to the pages, and increasing the reference counts for the pages: only pointers are copied, not the pages of the buffer. In Linux 2.6.30 and earlier, exactly one of fd_in and fd_out was required to be a pipe. Since Linux 2.6.31, both arguments may refer to pipes. EXAMPLE
See tee(2). SEE ALSO
copy_file_range(2), sendfile(2), tee(2), vmsplice(2), pipe(7) COLOPHON
This page is part of release 4.15 of the Linux man-pages project. A description of the project, information about reporting bugs, and the latest version of this page, can be found at https://www.kernel.org/doc/man-pages/. Linux 2017-09-15 SPLICE(2)
All times are GMT -4. The time now is 07:13 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy