Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Limit number of files transferred Post 303010484 by jim mcnamara on Tuesday 2nd of January 2018 08:27:36 AM
Old 01-02-2018
There is a command, parallel, that allows you to perform a selected number of operation all at once. Not all systems have it. Linux generally has it or it can be downloaded and installed.

Poor man's version in bash, using scp to copy files:

Code:
#!/bin/bash
cd /path/to/files/to/send
for fname in *
do
     for (( x=0; x<10; x++ ))
     do
          scp $fname remotebox::  &          
     done
     wait
done

 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

limit to number of files in a given directory

Everyone, We are on a unix AIX 4.3 platform and our application is written as such that all configuration files must reside in a specific directory. Currently there are over 10,000 files in this directory (and growing at about 300 per month). My question is is there a physical limit to the... (2 Replies)
Discussion started by: hedrict
2 Replies

2. Shell Programming and Scripting

How to know number files transferred

Hi, I am transferring files from our local server to remote server using FTP command in a shell script. I am using a the following code, FTPFILE="ercchk*.txt" mput $FTPFILE can any one help me out in calucalating the number of files transfered. help in this regard is highly... (9 Replies)
Discussion started by: azazalis
9 Replies

3. Shell Programming and Scripting

limit the number of jobs to run.

i just want to get the BackGround status and limit the number of jobs to run the at a time. can i able get the back ground exit status ? that i code below. can jobs -l limit the number of jobs to run ? total is this script looks fine ? cat run_job.ksh #!/usr/bin/ksh... (0 Replies)
Discussion started by: GrepMe
0 Replies

4. UNIX for Dummies Questions & Answers

Number of long limit

Hi Hi! I'm currently using AIX 5.2 and would like to know where can i find to see that there's a restriction on the number of login times a user can have. Example, I want give a 2 login per user but some one to give 3 login and some one have to give unlit login time (without logging off the... (2 Replies)
Discussion started by: herath
2 Replies

5. Solaris

How to limit number of Commands

Is there a way that I can limit number of commands that one user can run during period of time. For example Max 10 commands per senconds.:) (3 Replies)
Discussion started by: winger0608
3 Replies

6. UNIX for Dummies Questions & Answers

How files can be transferred from one system to another securely using Linux?

i need to know how files can be transfered from one system to another securely in linux. (9 Replies)
Discussion started by: bibing
9 Replies

7. UNIX Desktop Questions & Answers

limit number of sub-dirs searched for files

using: find . -type f -print|xargs -li "string", how do I limit the dated directories (2010-7-14, 2010-7-13,etc.) to just 2009 & 2010 years of directories to search. We go back to 2004 in our archives, way too many files. (3 Replies)
Discussion started by: MJThom713
3 Replies

8. UNIX for Dummies Questions & Answers

Limit Number of files

hi guys how can i limit number of files in a disk or partition ? or how can i make a limit to inode number for a disk or partition ? ext3 or ext4 file system (1 Reply)
Discussion started by: mhs
1 Replies

9. Solaris

How do files transferred via ftp or sftp gets thier permissions at destination?

We have umask defined under /etc/.login as 022. I have my user specific umask defined in /userhome/.login as 002. I understand ftp will not execute anything at destination, it simply transfers files. But it seem to be using 022 as umask for the files transferred. How does ftp knows what umask... (4 Replies)
Discussion started by: kchinnam
4 Replies

10. Shell Programming and Scripting

How to check whether files are transferred or not using ftp?

Hi, i want to execute a shell script which transfers files from one server to another using ftp in unix. How can i check whether the ftp is successful or not.(i.e files are transferred to destination server). because if i am checking the return code of ftp, it always shows 0 (denoting ftp is... (5 Replies)
Discussion started by: Little
5 Replies
sftp(1) 							   User Commands							   sftp(1)

NAME
sftp - secure file transfer program SYNOPSIS
sftp [-1Cv] [-B buffer_size] [-b batchfile] [-F ssh_config] [-o ssh_option] [-P sftp_server_path] [-R num_requests] [-S program] [-s subsystem | sftp_server] host sftp [[user@]host[:file [file]]] sftp [[user@]host[:dir[/]]] sftp -b batchfile [user@]host DESCRIPTION
The sftp utility is an interactive file transfer program with a user interface similar to ftp(1) that uses the ssh(1) command to create a secure connection to the server. sftp implements the SSH File Transfer Protocol as defined in IETF draft-ietf-secsh-filexfer. There is no relationship between the protocol used by sftp and the FTP protocol (RFC 959) provided by ftp(1). The first usage format causes sftp to connect to the specified host and enter an interactive mode. If a username was provided then sftp tries to log in as the specified user. If a directory is provided then sftp tries to change the current directory on the server to the specified directory before entering the interactive mode. The second usage format retrieves the specified file from the server and copies it to the specified target file or directory on the client. If a username is specified sftp tries to log in as the specified user. OPTIONS
The following options are supported: -b batchfile Batch mode reads a series of commands from an input batchfile instead of stdin. Since it lacks user interac- tion, it should be used in conjunction with non-interactive authentication. A batchfile of - can be used to indicate standard input. sftp aborts if any of the following commands fail: get, put, rm, rename, ln, rm, mkdir, chdir, ls, lchdir, chmod, chown, chgrp, lpwd, and lmkdir. Termination on error can be suppressed on a command by command basis by prefixing the command with a - character (for example, -rm /tmp/blah*). -B buffer_size Specifies the size of the buffer that sftp uses when transferring files. Larger buffers require fewer round trips at the cost of higher memory consumption. The default is 32768 bytes. -C Enables compression, using the -C flag in ssh(1). -F ssh_config Specifies an alternative per-user configuration file for ssh. This option is directly passed to ssh(1). -o ssh_option Specifies an option to be directly passed to ssh(1). -P sftp_server path Executes the specified path as an sftp-server and uses a pipe, rather than an ssh connection, to communicate with it. This option can be useful in debugging the sftp client and server. The -P and -S options are mutu- ally exclusive. -R num_requests Specifies how many requests can be outstanding at any one time. Increasing this can slightly improve file transfer speed but increases memory usage. The default is 16 outstanding requests. -s subsystem | sftp_server Specifies the SSH2 subsystem or the path for an sftp server on the remote host. A path is useful for using sftp over protocol version 1, or when the remote sshd does not have an sftp subsystem configured. -S ssh_program path Uses the specified program instead of ssh(1) to connect to the sftp server. The -P and -S options are mutu- ally exclusive. The program must understand ssh(1) options. -v Raises logging level. This option is also passed to ssh(1). -1 Specifies the use of protocol version 1. OPERANDS
The following operands are supported: hostname | user@hostname The name of the host to which sftp connects and logs into. INTERACTIVE COMMANDS
Once in interactive mode, sftp understands a set of commands similar to those of ftp(1). Commands are case insensitive and path names can be enclosed in quotes if they contain spaces. bye Quits sftp. cd path Changes remote directory to path. chgrp grp path Changes group of file path to grp. grp must be a numeric GID. chmod mode path Changes permissions of file path to mode. chown own path Changes owner of file path to own. own must be a numeric UID. exit Quits sftp. get [flags] remote-path [local-path] Retrieves the remote-path and stores it on the local machine. If the local path name is not specified, it is specified the same name it has on the remote machine. If the -P flag is specified, then the file's full permission and access time are copied too. help Displays help text. Identical to the ? command. lcd path Changes local directory to path. lls [ls-options [path]] Displays local directory listing of either path or current directory if path is not specified. lmkdir path Creates local directory specified by path. ln oldpath newpath Creates a link from oldpath to newpath. lpwd Prints local working directory. ls [-1aflnrSt] [path] Displays remote directory listing of either path or current directory if path is not specified. path can contain wildcards. The ls supports the following options: -a Lists files beginning with a dot (.). -f Does not sort the listing. The default sort order is lexicographical. -l Displays additional details including permissions and ownership information. -n Produces a long listing with user and group information presented numerically. -r Reverses the sort order of the listing. -S Sorts the listing by file size. -t Sorts the listing by last modification time. -1 Produces single column output. lumask umask Sets local umask to umask. mkdir path Creates remote directory specified by path. put [flags] local-path [local-path] Uploads local-path and stores it on the remote machine. If the remote path name is not specified, it is specified the same name it has on the local machine. If the -P flag is specified, then the file's full permission and access time are copied too. pwd Displays remote working directory. quit Quits sftp. rename oldpath newpath Renames remote file from oldpath to newpath. rm path Deletes remote file specified by path. rmdir path Removes remote directory specified by path. symlink oldpath newpath Creates a symbolic link from oldpath to newpath. version Displays the sftp protocol version. # [comment] Include a comment. This is useful in batch files. ! [command] If command is not specified, escapes to the local shell. If command is specified, executes command in the local shell. ? Displays help text. Identical to the help command. EXIT STATUS
The following exit values are returned: 0 Successful completion. >0 An error occurred. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWsshu | +-----------------------------+-----------------------------+ |Interface Stability |Committed | +-----------------------------+-----------------------------+ SEE ALSO
ftp(1), scp(1), ssh(1), ssh-add(1), ssh-keygen(1), sshd(1M), attributes(5) SunOS 5.11 8 Nov 2007 sftp(1)
All times are GMT -4. The time now is 10:01 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy