Arg List too Long in SCP


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Arg List too Long in SCP
# 1  
Old 02-26-2008
Arg List too Long in SCP

Hey guys. I have a program written in which i am trying to get the files from one remote machine and transferring the files to another remote machine using SCP.

It works fine for 50 or 60 files but when the files grows to 250 then i get an error message stating "Arg list too long".

Code:
#scp -p -B ${SRC} $DEST

Let me know if you would like to see the full code. I know i can accomplish the same task using FTP but was wondering if theres a way to do it through SCP.

Thanks for all your help.
# 2  
Old 02-26-2008
Arg List too Long in SCP

Hey guys. I have a program written in which i am trying to get the files from one remote machine and transferring the files to another remote machine using SCP.

It works fine for 50 or 60 files but when the files grows to 250 then i get an error message stating "Arg list too long".

Code:
#scp -p -B ${SRC} $DEST

Let me know if you would like to see the full code. I know i can accomplish the same task using FTP but was wondering if theres a way to do it through SCP.

Thanks for all your help.
# 3  
Old 02-27-2008
So looks like FTP is my only option.
# 4  
Old 02-27-2008
If you are going to be using ftp, you might want to consider sftp as a more secure option. Also, if you split up your file list so that no more than, say, 50 files are in one list, you could do this by running multiple scp commands.
# 5  
Old 02-27-2008
The problem is that not the command but the shell is expanding your wildcards. This is why you should not use constructs like "ls -1 * | ...." in your scripts offhand. Use "find .... -exec ...." instead.

You will find a detailed explanation of why your script fails here:

https://www.unix.com/unix-advanced-ex...ng-killed.html

One thing I'd ask you to bear in mind though: it is NOT ALLOWED to "bump up" your threads without presenting any new information.

You have to understand, that all the people here are not hired supporters but volunteering to solve your (and others) problems in their free time. It is just plain rude to pester them for not answering immediately or within any time frame you deem sufficient. If you want guaranteed response times hire some support.

Please keep in mind that what you have done here is technically an infraction. I will not hand you one giving you the benefit of doubt but in doing so I'd like to state for the record that you have been officially warned.


bakunin
# 6  
Old 02-27-2008
bakunin and blowtorch thanks for the reply. First of all that was my mistake posting the same question twice. That is why you saw a duplicate 2 replies.

Secondly i was just asking if FTP is my only option. Sorry not trying to be mean or something. I have been using this forums alot and this forums have helped me alot.

Anyways appologies if i did anything wrong.

Thansk
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Arg list too long

Hello All, I am trying to find a file name with .sh exention from a list of .dat files inside a directory. find /app/folder1/* -name '*.dat'| xargs grep '.sh' ksh: /usr/local/bin/find: arg list too long Please help me finding the command. Thanks (3 Replies)
Discussion started by: tkhan9
3 Replies

2. Shell Programming and Scripting

arg list too long error

Hello, I'm trying to search through 30,000 files in 1 directory, and am getting the "arg list too long" error. I've searched this forum and have been playing around with xargs and can't get that to work either. I'm using ksh on Solaris. Here's my original code: nawk "/Nov 21/{_=2}_&&_--"... (14 Replies)
Discussion started by: Kristin_in_CO
14 Replies

3. Shell Programming and Scripting

arg list too long

Hi, Help. I have a file that contains a list of users in a file. I want to cat the content of the file and feed it into sed to a preformated report. The error I got is "ksh: /usr/bin/sed: arg list too long" My method below. A=`cat FILE1.txt` B=`echo $A` sed "s#USERLIST#$B#" FILE2 >... (2 Replies)
Discussion started by: Zenwork
2 Replies

4. UNIX for Dummies Questions & Answers

arg list too long when mv files?

hello all i need some help because i am a unix/linux dummy...i have the following: DIR1> has 121437 files in it with varying dates going back to early April, a sub dir DIR1/DIR2> has 55835 files in it I need to move all files (T*.*) out of DIR1 into DIR2 that are older than today? Ive been... (2 Replies)
Discussion started by: jamos007
2 Replies

5. UNIX for Dummies Questions & Answers

execvp:ar:Arg list too long -> while linking

I get this error : execvp:ar:Arg list too long when i am trying to link the .obj files created on unix box. Any resolution to this? Thanks Mohit (1 Reply)
Discussion started by: mohitp
1 Replies

6. UNIX for Dummies Questions & Answers

ls -t arg list too long

echo dirname/filename* | xargs ls -t As a substitute doesn't give the results desired when I exceed the buffer size. I still want the files listed in chronological order, unfortunately xargs releases the names piecemeal...does anyone have any ideas? :( (4 Replies)
Discussion started by: CSU_Ram
4 Replies

7. UNIX for Advanced & Expert Users

arg list too long

Does anyone have a solution for arg list too long error. I have got this from the web but I fail to make any sense out of it Thanks enc (8 Replies)
Discussion started by: encrypted
8 Replies

8. UNIX for Dummies Questions & Answers

zcat --> Arg list too long

Hi all I have more than 1000 files in a folder and when ever i use a "compress" or "zcat" command it give error /bin/zcat: Arg list too long. . any solution for this :o (3 Replies)
Discussion started by: muneebr
3 Replies

9. UNIX for Dummies Questions & Answers

egrep and Arg list too long

hi everyone, We have a heck of a lot of files in a particular directory and I need to search through all of them to find a list of all files containing particular text strings...one being a date and the other being the name of the report that is printed on the files..... I've tried the... (6 Replies)
Discussion started by: kingo
6 Replies

10. UNIX for Dummies Questions & Answers

arg list too long

I do ls -l ABC*, I get arg list too long message. This will not happen if ABC* has small no of files I believe 4000 files is limit. Any way of avoiding this. I even tried like this for i in `ls -l ABC*` do echo $i done Same problem. Any solution would be great. I am on HP-UX... (5 Replies)
Discussion started by: vingupta
5 Replies
Login or Register to Ask a Question