Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Argument list too long w/ sed
Top Forums UNIX for Advanced & Expert Users Argument list too long w/ sed Post 302850589 by jim mcnamara on Thursday 5th of September 2013 05:44:43 AM
Old 09-05-2013
78000 file names is a lot of text when taken together. ARG_MAX is the limit to the total size of the arguments in bytes given to a command, including all env variables (like PATH, etc.)

one way around the problem, if I get what you are doing with sed:
Code:
ls | while read fname 
do 
 md5sum $fname | gsed -e s/\([^ ]*\) \(.*\(\..*\)\)$/mv -v \2 \1\3/e'
done [... more code]

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Argument list too long - Shell error

Trying to tar specific files from a directory causes problems when the number of files is too large. ls ~/logs | wc -l 5928 In the logs directory - I have 5928 files If I want to include all files with today's date - I run the following command tar cf ~/archive/LoadLogs_20060302.tar... (8 Replies)
Discussion started by: dad5119
8 Replies

2. UNIX for Dummies Questions & Answers

Argument list too long - SSH

Hi I executed the code for file in `ls pdb*.ent` do new_name=`echo $file | sed 's/^pdb//;s/.ent/.txt/'` mv $file $new_name done Its giving error at ' ls pdb*.ent' argument list too long i have around 150000 entries please help Thank you (6 Replies)
Discussion started by: empyrean
6 Replies

3. Shell Programming and Scripting

Argument too long list error

I have a wrote a script which consits of the below line.. Below of this script I'm getting this error "ksh: /usr/bin/ls: arg list too long" The line is log_file_time=`ssh -i $HOME/.ssh/id_rsa -q $i ls -lrt /bp/karthik/test/data/log/$abc*|tail -1|awk '{print $8}'` And $abc alias is as "p |... (1 Reply)
Discussion started by: 22karthikreddy
1 Replies

4. UNIX for Dummies Questions & Answers

Argument list too long for Sed command

Hi guys Following command results in sed -i 's/#/\\#/g' /home/test/sqlstents* -bash: /bin/sed: Argument list too long Please help me solve it.. is there any other way i can do this?.. thanks (4 Replies)
Discussion started by: depakjan
4 Replies

5. Shell Programming and Scripting

Argument list too long problem

I have a huge set of files (with extension .common) in my directory around 2 million. When I run this script on my Linux with BASH, I get /bin/awk: Argument list too long awk -F'\t' ' NR == FNR { a=NR } NR != FNR { sub(".common", "", FILENAME) print a, FILENAME, $1 } '... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies

6. Shell Programming and Scripting

Argument list too long!!

Dear Experts, I have a list of 10K files in a directory. I am not able to execute any commands lile ls -lrt, awk, sed, mv, etc........ I wanna execute below command and get the output. How can I achieve it?? Pls help. root# awk -F'|' '$1 == 1' file_20120710* | wc -l /bin/awk: Argument list... (2 Replies)
Discussion started by: Naga06
2 Replies

7. Shell Programming and Scripting

grep : Argument list too long

Hi, i am having some trouble with the below command, can some one suggest me the better way to do it. grep -l 'ReturnCode=1' `find $Log -newer /tmp/Failed.tmp -print | xargs ls -ld | egrep SUB | egrep -ve 'MTP' -ve 'ABC' -ve 'DEF' -ve 'JKL' -ve 'XYZ' | awk '{print $9}'` > $Home1 Its... (2 Replies)
Discussion started by: Prateek007
2 Replies

8. Shell Programming and Scripting

mv : Argument list too long

Hi I am using find command -- find "directory1" -type f | xargs -i mv {} "directory2" to avoid above argument list too long problem. But, issue i am facing is directory1 is having subdirectories due to this i am facing directory traversal problem as i dont want to traverse subdirectories... (9 Replies)
Discussion started by: VSom007
9 Replies

9. Shell Programming and Scripting

sed cannot execute [Argument list too long]

Hi All, This question has been asked many times, but my problem is slightly different. In my shell script i am connecting to oracle database and loading the results to .dat file. This .dat file is later used to create to .xls file Some times the size of .dat file becomes more than 120000... (8 Replies)
Discussion started by: galaxy_rocky
8 Replies

10. Shell Programming and Scripting

Argument list too long

Hi Team, Here's the situation. I have approximately 300000 to 500000 jpg files in /appl/abcd/work_dir mv /appl/abcd/work_dir /appl/abcd/process_dir The above move command will work if the jpg files count is close to 50000 (not sure). If the count is less this mv command holds good. But if... (14 Replies)
Discussion started by: kmanivan82
14 Replies

LEARN ABOUT SUSE

pilot-foto

pilot-foto(1)							    PILOT-LINK							     pilot-foto(1)

NAME

       pilot-foto - Palm 'Foto' Image Installer/Remover/Fetcher/Converter

SECTION

       pilot-link: Userland conduits

SYNOPSIS

	pilot-foto  [-p|--port	<port>]  [--version]  [-?|--help]  [-q|--quiet]  [--usage] [-d|--delete] [--delete-all] [-i|--install] [-l|--list]
       [-f|--fetch] [-F|--fetch-all] [-c|--convert]

DESCRIPTION

       This is a palm conduit to fetch, install, or remove, Foto files from a Palm. It can also convert *.jpg.pdb files  that  have  already  been
       fetched from the Palm to jpeg files.

       Delete all, or named fotos from handheld.

       Install one, or many jpeg images to handheld.

       List all jpeg files and thumbnails on handheld.

       Fetch all jpeg files, or certain ones by name.

       Tries to detect if a file really is a jpeg and refuses to install it, if it is not.

       pilot-foto allows you to do multiple operations in one sync. For instance, delete test.jpg and install test.jpg.

USAGE

       pilot-foto -p <port> [options] file

OPTIONS

   pilot-foto options
			       -d, --delete

       Delete a jpg file on the handheld

			       --delete-all

       Delete ALL jpg files on the handheld

			       -i, --install

       Install a jpg file

			       -l, --list

       List all photos and thumbnails

			       -f, --fetch

       Fetch files from the Palm

			       -F, --fetch-all

       Fetch ALL jpg files from the Palm

			       -c, --convert

       convert [file].jpg.pdb files to jpg

   Conduit Options
			       -p,
			       --port port

       Use  device  file port to communicate with the Palm handheld. If this is not specified, pilot-foto will look for the $PILOTPORT environment
       variable. If neither are found or supplied,  pilot-foto	will print the usage information.

			       -q,
			       --quiet

       Suppress 'Hit HotSync button' message

			       -v, --version

       Display version of pilot-foto and exit without connecting.

   Help Options
			       -h, --help

       Display the help synopsis for pilot-foto and exit without connecting.

			       --usage

       Display a brief usage message and exit without connecting.

EXAMPLES

		   Examples:
		   pilot-foto -p /dev/pilot -f pilot-foto -d MyImage.jpg
		   pilot-foto -i MyImage.jpg
		   pilot-foto -i *.jpg
		   pilot-foto -f MyImage
		   pilot-foto -c MyImage.jpg.pdb

PROBLEMS

       Palm has not published their database format for the thumbnails. So, pilot-foto puts a generic penguin thumbnail for every image  uploaded.
       Fotos can be accessed by a named list on the handheld as well as the thumbnails. This has been tried on a couple of handhelds. It is possi-
       ble that a foreign palm or different model will not like it.

       To get a thumbnail image you can copy the jpegs to the memory card. If you copy them back to the handheld they will have  a  new  thumbnail
       that matches the jpeg.

AUTHOR

       This manual page was converted to XML by Neil Williams <linux@codehelp.co.uk>

BUGS

       If  a  jpeg  is	installed with the same name as one already on the palm you will have 2 thumbnails pointing to the same jpeg. The new jpeg
       will overwrite the old jpeg.

       If the thumbnail fails to install then the jpeg should be removed. It is not.

       We have an online bug tracker. Using this is the only way to ensure that your bugs are recorded and that we can track them until  they  are
       resolved  or  closed.  Reporting  bugs  via  email, while easy, is not very useful in terms of accountability. Please point your browser to
       http://bugs.pilot-link.org: http://bugs.pilot-link.org and report your bugs and issues there.

COPYRIGHT

       This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as  published	by
       the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

       This  program  is  distributed  in  the	hope  that  it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER-
       CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along with this program; if not, write to the Free  Software  Foundation,
       Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301, USA.

SEE ALSO

	pilot-link(7)

0.12.5							      Copyright 1996-2007 FSF						     pilot-foto(1)
All times are GMT -4. The time now is 01:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy