Piping multiple commands


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Piping multiple commands
# 1  
Old 08-06-2012
Piping multiple commands

Using the below code I want to find all .sff files and extract them. This works but it seems very cheap. Is there a safer more efficient way to go about this?

Code:
#!/bin/bash

G1=(/home/dirone)

find ${G1} -type f -name \*.sff | xargs python /usr/local/bin/sff_extract.py

# 2  
Old 08-06-2012
What do you mean by "cheap"? It is standard shell code. Are you trying to bulletproof the code? There is no error checking that I can see.
# 3  
Old 08-06-2012
Thanks I just thought it looked as though I could get errors if conditions changed.
# 4  
Old 08-06-2012
Quote:
Originally Posted by jrymer
Is there a safer more efficient way to go about this?

Code:
#!/bin/bash

G1=(/home/dirone)

find ${G1} -type f -name \*.sff | xargs python /usr/local/bin/sff_extract.py

If the goal is to treat every conceivable pathname verbatim ...

xargs treats spaces, single quotes, double quotes, and perhaps also underscores specially. If any of those characters occurred in a filename, your xargs solution would misbehave.

There are xargs options to work with logical lines, but those modes of operation sacrifice a great deal of efficiency for an imperfect workaround (quotes would no longer be a problem, but leading/trailing spaces could be).

Some find/xarg implementations support delimiting pathnames with a null byte.

While the following is slightly more efficient since piping isn't required, the primary advantage is robustness: any legal filename, no matter how bizarre, will be passed intact:
Code:
find "${G1}" -type f -name \*.sff -exec python /usr/local/bin/sff_extract.py {} +

Regards,
Alister
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Piping commands using xargs

Need help in piping commands using xargs I have several .tar.gz files that I need to list the folder content in a subdirectory. For example, a.tar.gz b.tar.gz c.tar.gz The following command works great for each .tar.gz file but it's a pain to run the tar command for each file. tar -tf... (11 Replies)
Discussion started by: april
11 Replies

2. Shell Programming and Scripting

Proper chaining and piping of commands

can someone please help me fix the below one liner? what i want to do is run a command, and if that command is successful, pipe the output of the command to another command. i'd prefer not to use any temp files for this. who -blahblah ; if ; then echo exit; fi | egrep username (2 Replies)
Discussion started by: SkySmart
2 Replies

3. UNIX for Advanced & Expert Users

Pass Multiple Commands and Open Multiple Xterms via PSS

Hello, I'm attempting to open multiple xterms and run a command as an SAP user via sudo using PSSH. So far, I'm able to run PSSH to a file of servers with no check for keys, open every xterm in to the servers in the file list, and SUDO to the SAP(ADM) user, but it won't do anything else... (11 Replies)
Discussion started by: icemanj
11 Replies

4. Shell Programming and Scripting

Multiple Commands in PS

I need to find in file where the record starts with "A,U,I,R" and their file name Record will look like below A|1|138||XXXX|XX|XX U|2|XX|XX|XX|XX R|3|EK|XX|XX|XX D|4|TY|CC|CC|CC find ./*.dat -exec egrep "^A|U|I|R" \; -exec cut -d'|' -f1,2 \; -exec sort -u {} /dev/null \; But... (3 Replies)
Discussion started by: Niranjancse
3 Replies

5. UNIX for Dummies Questions & Answers

Piping commands

Hi I am tryin to undertand piping command1|command2 from what i learn output of cammand 2 is an intput for command 1 right? If so . What dose next sequence do cat f1 >> f2 | grep '^' I think it takes context of f1 and Concatenate's it to f2 and then looks for ....i don't know..... (7 Replies)
Discussion started by: iliya24
7 Replies

6. Shell Programming and Scripting

perform 3 awk commands to multiple files in multiple directories

Hi, I have a directory /home/datasets/ which contains a bunch (720) of subdirectories called hour_1/ hour_2/ etc..etc.. in each of these there is a single text file called (hour_1.txt in hour_1/ , hour_2.txt for hour_2/ etc..etc..) and i would like to do some text processing in them. Each of... (20 Replies)
Discussion started by: amarn
20 Replies

7. Solaris

Help with executing multiple remote commands after multiple hops

Hi SSHers, I have embedded this below code in my shell script.. /usr/bin/ssh -t $USER@$SERVER1 /usr/bin/ssh $USER2@S$SERVER2 echo uptime:`/opt/OV/bin/snmpget -r 0 -t 60 $nodeName system.3.0 | cut -d: -f3-5` SSH to both these servers are public-key authenticated, so things run... (13 Replies)
Discussion started by: LinuxUser2008
13 Replies

8. Shell Programming and Scripting

multiple commands

Hi, I have multiple commands that i need to run daily on my Solaris servers and watch the output, and actually i do it as multi-tasking. I do not want to put all of them in the file, and run it, and get the entire output at one time. What i want is that it should ask for before it runs next... (5 Replies)
Discussion started by: john_prince
5 Replies

9. Shell Programming and Scripting

Piping through commands read as variables from file

This is going to be part of a longer script with more features, but I have boiled it down to the one thing that is presently stumping me. The goal is a script which checks for updates to web pages that can be run as a cron job. The script reads (from a tab-delim file) a URL, an MD5 digest, and an... (1 Reply)
Discussion started by: fitzwilliam
1 Replies

10. Shell Programming and Scripting

How to do multiple commands:

NEVERMIND figured it out! (1 Reply)
Discussion started by: llsmr777
1 Replies
Login or Register to Ask a Question