Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Picking up files conditionally
Top Forums Shell Programming and Scripting Picking up files conditionally Post 302953181 by Scrutinizer on Tuesday 25th of August 2015 04:07:44 PM
Old 08-25-2015
Another option might be something like this, if the file names may not have spaces in them:

Code:
ls app-*-imp-*.txt | awk '{$NF="*.txt"}!A[$0]++' FS=- OFS=- |
while read subpattern
do
  for i in $subpattern
  do
    echo "processing file $i"
  done &
done
wait

What happens is that for each sub-pattern a for loop is processed in the background. Each sub-pattern expands to one or more related files which are in alphabetical order, which is the right order because of the way the files are named... So different files will be processed in parallel. If there are more than one files with a sub-pattern, these wil be processed sequentially..
Last edited by Scrutinizer; 08-25-2015 at 05:12 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Email from script conditionally

I have a script that is run from the Cron 3 times an hour, here is the cron line: 02,22,42 7-18 * * 1-5 /hci/TEST/bin/myscript.ksh TEST 1>/hci/TEST/logs/myscript.info 2>/hci/TEST/logs/myscript I am curious as to whether the time parameters from cron, ( 02, 22, 42 etc) can be accessed from the... (2 Replies)
Discussion started by: dfb500
2 Replies

2. UNIX for Dummies Questions & Answers

Conditionally joining lines in vi

I've done this before but I can't remember how. Too long away from vi. I want to do a search are replace, but I want the replace to be a join. Example see spot run see spot walk see spot run fast see spot hop %s/run$/<somehow perform a join with the next line>/g so the results... (0 Replies)
Discussion started by: ifermon
0 Replies

3. Shell Programming and Scripting

Get min from a column conditionally

hi, i have a file with folowing content: STORAGE PERCENTAGE FLAG: /storage_01 64% 0 /storage_02 17% 1 /storage_03 10% 0 /storage_04 50% 1 I need to get the value of STORAGE from those with FLAG=0 and which has the min PERCENTAGE i am able to get the STORAGE corresponding to... (8 Replies)
Discussion started by: kichu
8 Replies

4. Shell Programming and Scripting

Conditionally delete last X lines

delete last X lines,which start with + example file: test1 test2 remove1 remove2 one liner shell is preferred. (8 Replies)
Discussion started by: honglus
8 Replies

5. Shell Programming and Scripting

conditionally combine text from two files into one

Hi! I'm trying to take multiple text files (6), which have text on some lines but not others, and combine them. I'd also like to make the values in one column of some of the files (files 4-6) negative. I'm trying to write a short script (see below) as I have to do this with a large number of... (2 Replies)
Discussion started by: felix.echidna
2 Replies

6. UNIX for Dummies Questions & Answers

How to conditionally replace a pattern?

Hi, How to replace only the function calls with a new name and skip the function definition and declarations. consider the following code. There are 2 functions defined here returnint and returnvoid. I need to replace returnint with giveint and returnvoid with givevoid only in the function... (1 Reply)
Discussion started by: i.srini89
1 Replies

7. Shell Programming and Scripting

How to conditionally replace a pattern?

Hi, How to replace only the function calls with a new name and skip the function definition and declarations. consider the following code. There are 2 functions defined here returnint and returnvoid. I need to replace returnint with giveint and returnvoid with givevoid only in the function... (2 Replies)
Discussion started by: i.srini89
2 Replies

8. Shell Programming and Scripting

Urgent ...pls Sorting files based on timestamp and picking the latest file

Hi Friends, Newbie to shell scripting. Currently i have used the below to sort data based on filenames and datestamp $ printf '%s\n' *.dat* | sort -t. -k3,4 filename_1.dat.20120430.Z filename_2.dat.20120430.Z filename_3.dat.20120430.Z filename_1.dat.20120501.Z filename_2.dat.20120501.Z... (1 Reply)
Discussion started by: robertbrown624
1 Replies

9. UNIX for Dummies Questions & Answers

Sorting files based on timestamp and picking the latest file

Hi Friends, Newbie to shell scripting Currently i have used the below to sort data based on filenames and datestamp $ printf '%s\n' *.dat* | sort -t. -k3,4 filename_1.dat.20120430.Z filename_2.dat.20120430.Z filename_3.dat.20120430.Z filename_1.dat.20120501.Z filename_2.dat.20120501.Z... (12 Replies)
Discussion started by: robertbrown624
12 Replies

10. Shell Programming and Scripting

Picking up last two specific files, for transfer

Hi I need to transfer files with csv extension from one server to another (all running solaris). But the files to be picked are in a directory that also has: /directory deposit_698.csv deposit_698.checksum deposit_699.csv deposit_699.checksum deposit_700.csv deposit_700.checksum... (15 Replies)
Discussion started by: fretagi
15 Replies

LEARN ABOUT DEBIAN

meld

MELD(1) 						      General Commands Manual							   MELD(1)

NAME

       meld - Visual diff and merge tool for the GNOME Desktop

SYNOPSIS

       meld [options]
       meld [options] FILE1
       meld [options] DIR1
       meld [options] FILE1 FILE2 [FILE3]
       meld [options] DIR1 DIR2 [DIR3]

DESCRIPTION

       Meld  is  a  graphical diff viewer and merge application for the Gnome desktop.	It supports 2 and 3-file diffs, recursive directory diffs,
       diffing of directories under version control (Arch, Bazaar, Codeville, CVS, Darcs, Git, Mercurial, Monotone, RCS), as well as  the  ability
       to manually and automatically merge file differences.

OPTIONS

       --auto-compare, -a
	      Automatically compare all differing files on startup.

       --diff FILE1|DIR1 FILE2|DIR2 [FILE3|DIR3]
	      Create a diff tab for the given files or directories.  Note that "meld --diff FILE1 FILE2" is functionally equivalent to "meld FILE1
	      FILE2".  However, the --diff argument can be given multiple times for one invocation of meld which allows the user to  automatically
	      initiate multiple diffs when meld starts.  See examples below.

       --help, -h
	      Print application help and usage.

       --LABEL=<label>, -L <label>
	      Set application window title to <label>.

       --version
	      Print application version and exit.

EXAMPLES

       meld
	      Run meld without initiating a diff.

       meld FILE1
	      Initiate a diff between FILE1 and the version-controlled copy of FILE1.

       meld DIR1
	      Initiate a recursive diff between DIR1 and the version-controlled copy of DIR1.

       meld FILE1 FILE2
	      Initiate a diff between FILE1 and FILE2.

       meld FILE1 FILE2 FILE3
	      Initiate a 3-way diff between FILE1, FILE2, and FILE3.

       meld DIR1 DIR2
	      Initiate a recursive diff between directory DIR1 and DIR2.

       meld DIR1 DIR2 DIR3
	      Initiate a recursive 3-way diff between directory DIR1, DIR2, and DIR3.

       meld --diff FILE1 FILE2 --diff FILE3 FILE4
	      Initiate a diff between FILE1 and FILE2, and a separate diff between FILE3 and FILE4.

BUGS

       If  you	find  a  bug,  please report it at https://bugzilla.gnome.org/buglist.cgi?product=meld or mail a description of the issue to meld-
       list@gnome.org.

AUTHORS

       See the AUTHORS text file in meld's source code (http://git.gnome.org/browse/meld/tree/AUTHORS).

								   26 Sept 2010 							   MELD(1)
All times are GMT -4. The time now is 09:52 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy