Sponsored Content
Top Forums Shell Programming and Scripting Rename files - need help with array? Post 302283498 by darkoth on Tuesday 3rd of February 2009 11:26:17 AM
Old 02-03-2009
RE: script

Quote:
Originally Posted by lamano
I don't see any reason for keeping directories and files separated, as you are mapping one file to each directory in a one-to-one correspondence. You could create two arrays and then access the items as you like, but I think a simpler and straightforward way for doing this could be just creating a list of files including the full path. You could loop through your list of files like this:

#!/usr/xpg4/bin/sh
#
#
MAINDIR=/apps/main1
FILECOMP=/apps/scripts/rename.txt
SCPINFO=box1:/path/to/location

theFilesList='Test1/Ready/file1.csv Test2/Ready/file2.csv Test3_Part3/Ready/file3.csv ....'

umask -S
# Dates the log file
echo "" >>$LOGDIR 2>&1
`/usr/bin/date >>$LOGDIR 2>&1`

# ------- START PROCESSING ---------
for i in $theFilesList
do
FNAMETMP=/usr/bin/find . -name *.txt -newer $FILECOMP 2>>$LOGDIR
# Rename
mv $FNAMETMP $i 2>>$LOGDIR
# Move to archive
mv $FNAMETMP archive 2>>$LOGDIR
# SCP to another server
scp $i $SCPINFO 2>>$LOGDIR
# Update the File for comparison
touch $FILECOMP
done
exit
This looks pretty straight foward. How does it know to go into each directory though.. I see you have MAINDIR defined but then don't call it above. Would I just put $MAINDIR in the find?

FNAMETMP=/usr/bin/find $MAINDIR -name *.txt -newer $FILECOMP 2>>$LOGDIR
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to rename files?

:confused: How can i rename a file 'x.log' to 'x_20020512 072909.log' :eek: i'm using perl, with system command from a unix web server, and need to timestamp my logs if the above format (filename _ year month day hr min sec .log) (9 Replies)
Discussion started by: CompuTelSystem
9 Replies

2. Shell Programming and Scripting

rename files

hey all, I have files in the format of ABCD20061101 and ABCDEF20061101 in one directory, I would like to change all ABCD20061101 to ABCDEF20061101 and the problem is if I do a simple pattern match of ABCD, then those ABCDEF20061101 would also... (2 Replies)
Discussion started by: mpang_
2 Replies

3. Shell Programming and Scripting

rename files Ax based on strings found in files Bx

Hi, I'm not very experienced in shell scripting and that's probably why I came across the following problem: I do have several hundred pairs of text files (PF00x.spl and PF00x.shd) where the first file (PF00x.spl) needs to be renamed according a string that is included in the second file... (12 Replies)
Discussion started by: inCH
12 Replies

4. Shell Programming and Scripting

How to rename files

Hi Guys, I have to rename about 180 files in different folders in linux. For example, abc_110117.txt eff_110117.txt zzz_110117.txt After renaming the files, these files should like like abc.txt eff.txt zzz.txt I created a small script to rename the files like ls... (2 Replies)
Discussion started by: naveed
2 Replies

5. UNIX for Dummies Questions & Answers

Rename all .sh files to .pl

I have various .sh and .pl files in one directory. I want to rename all the .sh files to .pl i.e testscript.sh --> testscript.pl I am trying to use mv *.sh *.pl It doesnt work though!! (3 Replies)
Discussion started by: chrisjones
3 Replies

6. Shell Programming and Scripting

Rename Files in array

Hi Experts, I am new to Unix i wrote below code to rename if the file size less than 8MB. I might have more than one file to rename sometimes:wall:. Please help me in writing the code for multiple files. Eg:- 071720112200.file001 and 071820112200.file001 Single File... (1 Reply)
Discussion started by: rajubollas
1 Replies

7. UNIX for Dummies Questions & Answers

Rename several files

Hi, I would like to rename several files, for example: MSIRP_CatastropheLog_Data_Extract_-_TCAPMI_SMB_20111116_040028.txt MSIRP_CatastropheLog_Data_Extract_-_TCAPMI_SMB_20111117_040023.txt MSIRP_CatastropheLog_Data_Extract_-_TCAPMI_SMB_20111118_040039.txt... (3 Replies)
Discussion started by: wsoethe
3 Replies

8. Shell Programming and Scripting

Script to unzip files and Rename the Output-files

Hi all, I have a many folders with zipped files in them. The zipped files are txt files from different folders. The txt files have the same names. If i try to find . -type f -name "*.zip" -exec cp -R {} /myhome/ZIP \; it fails since the ZIP files from different folders have the same names and... (2 Replies)
Discussion started by: pmkenya
2 Replies

9. Shell Programming and Scripting

Rename files

I am getting some files with this mask: aaaa_SP_bbb.txt aaaa_FX_bbbb.txt aaaabbbb.txt I want to rename the files containing: _SP_ -> Rename - >> fileSP.TXT _FX_ -> Rename - >> fileFX.txt and other file that does not contain these words rename them: filenamexx.txt as I... (4 Replies)
Discussion started by: Jomeaide
4 Replies

10. Shell Programming and Scripting

SBATCH trinity for multiple files and rename/move the output files

Hey guys, I have wrote the following script to apply a module named "trinity" on my files. (it takes two input files and spit a trinity.fasta as output) #!/bin/bash -l #SBATCH -p node #SBATCH -A <projectID> #SBATCH -n 16 #SBATCH -t 7-00:00:00 #SBATCH --mem=128GB #SBATCH --mail-type=ALL... (1 Reply)
Discussion started by: @man
1 Replies
PMNEWLOG(1)						      General Commands Manual						       PMNEWLOG(1)

NAME
pmnewlog - stop and restart archive logging for PCP performance metrics SYNOPSIS
$PCP_BINADM_DIR/pmnewlog [-a accessfile] [-C saveconfig] [-c configfile] [-N] [-n pmnsfile] [-P] [-p pid] [-s] [-V] [other pmlogger options] archive DESCRIPTION
pmnewlog may be used to stop and restart a running instance of pmlogger(1). This is most useful for managing multiple sets of Performance Co-Pilot (PCP) archive logs. These archive logs record the history of performance metric values that may be ``played back'' by other PCP tools, and they form the basis of the VCR paradigm and retrospective performance analysis services common to the PCP toolkit. In normal usage, pmnewlog would be executed by cron(1) in the wee hours to terminate one PCP archive log and start another, i.e. to perform log rotation. Even more common, would be the execution of pmnewlog from the PCP archive management script pmlogger_daily(1). In this case, direct end- user execution of pmnewlog is most unlikely. The mandatory argument archive is the base name for the physical files that will constitute the new archive log. The pmlogger instance to be stopped and restarted must be running on the same system as pmnewlog and is either the primary logger (the default) or the logger with pid as specified by the -p option. If the -n option is specified, then pmnewlog will use the namespace in the pmnsfile, rather than the default Performance Metrics Name Space (PMNS). If no -c option is specified, pmnewlog will use pmlc(1) to connect to the running pmlogger(1) and so determine all those metrics and instances that are subject to mandatory logging or advisory on logging, and the associated logging frequencies. This information is used to synthesize a new pmlogger(1) configuration file. If the -n option is specified, it will also be used for these interactions with pmlc(1). If the -c option is specified, pmlogger(1) will be restarted with configfile as the configuration file. Normally configfile would be the same configuration file used to start pmlogger(1) in the first place, however note that since pmlogger(1) is restarted, any changes to the logging status made using pmlc(1) will be lost, unless these have also been reflected in changes to configfile. If configfile does not exist, then a search is made in the directory $PCP_SYSCONF_DIR/pmlogger for a file of the same name, and if found that file is used, e.g. if config.mumble does not exist in the current directory and the file $PCP_SYSCONF_DIR/pmlogger/config.mumble does exist, then -c config.mumble and -c $PCP_SYSCONF_DIR/pmlogger/config.mumble are equivalent. Access controls specifications for the new pmlogger(1) instance may optionally be provided via the -a option. The contents of accessfile should start with the literal token [access] and conform to the syntax of the access controls section as described for pmlogger(1). The -C option may be used to save the configuration file that pmnewlog passes to the newly launched pmlogger(1). If the pmlogger(1) instance needs to be started under the control of pmsocks(1) to connect to a pmcd through a firewall, the -s option may be used. The -V option enables verbose reporting of the activity. By default no output is generated unless some error or warning condition is encountered. The -N option enables a ``show me'' mode, where the actions are echoed, but not executed, in the style of ``make -n''. Using -N in con- junction with -V maximizes the diagnostic capabilities for debugging. The other pmlogger options are as described for pmlogger(1). Note that pmnewlog does not support the following options of pmlogger(1). -h host pmnewlog determines the host to which the new pmlogger(1) should connect based upon the current host connection for the old pmlog- ger(1). -s samples The new pmlogger(1) is expected to be long running, and the -s option of pmnewlog takes precedence. -T runtime The new pmlogger(1) is expected to be long running -V version The new pmlogger will always create the latest version PCP archive format, and the -V option of pmnewlog takes precedence. -x fd The launched pmlogger cannot be controlled by pmRecordControl(3). EXAMPLE
The following sh(1) script could be executed by root via cron(1) to start a new set of archive logs for the primary logger each evening. A more complete version of this script may be found in $PCP_BINADM_DIR/pmlogger_daily, and is documented in the manual page for pmlog- ger_daily(1). #!/bin/sh # start new logs for PCP primary logger on this host # standard place for logs LOGDIR=$PCP_LOG_DIR/pmlogger/`hostname` # each new log is named yymmdd.hh.mm LOGNAME=`date "+%Y%m%d.%H.%M"` # do it [ ! -d $LOGDIR ] && mkdir -p $LOGDIR cd $LOGDIR $PCP_BINADM_DIR/pmnewlog -l $LOGDIR/pmlogger.log $LOGDIR FILES
archive.meta metadata (metric descriptions, instance domains, etc.) for the archive log archive.0 initial volume of metrics values (subsequent volumes have suffixes 1, 2, ...) archive.index temporal index to support rapid random access to the other files in the archive log $PCP_BINADM_DIR/pmlogger_daily sample script to rotate archives for a number of loggers PCP ENVIRONMENT
Environment variables with the prefix PCP_ are used to parameterize the file and directory names used by PCP. On each installation, the file /etc/pcp.conf contains the local values for these variables. The $PCP_CONF variable may be used to specify an alternative configura- tion file, as described in pcp.conf(5). SEE ALSO
PCPIntro(1), pmcd(1), pmdumplog(1), pmlc(1), pmlogger(1), pmlogger_daily(1), pmsocks(1), pcp.conf(5) and pcp.env(5). DIAGNOSTICS
Due to the precious nature of the archive logs, pmnewlog is rather paranoid in its checking and validation, and will try very hard to ensure that an appropriately configured pmlogger(1) can be restarted, before terminating the existing pmlogger(1). As a consequence of this checking, pmnewlog tends to generate rather verbose error and warning messages. CAVEATS
If no configfile is specified, the method for synthesizing a configuration file using a pmlc(1) connection to the existing pmlogger(1) is, of necessity, incomplete. In particular, for metrics with dynamic underlying instance domains, it is not possible to identify a configura- tion that logs all instances of a metric all of the time, so rather the synthesized configuration file requests the continued logging of the set of instances that exist at the time pmlogger(1) is interrogated by pmnewlog. If this situation is a concern, a fixed configuration file should be used, and passed to pmnewlog via the -c option. Performance Co-Pilot PCP PMNEWLOG(1)
All times are GMT -4. The time now is 08:49 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy