05-20-2009
perl script on multiple files
I have a script that runs on one file (at a time).
like this:
$> perl myscript.pl filename > output
How can I run it on >6000 files and have the output sent out into slightly modified file name
$> perl myscript 6000files> output6000files.new extension
Thanks in anticipation
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
All,
I want to combine multiple files in one file.
Something like what we do on the commad line as follows ->
cat file1 file2 file3 > Main_File.
Can something like this be done in a perl script very efficiently?
Thanks,
Rahul. (1 Reply)
Discussion started by: rahulrathod
1 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I have thousands of files in a directory that have the following 2 formats:
289620178.aln
289620179.aln
289620180.aln
289620183.aln
289620184.aln
289620185.aln
289620186.aln
289620187.aln
289620188.aln
289620189.aln
289620190.aln
289620192.aln....
and:
alnCDS_1.fasta (1 Reply)
Discussion started by: greptastic
1 Replies
3. Shell Programming and Scripting
Hi,
I want to run a Perl script on multiple files, with same name ("Data.txt") but in different directories (eg : 2010_06_09_A/Data.txt, 2010_06_09_B/Data.txt).
I know how to run this perl script on files in the same directory like:
for $i in *.txt
do
perl myscript.pl $i > $i.new... (8 Replies)
Discussion started by: ad23
8 Replies
4. Shell Programming and Scripting
I want to write a Perl script that manipulates multiple files. In the directory, I have files 250.*chr$.ped where * is from 1 to 1000 and $ is from 1-22 for a total of 22 x 10,000 = 22,000 files.
I want to write a script that only manipulates files 250.1chr*.ped where * is from 1 to 22.... (10 Replies)
Discussion started by: evelibertine
10 Replies
5. Programming
Hi every one,
Please excuse me if any grammatical mistakes is there.
I have multiple xml files in one directory, I need to create multiple XML files into one XML file.example files like this</p>
file1:bvr.xml
... (0 Replies)
Discussion started by: veerubiji
0 Replies
6. Shell Programming and Scripting
I am new for Perl I want to ask one question. I have around 50 custom packages which i am using in my Perl script. I want to import all .pm packages in my Perl script in an easy way. Right now i have to import each package individually. So Is there any way to do so??
Right Now i am doing like:
... (1 Reply)
Discussion started by: Navrattan Bansa
1 Replies
7. Shell Programming and Scripting
Hi
I have 100 files under file A labled 1.txt 2.txt.....100.txt(made up name)
I have 1 files under file B labled name.txt
How can i run the same perl script on 100 files and file name.txt
I want to run
perl script.pl A/1.txt B/name.txt
perl script.pl A/2.txt B/name.txt
.......
perl... (3 Replies)
Discussion started by: grace_shen
3 Replies
8. UNIX for Dummies Questions & Answers
How can I run the following command on multiple files and print out the corresponding multiple files.
perl script.pl genome.gff 1.txt > 1.gff
However, there are multiples files of 1.txt, from 1----100.txt
Thank you so much.
No duplicate posting! Continue here. (0 Replies)
Discussion started by: grace_shen
0 Replies
9. Shell Programming and Scripting
Hi Experts,
I am querying backup status results for multiple databases and getting each and every database result in one csv file. so i need to combine all csv files in one excel file with separate tabs. I am not familiar with perl script so i am using shell script.
Could anyone please... (4 Replies)
Discussion started by: ramakrk2
4 Replies
10. Shell Programming and Scripting
We have the data looks like below in a log file.
I want to generat files based on the string between two hash(#) symbol like below
Source:
#ext1#test1.tale2 drop
#ext1#test11.tale21 drop
#ext1#test123.tale21 drop
#ext2#test1.tale21 drop
#ext2#test12.tale21 drop
#ext3#test11.tale21 drop... (5 Replies)
Discussion started by: Sanjeev G
5 Replies
LEARN ABOUT CENTOS
hwloc-ps
HWLOC-PS(1) hwloc HWLOC-PS(1)
NAME
hwloc-ps - List currently-running processes or threads that are bound
SYNOPSIS
hwloc-ps [options]
OPTIONS
-a list all processes, even those that are not bound to any specific part of the machine.
-p --physical
report OS/physical indexes instead of logical indexes
-l --logical
report logical indexes instead of physical/OS indexes (default)
-c --cpuset
show process bindings as cpusets instead of objects.
-t --threads
show threads inside processes. If -a is given as well, list all threads within each process. Otherwise, show all threads inside
each process where at least one thread is bound.
--whole-system
Do not consider administration limitations.
--pid-cmd <cmd>
Append the output of the given command to each PID line. For each displayed process ID, execute the command <cmd> <pid> and
append the first line of its output to the regular hwloc-ps line.
DESCRIPTION
By default, hwloc-ps lists only those currently-running processes that are bound. If -t is given, processes that are not bound but contain
at least one bound thread are also displayed, as well as all their threads.
hwloc-ps displays process identifier, command-line and binding. The binding may be reported as objects or cpusets.
By default, process bindings are restricted to the currently available topology. If some processes are bound to processors that are not
available to the current process, they are ignored unless --whole-system is given.
The output is a plain list. If you wish to annotate the hierarchical topology with processes so as to see how they are actual distributed
on the machine, you might want to use lstopo --ps instead (which also only shows processes that are bound).
The -a switch can be used to show all processes, if desired.
EXAMPLES
If a process is bound, it appears in the default output:
$ utils/hwloc-ps
4759 Core:0 myprogram
If a process is not bound but 3 of his 4 threads are bound, it only appears in the thread-aware output:
$ utils/hwloc-ps
$ utils/hwloc-ps -t
4759 Machine:0 myprogram
4759 Machine:0
4761 PU:0
4762 PU:2
4765 PU:1
To display the binding of already running MPI processes (launched by Open MPI) and append their MPI rank (in MPI_COMM_WORLD) to each line:
$ utils/hwloc-ps --pid-cmd myscript
29093 L1dCache:0 myprogram OMPI_COMM_WORLD_RANK=0
29094 L1dCache:2 myprogram OMPI_COMM_WORLD_RANK=1
29095 L1dCache:1 myprogram OMPI_COMM_WORLD_RANK=2
29096 L1dCache:3 myprogram OMPI_COMM_WORLD_RANK=3
where myscript is a bash script doing:
#!/bin/sh
cat /proc/$1/environ 2>/dev/null | xargs --null --max-args=1 echo | grep OMPI_COMM_WORLD_RANK
SEE ALSO
hwloc(7), lstopo(1), hwloc-calc(1), hwloc-distrib(1)
1.7 Apr 07, 2013 HWLOC-PS(1)