10-18-2012
Column extraction from multiple files to multiple files
I have roughly ~30 .txt files in a directory which all have unique names. These files all contain text arranged in columns separated by whitespace (example file:
[#YY MM DD hh mm WDIR WSPD GST WVHT DPD APD MWD PRES ATMP WTMP DEWP VIS TIDE
#yr mo dy hr mn degT m/s m/s m sec sec deg hPa degC degC degC nmi ft
2012 05 31 23 50 60 0.8 0.9 0.04 99.00 2.77 999 1016.7 7.1 5.3 999.0 99.0 99.00
2012 06 01 00 50 30 1.8 2.2 0.04 99.00 2.77 999 1016.8 6.0 5.3 999.0 99.0 99.00
2012 06 01 01 50 42 0.7 1.3 0.13 99.00 3.98 999 1016.4 6.4 4.8 999.0 99.0 99.00
2012 06 01 02 50 105 2.3 2.6 0.04 99.00 3.46 999 1016.5 5.3 4.6 999.0 99.0 99.00
...
...
...
)
I am looking to extract columns from these files (ie: PRES, which runs from the 54-59 char in each line) so that i can find their average value accross each file. I would like these outputs to remain distinct and indentifiable to the original file.
In the end, I am looking to extract data from the files with the following names:
4500172012.txt
4500182012.txt
4500262012.txt
4500272012.txt
4500282012.txt
4500362012.txt
4500372012.txt
4500382012.txt
4500462012.txt
4500472012.txt
4500482012.txt
4500562012.txt
4500572012.txt
4500582012.txt
4500662012.txt
4500672012.txt
4500682012.txt
4500762012.txt
4500772012.txt
4500782012.txt
4500862012.txt
4500872012.txt
4500882012.txt
4501262012.txt
4501272012.txt
4501282012.txt
I am looking to extract the columns PRES, ATMP, and WTMP (char 54-59, 62-65, 68-71 respectively).
How can I do this?
Thank you for any help you can provide.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello dear friends,
My problem as explained below seems really basic.
Fact is that I'm totally new to programming, and have only a week to produce a script ( CShell or Perl ? ) to perform this action.
While searching on the forums, I found a command that could help me, but I don't know... (2 Replies)
Discussion started by: ackheron
2 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I'd like to process multiple files. For example:
file1.txt
file2.txt
file3.txt
Each file contains several lines of data. I want to extract a piece of data and output it to a new file.
file1.txt ----> newfile1.txt
file2.txt ----> newfile2.txt
file3.txt ----> newfile3.txt
Here is... (3 Replies)
Discussion started by: Liverpaul09
3 Replies
3. Shell Programming and Scripting
I have multiple files; each file contains a certain data in a column view
simply i want to combine all those files into one file in columns
example
file1:
a
b
c
d
file 2:
1
2
3
4
file 3:
G (4 Replies)
Discussion started by: ahmedamro
4 Replies
4. Shell Programming and Scripting
Hi!
I'm new in awk and I need some help.
I have a folder with a lot of files and I need that awk do something in each file and print a new file with the output. The input file name should be modified when I print the outpu files.
Thanks in advance for help!
:-)
ciao (5 Replies)
Discussion started by: gabrysfe
5 Replies
5. UNIX for Dummies Questions & Answers
How can I run the following command on multiple files and print out the corresponding multiple files.
perl script.pl genome.gff 1.txt > 1.gff
However, there are multiples files of 1.txt, from 1----100.txt
Thank you so much.
No duplicate posting! Continue here. (0 Replies)
Discussion started by: grace_shen
0 Replies
6. Shell Programming and Scripting
How can I Run one script on multiple files and print out multiple files.
FOR EXAMPLE
i want to run script.pl on 100 files named 1.txt ....100.txt under same directory and print out corresponding file 1.gff ....100.gff.THANKS (4 Replies)
Discussion started by: grace_shen
4 Replies
7. Shell Programming and Scripting
Hi Friends,
$ cat test1.txt
emeka:1438
shelley:1439
dmeyer:1440
kurtarn:1441
abdul:1442
$ cat test2.txt
1:a
2:b
3:c
4:d
$ cat test3.txt
cat:dog:bat
man:hot:cold (5 Replies)
Discussion started by: Jewel
5 Replies
8. UNIX for Dummies Questions & Answers
Hello Gurus,
Im new to scripting. Got struck with a file merge issue in Unix. Was looking for some direction and stumbled upon this site. I saw many great posts and replies but couldnt find a solution to my issue. Greatly appreciate any help..
I have three csv files -> Apex_10_Latest.csv,... (1 Reply)
Discussion started by: wamshi
1 Replies
9. Shell Programming and Scripting
Hi All,
I want to use egrep on multiple files and the results should be output to multiple files. I am using the below code in my shell script(working in Ksh shell). However with this code I am not attaining the desired results.
#!/bin/ksh
(
a="/path/file1"
b="path/file2"
for file in... (4 Replies)
Discussion started by: am24
4 Replies
10. UNIX for Beginners Questions & Answers
I have data of an excel files as given below,
file1
org1_1 1 1 2.5 100
org1_2 1 2 5.5 98
org1_3 1 3 7.2 88
file2
org2_1 1 1 2.5 100
org2_2 1 2 5.5 56
org2_3 1 3 7.2 70
I have multiple excel files as above shown.
I have to copy column 1, column 4 and paste into a new excel file as... (26 Replies)
Discussion started by: dineshkumarsrk
26 Replies
LEARN ABOUT CENTOS
dh_ucf
DH_UCF(1) Debhelper DH_UCF(1)
NAME
dh_ucf - register configuration files with ucf
SYNOPSIS
dh_ucf [debhelperoptions] [-A] [-n] [file...]
DESCRIPTION
dh_ucf is a debhelper program that is responsible for generating the postinst and postrm commands that register files with ucf(1) and
ucfr(1).
FILES
debian/package.ucf
List pairs of source and destination files to register with ucf. Each pair should be put on its own line, with the source and
destination separated by whitespace. Both source and destination must be absolute paths. The source should be a file that is provided
by your package, typically in /usr/share/, while the destination is typically a file in /etc/.
A dependency on ucf will be generated in ${misc:Depends}.
OPTIONS
-A, --all
Install all files specified by command line parameters in ALL packages acted on.
-n, --no-scripts
Do not modify postinst/postrm scripts. Turns this command into a no-op.
file ...
Install these info files into the first package acted on. (Or in all packages if -A is specified).
NOTES
Note that this command is not idempotent. dh_prep(1) should be called between invocations of this command. Otherwise, it may cause multiple
instances of the same text to be added to maintainer scripts.
SEE ALSO
debhelper(7)
This program is a part of debhelper.
AUTHOR
Joey Hess <joeyh@debian.org> Jeroen Schot <schot@a-eskwadraat.nl>
11.1.6ubuntu2 2018-05-10 DH_UCF(1)