Sponsored Content
Top Forums Shell Programming and Scripting Multiply numbers from different files Post 302561317 by shoaibjameel123 on Monday 3rd of October 2011 09:54:46 PM
Old 10-03-2011
Multiply numbers from different files

Hi All,

I have tried few things with this but it did not help much.

I have some 200,000 files in a directory. There are two sets of files.

1. Files with extension .dat with file names like these (1.dat, 2.dat, 5.dat, 8.dat....200000.dat)

2. Another set of files with .txt extension and names like (1.txt, 2.txt, 5.txt, 8.txt.....200000.txt)

As you can see for every .dat with number there is a corresponding .txt...that is 1.dat has 1.txt, 2.dat has 2.txt and this thing goes on.

.dat files look like this:

For example, 1.dat

Code:
1
2
3
4
5

1.txt file look like this:
Code:
4.5
0.34
3.45
9
5.67

Another thing is that the number of lines in 1.dat and 1.txt are all same too.

What I need to do is to multiple the corresponding FILES with corresponding numbers in each file and store the result in .mul file. That is, multiply numbers present in 1.txt with 1.dat line by line and store the result in 1.mul and same thing goes for 2.txt and 2.dat with creating of 2.mul.

This is what I need to do in order to create 1.mul
Code:
4.5	* 1	= 4.5
0.34	* 2	= 0.68
3.45  * 3	= 10.35
9	* 4	= 36
5.67	* 5	= 28.35

So, my 1.mul will have


Code:
4.5
0.68
10.35
36
28.35

This is how I do for every file.

Now, the problem that I am facing is that my file numbers are not in continuity. As you can see after 2.dat; 5.dat comes in. So, my script breaks.

I am trying to do this:

First I paste values together:

Code:
for num in `seq 1 200000`; do
 paste $num.dat $num.txt >$num.common
done

Then I multiply the numbers like this:
Code:
ls -1 *.common | while read page
do
cat $page | awk '{print $1 * $2}' $page>$page.txt
done

But I believe I am using unnecessary disk space by creating .common files. I am working on Linux with BASH.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to add/multiply numbers with scientific notation (2.343e-5)

Hi, I'm need to do some addition and multiplication of scientific nottaion numbers, in the form 34.23423e-10 for example. I was echoing the list of numbers to stdout, then using bc -l, then I find that this does not seem to work for numbers with exponential notation. Could someone help me out... (1 Reply)
Discussion started by: chugger06
1 Replies

2. Shell Programming and Scripting

multiply variable

I need to multiply the value of a variable and then store it in another variable. I have EXPHOURINSEC=$(($EXPDATEHOUR * 3600)) but i get an error saying the * is unexpected. Im using ksh (4 Replies)
Discussion started by: fwabbly
4 Replies

3. Shell Programming and Scripting

Multiply variables

I have no idea about programming, just know some simple html :confused:and I need to get to somebody that can help me with creating the application (?) that will multiply 2 varibales and given price (height x lenght) x $$$. PLEASE HELP!:confused: edit by bakunin: Anita, as much as we... (2 Replies)
Discussion started by: Anita Flejter
2 Replies

4. Shell Programming and Scripting

All I want to do is Multiply...

All I want to do is find 5!. read num num={1..5} while do f= done echo f Error Msg. line 5: ${1..5} bad substitution line 6: integer expression expected Line 5 is the num=... Line 6 is the "while" statement I am new at this, and I am really, really trying. Please... (14 Replies)
Discussion started by: Ccccc
14 Replies

5. Shell Programming and Scripting

Multiply whole column with a value

Hi, I need to multiply 3rd column (comma seperated) of entire file by a value say 2.2. Suppose the file is: C,Gas $ YTD(TRI),15512.36,01/01/2010 New file should be (3rd column value multiplied by 2.2): C,Gas $ YTD(TRI),34127.192,01/01/2010 (5 Replies)
Discussion started by: yale_work
5 Replies

6. Shell Programming and Scripting

Multiply numbers in two columns and then add.

I have some 100 files with extension .tmp The files are named as 1.tmp, 2.tmp, 3.tmp until 100.tmp All files look like this: 0.38701788 1.968068e-02 0.38622013 2.054002e-02 0.38350296 1.715522e-02 0.38282126 1.781283e-02 0.38282126 1.781283e-02 0.35847232 1.026839e-02 0.3557739... (7 Replies)
Discussion started by: shoaibjameel123
7 Replies

7. Shell Programming and Scripting

multiply with awk

HI help i have cc 9+37.50 328611.50 688498.25 42.38 cc 66+62.50 328636.50 688498.42 42.58 i want to make o/p cc 9+3750 328611.50 688498.25 42.38 cc 66+6250 328636.50 688498.42 42.58 plz help (2 Replies)
Discussion started by: Indra2011
2 Replies

8. Shell Programming and Scripting

awk multiply values contained in 2 different files

Hi Everyone ! I have two files with the same configuration and I want to multiply corresponding values and write the result in a file. Let say 2 header lines and then lines of values (with not constant number of columns): more file1.txt --> BLABLABLA BLABLABLA 1 2 3 4 1 2 3 1 2 1... (7 Replies)
Discussion started by: Youm
7 Replies

9. Shell Programming and Scripting

Multiply a row of numbers

the following is used to add numbers: echo 7 47 47 44 4 3 3 3 3 3 | awk '{ for(i=1; i<=NF;i++) j+=$i; print j; j=0 }' how do i multiply OR subtract a row of numbers using the above tactic? (8 Replies)
Discussion started by: SkySmart
8 Replies

10. UNIX for Dummies Questions & Answers

Multiply value by row

Hi I would like to know how can I multiply the value of column three to columns 4-end of file example of input file: rs1000012 AK8 2 0.05 0.05 1 0 0 rs10000154 PAQR3 0.01 2 1 2 2 1 Desired output file: rs1000012 AK8 ... (1 Reply)
Discussion started by: fadista
1 Replies
pymcaroitool(1) 					 PyMca X-Ray Fluorescence Toolkit					   pymcaroitool(1)

NAME
pymcaroitool - PyMca region-of-interest imaging X application SYNOPSIS
pymcaroitool [OPTIONS]... [FILE(S)] DESCRIPTION
Start the graphical user interface of the PyMca X-Ray Fluorescence Toolkit region-of-interest imaging tool. This tool is best suited for handling datasets that can be represented by three-dimensional arrays. Typical cases are stacks of images (first dimension is image number) or 2D maps of 1D spectra (last dimension is spectrum channel number). It allows to display maps of particular regions of the spectra or spectra of a particular region of the map. A system of plugins allow to extend the capabilities of this tool. Plugins for multivariate analysis are already built in. If FILE is given, it will be opened in the program provided its format is supported. EXAMPLES
pymcaroitool Start the program with a file browser to select the input files. pymcaroitool file_0001.edf Tries to open the file named file_0001.edf and all indexed files of the form file_????.edf where ???? is a number. pymcaroitool --imagestack=1 file_0001.edf Tries to open the file named file_0001.edf and all indexed files of the form file_????.edf where ???? is a number as a set of images. pymcaroitool uncompressed_tiff_file_0001.tif Tries to open a series of uncompressed TIFF files as an image stack. pymcaroitool --begin=100 --end=200 --filepattern=file_%05d.edf Start the program loading the single indexed files from file_00100.edf to file_00200.edf pymcaroitool --begin=10,100 --end=20,200 --filepattern=row%d_col%03d.dat Load the double indexed files from row10_col100.dat, row10_col101.dat, ... to row20_col00199.dat, row20_col00200.dat CAVEATS
If files f_000.xxx and f_001.xxx are present in the same directory, the program will always try to load both of them unless a cumbersome way using a file pattern is used. SEE ALSO
HDF5, h5py ESRF
March 2012 pymcaroitool(1)
All times are GMT -4. The time now is 03:22 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy