05-04-2006
Showing an extra record/line
Hello everybody,
I am working on ETL side. My job is to load the data from Oracle table to flat file and from flat file to oracle table using ETL tool Informatica. My flat files are fixed width. In the first phase, it is loading 66351 records into data file through tool. When I checked through wc -l <data filename> it is giving 66352. I attached a QC file to check the source count. In that file it is giving correct count as 66351. When I loaded the data from this data file to table, only 66351 records are loaded. Not 66352 records. I am confused why it is giving an extra line in the file with WC command but it contains exactly the same number of rows in source. Please send all possibilities with solution as I am new to this.
Thanks and regards,
Srivsn
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello everybody,
My job is to load the data from Oracle table to flat file and from flat file to oracle table using ETL tool Informatica. My flat files are fixed width. In the first phase, it is loading 66351 records into data file through tool. When I checked through wc -l <data filename> it is... (1 Reply)
Discussion started by: srivsn
1 Replies
2. UNIX for Dummies Questions & Answers
Hi
my file data is like below
ramu,sony,"raju \n ravi \n ramya" \n
ravi,sarah,"sowmya \n sorry s\ sangam" \n
i want replace new line characters in between double coats with sinhle space.
for example
cat input_file
ramu,sony,"raju
ravi
ramya"
ravi,sarah,"sowmya
sorry
sangam"
... (3 Replies)
Discussion started by: Raghava
3 Replies
3. Shell Programming and Scripting
Hi,
I need a help in deleting extra spaces in a text.
I have a huge file, a part of it is :-
3 09/21/08 03:32:07 started undef mino Oracle nmx004.wwdc.numonyx.com Message Text : The Oracle session with the PID 1103 has a CPU time ... (6 Replies)
Discussion started by: vikas027
6 Replies
4. Filesystems, Disks and Memory
hi fren
i am facing this problem
i have sun 6140 storage
30 volumes
bt my vxdisk list output is showing 37 disk
which shd nt b there
has neone faced this proble earlier
vxdiks list output is like this
SUN6140-2_0 auto - - online c4t201700A0B84853C0d2s2
SUN6140-2_1 auto - - online... (13 Replies)
Discussion started by: bond_ankur
13 Replies
5. Shell Programming and Scripting
Here is an interesting problem that I am seeing when using 'sed'. The goal
is to print out the names of the Oracle SID's on a system and here is the
command I am using:
ps -ef|grep ora|grep pmon|awk '{print $NF}'|sed 's/ora_pmon_//'
The output of the command after the awk is this:
... (3 Replies)
Discussion started by: soleil4716
3 Replies
6. Shell Programming and Scripting
I'm new to using sed and grep commands, but have found them extremely useful. However I am having a hard time figuring this one out:
Delete every line containing the word CEN and the next line as well.
ie. test.txt
blue
324 CEN
green
red
blue
324 CEN
green
red
blue
to produce:... (2 Replies)
Discussion started by: rocketman88
2 Replies
7. Shell Programming and Scripting
And I want to delete the characters longer than 20 for each line start with #. The other lines should remain the same. I think this can be done by sed. Could anyone help me with this? Thanks!
my input file:
#ZP_05494889.1_Clostridium_papyrosolvens... (3 Replies)
Discussion started by: ritacc
3 Replies
8. UNIX for Dummies Questions & Answers
Hello,
I have a text file that looks like:
ABC123|some text|some more text|00001
00002
0003
0004
000019|000003|Item
I have searched and found an example to remove the extra new line characters using grep and sed, but it (I think) assumes the lines start with a number and the... (5 Replies)
Discussion started by: c56444
5 Replies
9. Shell Programming and Scripting
Hi,
I have a input file with the following entries:
1one
2two
3three
1four
2five
3six
1seven
1eight
1nine
2ten
The output should be
1one
2two
3three
1four
2five
3six (2 Replies)
Discussion started by: supchand
2 Replies
10. Shell Programming and Scripting
Hi,
I have a input file with the following entries:
1one
2two
3three
1four
2five
3six
1seven
1eight
1nine
2ten
2eleven
2twelve
1thirteen
2fourteen
The output should be: (5 Replies)
Discussion started by: supchand
5 Replies
FULLA(1) HUGIN FULLA(1)
NAME
fulla - Correct lens distortion, vignetting and chromatic aberration
SYNOPSIS
fulla [options] inputfile(s)
DESCRIPTION
Apply radial or flat-field vignetting correction as well as geometrical radial distortion and transversal chromatic aberration correction.
fulla can be used to batch correct a large number of files. Radial distortion coefficients can be read from a PTLens database (only
database version 4.2 is supported).
Vignetting correction is done the same way as described in the nona script file documentation. Vignetting correction can be done based on
a flat-field or a radial scaling.
Vignetting correction by flat-field division:
I = I / c, c = flat-field / mean(flat-field)
Radial vignetting correction:
I = I / c, c = a + b*r^2 + c*r^4 + d*r^6
The radial distortion correction is identical to the one implemented by PanoTools:
r_new = a*r^4 + b*r^3 + c*r^2 + d*r [1]
Since transversal chromatic aberrations (TCA) leads to differently scaled objects in the red, green and blue channel, it can be corrected
by scaling the red and blue channel so that they match the green channel. Most applications, like Photoshop or Picture Window Pro offer TCA
correction by linear scaling. This is equal to varying the d parameter in equation [1].
See http://hugin.sf.net/tutorials/tca for a method to determine these parameters.
OPTIONS
-g a:b:c:d
Radial distortion coefficient for all channels, (a, b, c, d)
-b a:b:c:d
Radial distortion coefficients for blue channel, (a, b, c, d). This is applied on top of the -g distortion coefficients, use for TCA
corr
-r a:b:c:d
Radial distortion coefficients for red channel, (a, b, c, d). This is applied on top of the -g distortion coefficients, use for TCA
corr
-p Try to read radial distortion coefficients (usually supplied using -g) from the PTLens database. The environment variable
PTLENS_PROFILE should point to the profile.txt file. Since newer version of the PTLens database are incompatible with fulla, download
the PTLens database from the hugin sourceforge website instead: http://www.sf.net/projects/hugin
-m Canon
Camera manufacturer, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given
-n Camera
Camera name, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given.
-l Lens
Lens name, for PTLens database query if not specified, a list of possible lenses is displayed
-d 50
Specify focal length in mm, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given.
-s Do not rescale the image to avoid black borders.
-f filename
Vignetting correction by flat-field division
I = I / c, c = flat-field / mean(flat-field)
-c a:b:c:d
Radial vignetting correction by division:
I = I / c, c = a + b*r^2 + c*r^4 + d*r^6
-i value
Gamma of input data. used for gamma correction before and after flat-field correction
-t n
Number of threads that should be used during processing
-h Display help summary.
-o name
Set output filename. If more than one image is given, the name will be uses as suffix (default suffix: _corr)
-e value
Compression of the output files
For JPEG output: 0-100
For tiff output: DEFLATE, LZW
-v Verbose
AUTHORS
Written by Pablo d'Angelo. Also contains contributions from Douglas Wilkins, Ippei Ukai, Ed Halley, Bruno Postle, Gerry Patterson and Brent
Townshend.
This man page was written by Cyril Brulebois <cyril.brulebois@enst-bretagne.fr> and is licensed under the same terms as the hugin package
itself.
"Version: 2011.4.0" 2011-12-02 FULLA(1)