Sponsored Content
Full Discussion: problem with flat file
Operating Systems Solaris problem with flat file Post 302168330 by surjyap on Monday 18th of February 2008 03:38:10 AM
Old 02-18-2008
problem with flat file

Hi,
I have two flat files which is generated by some automated process.
When I tried to view both files in vi editor using vi command both looks same. But I typed
=>cat TEST_WESM900033
&&HDR|M9SLRBR|0003|020012|012408|M9
&&TLR|0wes [mwtest1] /usr5/datafiles/batch/M9


=>cat TEST_WESM90004
&&HDR|M9SLRBR|0004|020013|012508|M9
&&TLR|0
wes [mwtest1] /usr5/datafiles/batch/M9

For the file TEST_WESM900033 command promp comes in the same line, where as for the file TEST_WESM90004 command prompt comes in the next line as shown in the above example. Even I tried with wc -l for both file TEST_WESM900033 (number of lines 1) and TEST_WESM90004 (number of lines 2). Can any one help me what could be the reason and how to fix it.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Problem with the flat file

Hi All, I have a situation where I have a flat file that contains data that needs to be loaded into tables. The flat file contains 10 columns that are pipe dilimited. This table contains more than 500,000 rows. This flat file was created from two different sources. The problem is third... (2 Replies)
Discussion started by: rkumar28
2 Replies

2. Shell Programming and Scripting

Help with a flat file!!!

Hi All, I get a flat file everyday with some records being invalid.Some records come with less number '|'.I just want to add the missing '|'s ,So the it doesnt give an error insufficient fields while loading...There area total of 32 pipes in each record. Input: ASADASD |Y|B|SDFGDSDFD| ... (3 Replies)
Discussion started by: kumarsaravana_s
3 Replies

3. Shell Programming and Scripting

Help with a Flat File!!!

Hi All, I need a help with a shelll script program.I get a '|' separated file which sometime has a encrypted column.And this encryption sometime breaks the last column data into a new line and this is not picked by the ETL.So when i run a script,it should append back the broken new line data... (11 Replies)
Discussion started by: kumarsaravana_s
11 Replies

4. Shell Programming and Scripting

Flat file

Hi I have a flat file looking this QWER 2:35 7044 00001 ROUT 1188 EA SS ASD 2:36 7044 00010 ROUT BSD 2:37 7044 00011 ROUT END QWER 3:35 7044 00011 ROUT 1088 EA SS ASD 3:36 7044 00010 ROUT BSD 3:37 7044 00011 ROUT... (9 Replies)
Discussion started by: Krishnaramjis
9 Replies

5. Shell Programming and Scripting

Flat File in HP-UX

Hi I have a file like below . IF the record starts with ASD then change the 20th offset to "K" follwed by that 20th offset value & if the record starts with ASDR then change the 38th offset to "K" followed by 38th offset value . But here the condition is the next value ... (0 Replies)
Discussion started by: Krishnaramjis
0 Replies

6. Shell Programming and Scripting

Awk to convert a flat file to CSV file

Hi , I have a file with contents as below: Contract Cancellation Report UARCNCL LOS CODE DATE REAS TYPE AMOUNT AMOUNT LETTER BY ========= ======= ==== ==== ==== ========= ==== ==== 8174739 7641509 1S NONE CRCD 30-JUN-2008 NPAR N .00 .00 CCAN 8678696 8091709 1S NONE DDEB 30-JUN-2008... (14 Replies)
Discussion started by: rkumudha
14 Replies

7. Programming

compare XML/flat file with UNIX file system structure

Before i start doing something, I wanted to know whether the approach to compare XML file with UNIX file system structure. I have a pre-configured file(contains a list of paths to executables) and i need to check against the UNIX directory structure. what are the various approches should i use ? I... (6 Replies)
Discussion started by: shafi2all
6 Replies

8. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies

9. Shell Programming and Scripting

reading a csv file and creating a flat file

hi i have written a script for reading a csv file and creating a flat file, suggest if this script can be optimized #---------------- FILENAME="$1" SCRIPT=$(basename $0) #-----------------------------------------// function usage { echo "\nUSAGE: $THIS_SCRIPT file_to_process\n"... (3 Replies)
Discussion started by: mprakasheee
3 Replies

10. UNIX for Beginners Questions & Answers

Flat File Validation

Hi Team there is a requirement to do validate on Flat files using Shell Scripting. Suppose we have two flat files ( F1, F2). Validation 1. Row count between F1 and F2 a) Write it in a file with results of count of each file and differences if any 2. Apply checksum or any... (1 Reply)
Discussion started by: shlearner
1 Replies
FULLA(1)							       HUGIN								  FULLA(1)

NAME
fulla - Correct lens distortion, vignetting and chromatic aberration SYNOPSIS
fulla [options] inputfile(s) DESCRIPTION
Apply radial or flat-field vignetting correction as well as geometrical radial distortion and transversal chromatic aberration correction. fulla can be used to batch correct a large number of files. Radial distortion coefficients can be read from a PTLens database (only database version 4.2 is supported). Vignetting correction is done the same way as described in the nona script file documentation. Vignetting correction can be done based on a flat-field or a radial scaling. Vignetting correction by flat-field division: I = I / c, c = flat-field / mean(flat-field) Radial vignetting correction: I = I / c, c = a + b*r^2 + c*r^4 + d*r^6 The radial distortion correction is identical to the one implemented by PanoTools: r_new = a*r^4 + b*r^3 + c*r^2 + d*r [1] Since transversal chromatic aberrations (TCA) leads to differently scaled objects in the red, green and blue channel, it can be corrected by scaling the red and blue channel so that they match the green channel. Most applications, like Photoshop or Picture Window Pro offer TCA correction by linear scaling. This is equal to varying the d parameter in equation [1]. See http://hugin.sf.net/tutorials/tca for a method to determine these parameters. OPTIONS
-g a:b:c:d Radial distortion coefficient for all channels, (a, b, c, d) -b a:b:c:d Radial distortion coefficients for blue channel, (a, b, c, d). This is applied on top of the -g distortion coefficients, use for TCA corr -r a:b:c:d Radial distortion coefficients for red channel, (a, b, c, d). This is applied on top of the -g distortion coefficients, use for TCA corr -p Try to read radial distortion coefficients (usually supplied using -g) from the PTLens database. The environment variable PTLENS_PROFILE should point to the profile.txt file. Since newer version of the PTLens database are incompatible with fulla, download the PTLens database from the hugin sourceforge website instead: http://www.sf.net/projects/hugin -m Canon Camera manufacturer, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given -n Camera Camera name, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given. -l Lens Lens name, for PTLens database query if not specified, a list of possible lenses is displayed -d 50 Specify focal length in mm, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given. -s Do not rescale the image to avoid black borders. -f filename Vignetting correction by flat-field division I = I / c, c = flat-field / mean(flat-field) -c a:b:c:d Radial vignetting correction by division: I = I / c, c = a + b*r^2 + c*r^4 + d*r^6 -i value Gamma of input data. used for gamma correction before and after flat-field correction -t n Number of threads that should be used during processing -h Display help summary. -o name Set output filename. If more than one image is given, the name will be uses as suffix (default suffix: _corr) -e value Compression of the output files For JPEG output: 0-100 For tiff output: DEFLATE, LZW -v Verbose AUTHORS
Written by Pablo d'Angelo. Also contains contributions from Douglas Wilkins, Ippei Ukai, Ed Halley, Bruno Postle, Gerry Patterson and Brent Townshend. This man page was written by Cyril Brulebois <cyril.brulebois@enst-bretagne.fr> and is licensed under the same terms as the hugin package itself. "Version: 2011.4.0" 2011-12-02 FULLA(1)
All times are GMT -4. The time now is 11:06 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy