01-23-2001
Just written a great little script that analyses a flat ASCII CSV file and reports for any discrepancies with field counts per record etc.
Works fine on all the flat files except one, which has 113 fields per line. AWK can only seemingly cope with up to 99 fields.
Is there any way around this? It will be a pain to check manually as there are more than 100,000 records in this file!
Cheers
Dave
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am using:
ps -A -o command,%cpu
to get process and cpu usage figures. I want to use awk to split up the columns it returns. If I use:
awk '{print "Process: "$1"\nCPU Usage: "$NF"\n"}'
the $NF will get me the value in the last column, but if there is more than one word in the... (2 Replies)
Discussion started by: json4639
2 Replies
2. Shell Programming and Scripting
#cat BATCH007.TXT
01,661060052,061000104,081118,0915,07,80,1,2/
99,,,2/
I have this file called BATCH007.TXT. I am trying to change fields 2 and 3 on line 2 to have zeroes. Like this:
01,661060052,061000104,081118,0915,07,80,1,2/
99,0,0,2/
I can use these commands to print identify the... (2 Replies)
Discussion started by: ddurden7
2 Replies
3. Shell Programming and Scripting
I'm working on formatting some attendance data to meet a vendors requirements to upload to their system. With some help on the forums here, I have the data close. But they've since changed what they want.
The vendor wants me to submit three fields to them. Field 1 is the studentid field,... (4 Replies)
Discussion started by: axo959
4 Replies
4. Shell Programming and Scripting
Hi there, i need some help please...
I have this text, it's name data.txt that contains the following information:
Mark Owen: 6999999888 6999999888 +302310999999 2310999999
Steve Blade Pit: +30691111222 2310888777 6999999888
John Rose: 2310777555 310544565 +302310999999
Mary Stuart:... (7 Replies)
Discussion started by: Mark_orig
7 Replies
5. UNIX for Dummies Questions & Answers
I feel like a real leech now, 3 questions in 3 days, but hopefully when I get my head around all of this I can contribute back to this community!
Anyway, so a couple of you guys have gotten me onto AWK and I've been researching it a little over the last couple of hours, now I'm somewhat sure I... (2 Replies)
Discussion started by: Aussiemick
2 Replies
6. Shell Programming and Scripting
Hi,
Could someone please let me know me how i can use an awk command to print the No. of fields of each file present in a Directory?Suppose the Directory has 5 text files in which the first record in each file contains fields separated by a '|'. I need to use a awk command to display the No... (8 Replies)
Discussion started by: pchegoor
8 Replies
7. Shell Programming and Scripting
Hi All,
I am looking for an awk script to do the following
Join the fields together only if the first 4 fields are same.
Can it be done with join function in awk??
a,b,c,d,8,,,
a,b,c,d,,7,,
a,b,c,d,,,9,
a,b,p,e,8,,,
a.b,p,e,,9,,
a,b,p,z,,,,9
a,b,p,z,,8,,
desired output:
... (1 Reply)
Discussion started by: aksijain
1 Replies
8. Shell Programming and Scripting
Hi experts,
I need to print the first field first then last two fields should come next and then i need to print rest of the fields.
Input :
a1,abc,jsd,fhf,fkk,b1,b2
a2,acb,dfg,ghj,b3,c4
a3,djf,wdjg,fkg,dff,ggk,d4,d5
Expected output:
a1,b1,b2,abc,jsd,fhf,fkk... (6 Replies)
Discussion started by: 100bees
6 Replies
9. Shell Programming and Scripting
I'm trying to compare 2 files for differences in a selct number of fields. When differnces are found it will write the whole record of the second file including appending '|C' out to a delta file. Each record will have 20 fields, but only want to do comparison of 1st 15 fields. The 1st field of... (7 Replies)
Discussion started by: sljnk
7 Replies
10. Shell Programming and Scripting
Hi
I have a file as below
<field1> <field2> <field3> ... <field_num1> <field_num2>
Trying to sort based on difference of <field_num1> and <field_num2> in desceding order and print all fields.
I tried this and it doesn't sort on the difference field .. Appreciate your help.
cat... (9 Replies)
Discussion started by: newstart
9 Replies
FULLA(1) HUGIN FULLA(1)
NAME
fulla - Correct lens distortion, vignetting and chromatic aberration
SYNOPSIS
fulla [options] inputfile(s)
DESCRIPTION
Apply radial or flat-field vignetting correction as well as geometrical radial distortion and transversal chromatic aberration correction.
fulla can be used to batch correct a large number of files. Radial distortion coefficients can be read from a PTLens database (only
database version 4.2 is supported).
Vignetting correction is done the same way as described in the nona script file documentation. Vignetting correction can be done based on
a flat-field or a radial scaling.
Vignetting correction by flat-field division:
I = I / c, c = flat-field / mean(flat-field)
Radial vignetting correction:
I = I / c, c = a + b*r^2 + c*r^4 + d*r^6
The radial distortion correction is identical to the one implemented by PanoTools:
r_new = a*r^4 + b*r^3 + c*r^2 + d*r [1]
Since transversal chromatic aberrations (TCA) leads to differently scaled objects in the red, green and blue channel, it can be corrected
by scaling the red and blue channel so that they match the green channel. Most applications, like Photoshop or Picture Window Pro offer TCA
correction by linear scaling. This is equal to varying the d parameter in equation [1].
See http://hugin.sf.net/tutorials/tca for a method to determine these parameters.
OPTIONS
-g a:b:c:d
Radial distortion coefficient for all channels, (a, b, c, d)
-b a:b:c:d
Radial distortion coefficients for blue channel, (a, b, c, d). This is applied on top of the -g distortion coefficients, use for TCA
corr
-r a:b:c:d
Radial distortion coefficients for red channel, (a, b, c, d). This is applied on top of the -g distortion coefficients, use for TCA
corr
-p Try to read radial distortion coefficients (usually supplied using -g) from the PTLens database. The environment variable
PTLENS_PROFILE should point to the profile.txt file. Since newer version of the PTLens database are incompatible with fulla, download
the PTLens database from the hugin sourceforge website instead: http://www.sf.net/projects/hugin
-m Canon
Camera manufacturer, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given
-n Camera
Camera name, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given.
-l Lens
Lens name, for PTLens database query if not specified, a list of possible lenses is displayed
-d 50
Specify focal length in mm, for PTLens database query. EXIF data inside JPEG files is read, if this option is not given.
-s Do not rescale the image to avoid black borders.
-f filename
Vignetting correction by flat-field division
I = I / c, c = flat-field / mean(flat-field)
-c a:b:c:d
Radial vignetting correction by division:
I = I / c, c = a + b*r^2 + c*r^4 + d*r^6
-i value
Gamma of input data. used for gamma correction before and after flat-field correction
-t n
Number of threads that should be used during processing
-h Display help summary.
-o name
Set output filename. If more than one image is given, the name will be uses as suffix (default suffix: _corr)
-e value
Compression of the output files
For JPEG output: 0-100
For tiff output: DEFLATE, LZW
-v Verbose
AUTHORS
Written by Pablo d'Angelo. Also contains contributions from Douglas Wilkins, Ippei Ukai, Ed Halley, Bruno Postle, Gerry Patterson and Brent
Townshend.
This man page was written by Cyril Brulebois <cyril.brulebois@enst-bretagne.fr> and is licensed under the same terms as the hugin package
itself.
"Version: 2011.4.0" 2011-12-02 FULLA(1)