awk processing of variable number of fields data file Post: 302874643

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

AWK - printing certain fields when field order changes in data file

I'm hoping someone can help me on this. I have a data file that greatly simplified might look like this: sec;src;dst;proto 421;10.10.10.1;10.10.10.2;tcp 426;10.10.10.3;10.10.10.4;udp 442;10.10.10.5;10.10.10.6;tcp sec;src;fac;dst;proto 521;10.10.10.1;ab;10.10.10.2;tcp...

2. Shell Programming and Scripting

Parse apart strings of comma separated data with varying number of fields

I have a situation where I am reading a text file line-by-line. Those lines of data contain comma separated fields of data. However, each line can vary in the number of fields it can contain. What I need to do is parse apart each line and write each field of data found (left to right) into a file....

3. Shell Programming and Scripting

awk sed cut? to rearrange random number of fields into 3 fields

I'm working on formatting some attendance data to meet a vendors requirements to upload to their system. With some help on the forums here, I have the data close. But they've since changed what they want. The vendor wants me to submit three fields to them. Field 1 is the studentid field,...

4. Shell Programming and Scripting

Help with data processing, maybe awk

I have a file, first 5 columns are very normal, like "1107",106027,71400,"Y","BIOLOGY",, however, the 6th columns, the user can put comments, anything, just any characters, like new line, double quote, single quote, whatever from the keyboard, like"Please load my previous SOM597G course content in...

5. Shell Programming and Scripting

number of fields in a text file as a variable - perl

I am looking for perl code to get following o/p. If a line has more than 7 fields then value in field 7 onwards is BHA_GRP1, BHA_GRP2, BHA_GRP3, BHA_GRP4 etc. Here is example of what I am trying to achieve. INPUT File: VAH NIC_TYPE CONFIG SIZE_GB PILO KOM BHA_GRP1 BHA_GRP2 BHA_GRP3...... 2...

6. Shell Programming and Scripting

awk help: Match data fields from 2 files & output results from both into 1 file

I need to take 2 input files and create 1 output based on matches from each file. I am looking to match field #1 in both files (Userid) and create an output file that will be a combination of fields from both file1 and file2 if there are any differences in the fields 2,3,4,5,or 6. Below is an...

7. Shell Programming and Scripting

Data processing using awk

Hello, I have some bitrate data in a csv which is in an odd format and is difficult to process in Excel when I have thousands of rows. Therefore, I was thinking of doing this in bash and using awk as the primary application except that due to its complication, I'm a little stuck. ...

8. Shell Programming and Scripting

[ksh88 and awk] Number of fields with a value.

Hi, With: # VALUES="one~two~~~" # echo $VALUES | awk 'BEGIN {FS="~"} {print NF}' 5 I can determine the number of fields. How to determine the number of fields with a value ? In this case 2. Thanks in advance, ejdv

9. Programming

awk processing / Shell Script Processing to remove columns text file

Hello, I extracted a list of files in a directory with the command ls . However this is not my computer, so the ls functionality has been revamped so that it gives the filesizes in front like this : This is the output of ls command : I stored the output in a file filelist 1.1M...

10. Shell Programming and Scripting

Setting the number of fields using awk

Hi Guys, I've obviously had a senior moment here, what I'm trying to do is set the number of fields to 35 in a csv these should be appended to the end of the line. But what I'm getting is:- Source Data $ head out_file_01.txt N1000,024,2809003,,,3,DYNAMIC AVLEASE INC,PO BOX...

LEARN ABOUT DEBIAN

gpiv_mktestimg

GPIV_MKTESTIMG(1)					      General Commands Manual						 GPIV_MKTESTIMG(1)

NAME

       gpiv_mktestimg - Generates a simplified image for image processing.

SYNOPSIS

       gpiv_mktestimg [-h | --help] [-p | --print] [-t N | --threshold N] [-w N] [-v | --version] [filename] < stdin > stdout

DESCRIPTION

       gpiv_mktestimg  generates  an  image  (pair)  in order to be processed by the processing tools. This program is provided for developing and
       testing image processing tools.

       The parameters read from the configuration resources (containing the key GPIV_IMGPROC) may be overruled by the  command	line  options,	as
       explained below.

Options
       -h | --help
	      On-line help

       -t N | --threshold N
	      Threshold value

       -v | --version
	      Print version information on standard output, then exit successfully.

       -w N   window size (default: 15)

       filename
	      Input image filename. Overrides stdin and stdout with the full filename of the image. Output will be written to filename.png. Param-
	      eters are stored in filename.par and may be used for future use by including them in ./gpivrc. If stdin and  stdout  are	used,  the
	      input is expected to be a PNG formatted image.

       SEE ALSO
	      gpivtools

AUTHOR

       Gerber Van der Graaf

								  7 November 2006						 GPIV_MKTESTIMG(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

AWK - printing certain fields when field order changes in data file

Discussion started by: eric4

2. Shell Programming and Scripting

Parse apart strings of comma separated data with varying number of fields

Discussion started by: 2reperry

3. Shell Programming and Scripting

awk sed cut? to rearrange random number of fields into 3 fields

Discussion started by: axo959

4. Shell Programming and Scripting

Help with data processing, maybe awk

Discussion started by: freelong