Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: validating a file based on conditions
Top Forums Shell Programming and Scripting validating a file based on conditions Post 302272964 by radoulov on Friday 2nd of January 2009 03:27:39 AM
Old 01-02-2009
Quote:
Originally Posted by trichyselva
hi,
thanks for the response
actually in my message if there are 3 records like

aaa 123 233
aaa 234 222
aaa 242 222

then only ONE aaa

need to be printed
but in the output it is showing all the 3 values
[...]
Is this the correct output or I'm missing something?


Code:
% cat file
aaa 123 233
aaa 234 222
aaa 242 222
% awk 'END { 
  for (_ in u) if (u[_])
  print _
}
{
  u[$1] = k[$1,$2]++ ? x : 1
  }' file
aaa

If your fields are separated by |, use awk -F\| ...

If you post sample from your real data, it would be easier.
Last edited by radoulov; 01-02-2009 at 04:38 AM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Validating input based on fixed number of fields

Yes, i did... let me state my problem in more detail Inputs: I have one input CSV file And, i have stored no. of comma each line should in a variable. e.g. $ cat cmt.csv this, is a ,comma ,count test1 ,,this, is a ,comma ,count test2 this, is a ,comma ,count test3... (6 Replies)
Discussion started by: Dipali
6 Replies

2. UNIX for Dummies Questions & Answers

How to get remove duplicate of a file based on many conditions

Hii Friends.. I have a huge set of data stored in a file.Which is as shown below a.dat: RAO 1869 12 19 0 0 0.00 17.9000 82.3000 10.0 0 0.00 0 3.70 0.00 0.00 0 0.00 3.70 4 NULL LEE 1870 4 11 1 0 0.00 30.0000 99.0000 0.0 0 0.00 0 0.00 0.00 0.00 0 ... (3 Replies)
Discussion started by: reva
3 Replies

3. Shell Programming and Scripting

Extract file records based on some field conditions

Hello Friends, I have a file(InputFile.csv) with the following columns(the columns are pipe-delimited): ColA|ColB|ColC|ColD|ColE|ColF Now for this file, I have to get those records which fulfil the following condition: If "ColB" is NOT NULL and "ColD" has values one of the following... (9 Replies)
Discussion started by: mehimadri
9 Replies

4. UNIX for Dummies Questions & Answers

Shell script to extract data from csv file based on certain conditions

Hi Guys, I am new to shell script.I need your help to write a shell script. I need to write a shell script to extract data from a .csv file where columns are ',' separated. The file has 5 columns having values say column 1,column 2.....column 5 as below along with their valuesm.... (1 Reply)
Discussion started by: Vivekit82
1 Replies

5. Shell Programming and Scripting

Split File based on different conditions

I need to split the file Conditions: Ignore any record that either starts with 1 or 9 Split the file at position 404 , if position 404 is abc or def then write all the records in a file > File 1 , the remaining records should go in to a file > File 2 Further I want to split the... (7 Replies)
Discussion started by: protech
7 Replies

6. Shell Programming and Scripting

Create new file with increment column based on conditions

Hello, Using bash script, i need to process the following file: 887,86,,2013-11-06,1,10030,5,2,0,200,, 887,86,,2013-11-05,1,10030,5,2,0,199,, 887,138,,2013-11-06,1,10031,6,2,0,1610612736,, 887,164,,2013-11-06,1,10000,0,2,0,36000,, and to create a new file such as the below ... (2 Replies)
Discussion started by: JonhyDeep
2 Replies

7. Shell Programming and Scripting

Help with Creating file based on conditions

Can anyone please assist? I have a .txt file(File1.txt) and a property file(propertyfile.txt) . I have to read the vales from the property file and .txt file and create the output file(outputfile.txt) mentioned in the attachment. For each record in .txt file,the below mentioned values shall be... (20 Replies)
Discussion started by: vinus
20 Replies

8. Shell Programming and Scripting

awk to filter file based on seperate conditions

The below awk will filter a list of 30,000 lines in the tab-delimited file. What I am having trouble with is adding a condition to SVTYPE=CNV that will only print that line if CI= must be >.05 . The other condition to add is if SVTYPE=Fusion, then in order to print that line READ_COUNT must... (3 Replies)
Discussion started by: cmccabe
3 Replies

9. Shell Programming and Scripting

awk to update file based on 5 conditions

I am trying to use awk to update the below tab-delimited file based on 5 different rules/conditions. The final output is also tab-delimited and each line in the file will meet one of the conditions. My attemp is below as well though I am not very confident in it. Thank you :). Condition 1: The... (10 Replies)
Discussion started by: cmccabe
10 Replies

10. Shell Programming and Scripting

Search and replace value based on certain conditions in a fixed width file

Hi Forum. I tried searching for a solution using the internet search but I haven't been able to find any solution for what I'm trying to accomplish. I have a fixed width column file where I need to search for any occurrences of "D0" in col pos.#1-2, 10-11, 20-21 and replaced it with "XD". ... (2 Replies)
Discussion started by: pchang
2 Replies

LEARN ABOUT DEBIAN

g2p-sk

g2p-sk(1)							   USER COMMANDS							 g2p-sk(1)

NAME

       g2p-sk - phonetic transcription for Slovak

SYNOPSIS

       g2p-sk [--color] [--dl debug level] [--help] [--stats] [--ofile <file_name>] [<input file>]

DESCRIPTION

       The phonetic transcription is essential for some linguistic or speech recognition applications. Depending on the language either rule based
       or statistical approach is being used. g2p-sk implements the rule based approach but in the future it may be replaced by statistical one.

       Each input word consisting of the sequence of graphemes is transcribed in to the sequence of phones in the SAMPA coding. If no  input  file
       is  specified,  the  standard  input  is expected. If input file is used then the output is written in to the file as well. The filename is
       input filename with the extension "_trans.txt".

       The input output code page is ISO 8859-2. To use it with different CP use some CP converter and pipes. For example to have input and output
       in  UTF-8  use  (for interactive use): filterm UTF8-iso2 iso2-UTF8 g2p-sk or (for batch processing) iconv -f UTF-8 -t ISO_8859-2 | g2p-sk |
       iconv -f ISO_8859-2 -t UTF-8

       Performance of the phonetic transcription depend on the morphematic segmentation. To improve the quality of the morphematic segmentation is
       possible to replace the small version of the simple morphematic dictionary in the /usr/share/g2p_sk/Exceptions/morfemy.ddat with the better
       one.  The syllabic segmentation is as important as morphematic one. The syllabic segmentation is provided by sylseg-sk package.

       The design of the g2p-sk is language dependent. To use it for another language the all rules need to be rewritten.

OPTIONS

       --color
	      Enable color output.

       --dl 1..5
	      Set the debug level. Control the amount of displayed information The debug level 0 displays nothing. The maximum	level  5  displays
	      full debugging report. The default debug level is 1.

       --help Display a short help text

       --ofile <file_name>
	      Write output also in to given file.

       --stats
	      Count and display statistic for each phone

EXAMPLES

       Use standard input and debug level 3:
	      g2p-sk --dl 3

       Process all the from file aaa.txt:
	      g2p-sk aaa.txt

EXIT STATUS

       g2p-sk returns a zero if it succeeds to process all the input words

AUTHOR

       Jozef Ivanecky (dodo (at) kanoistika.sk)

SEE ALSO

       sylseg-sk(1), filterm(1), iconv(1), konwert(1)

version 0.4							   May 17, 2009 							 g2p-sk(1)
All times are GMT -4. The time now is 08:16 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy