Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Parsing a File

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Parsing a File
# 1  
Old 04-09-2009
Parsing a File
Hi,

I want to parse a tricky comma separated csv file called runTest.csv (See bellow)
/*
./thirdparty/messages.properties,
,

./thirdparty/messages.properties,login.label.server,Server Name:
./thirdparty/messages.properties,login.label.port,Port:
./thirdparty/messages.properties,login.check.secure,Secure
*/


The file has a number of lines however they are not all in the same format. E.g Some start with a comma, some lines have 3 commas, some are blank etc...

I want to put an 'X' at the end of each line that has ONLY 3 colums (2 comma separated words).
E.g: "./com/intelliden/icos/apps/thirdparty/messages.properties,login.label.port,Port:X"

Can you help me please.
Thanks!
# 2  
Old 04-09-2009
Hi,,

Hope this can help you..
Sample one
Code:
echo "jaslf,jlaskfdj,lajslf"|awk -F"," '{if(NF=3) print $0"X"}'
or
awk -F"," '{if(NF=3) print $0"X"}' inputfile

Thanks
Sha
# 3  
Old 04-09-2009
Quote:
I want to put an 'X' at the end of each line that has ONLY 3 colums (2 comma separated words).
Code:
$> cat infile2
./com/intelliden/icos/apps/thirdparty/messages.properties,login.label.port,Port:
,./com/intelliden/icos/apps/thirdparty/messages.propertieslogin.label.port,Port:
./com/intelliden/icos/,apps/thirdparty/messages.propertieslogin.label.port,Port:
$> sed '/[^,]*[[:alnum:]],[[:alnum:]][^,]*[[:alnum:]],[[:alnum:]][^,]*/ {s/$/X/}' infile2
/com/intelliden/icos/apps/thirdparty/messages.properties,login.label.port,Port:X
,./com/intelliden/icos/apps/thirdparty/messages.propertieslogin.label.port,Port:
./com/intelliden/icos/,apps/thirdparty/messages.propertieslogin.label.port,Port:

I used alpha numerical in this case to make sure the commas are surrounded by words (maybe with numbers) - if you don't want any numbers in those words, just use [:alpha:] or [a-ZA-Z] instead.
# 4  
Old 04-09-2009
Thanks for your reply zaxxon & Shahul.

However the problem is that I only want to put an 'X' after a line that has two commas in it? (Not one at the start of the line but in the middle of it.

Also how can I ignore lines that are blank, have less than 2 commas? Sorry if I seem like im asking the same question again!

Here is an example of the file (runTest.csv) to be parsed:
/*
./thirdparty/messages.properties,Port,Serial,Heat
,
./thirdparty/messages.properties
./thirdparty/messages.properties,login.label.server,Server Name:

123456,./thirdparty/messages.properties,Port,Serial,Heat,Machine,Server
*/

Here is the result I want:
/*
./thirdparty/messages.properties,Port,Serial,Heat
,
./thirdparty/messages.properties
./thirdparty/messages.properties,login.label.server,Server Name:X

123456,./thirdparty/messages.properties,Port,Serial,Heat,Machine,Server
*/

Thanks again!
# 5  
Old 04-09-2009
Do us one favour, use CODE tags when displaying code, logs, data etc, ty Smilie That's the nice blue background square that also keeps formatting and stuff.

Code:
sed '/^[^,]*[a-zA-Z],[a-zA-Z][^,]*[a-zA-Z],[a-zA-Z][^,]*$/ {s/$/X/}' infile
/*
./thirdparty/messages.properties,Port,Serial,Heat
,
./thirdparty/messages.properties
./thirdparty/messages.properties,login.label.server,Server Name:X

123456,./thirdparty/messages.properties,Port,Serial,Heat,Machine,Server
*/

# 6  
Old 04-09-2009
Parsing an irregular CSV file
To skip (that is, preserve) the other lines, just print them,
making sure that you DON'T do this when you add an "X".


nawk -F, ' NF == 3 { print $0 "X" ; next } {print} ' inputfile
# 7  
Old 04-09-2009
@nobody4
This does not work when the 1st symbol is a comma.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File Parsing

Hi Gurus, i have files like this and i want to rename it. server1_0_Log0000597500 server1_0_Log0000597501 server1_0_Log0000597502 server1_0_Log0000597503 server1_0_Log0000597504 server1_0_Log0000597505 server1_0_Log0000597506 server1_0_Log0000597507 server1_0_Log0000597508... (7 Replies)
Discussion started by: fedora132010
7 Replies

2. Shell Programming and Scripting

parsing data from a big file using keys from another smaller file

Hi, I have 2 files format of file 1 is: a1 b2 a2 c2 d1 f3 format of file 2 is (tab delimited): a1 1.2 0.5 0.06 0.7 0.9 1 0.023 a3 0.91 0.007 0.12 0.34 0.45 1 0.7 a2 1.05 2.3 0.25 1 0.9 0.3 0.091 b1 1 5.4 0.3 9.2 0.3 0.2 0.1 b2 3 5 7 0.9 1 9 0 1 b3 0.001 1 2.3 4.6 8.9 10 0 1 0... (10 Replies)
Discussion started by: Lucky Ali
10 Replies

3. Shell Programming and Scripting

Parsing of file for Report Generation (String parsing and splitting)

Hey guys, I have this file generated by me... i want to create some HTML output from it. The problem is that i am really confused about how do I go about reading the file. The file is in the following format: TID1 Name1 ATime=xx AResult=yyy AExpected=yyy BTime=xx BResult=yyy... (8 Replies)
Discussion started by: umar.shaikh
8 Replies

4. Shell Programming and Scripting

Parsing file, yaml file? Extracting specific sections

Here is a data file, which I believe is in YAML. I am trying to retrieve just the 'addon_domains" section, which doesnt seem to be as easy as I had originally thought. Any help on this would be greatly appreciated!! I have been trying to do this in awk and mostly bash scripting instead of perl... (3 Replies)
Discussion started by: Rhije
3 Replies

5. UNIX for Dummies Questions & Answers

Script for parsing details in a log file to a seperate file

Hi Experts, Im a new bee for scripting, I would ned to do the following via linux shell scripting, I have an application which throws a log file, on each action of a particular work with the application, as sson as the action is done, the log file would vanish or stops updating there, the... (2 Replies)
Discussion started by: pingnagan
2 Replies

6. Shell Programming and Scripting

File Parsing Help

Hello, I have a file which contains groups of fields. These groups are separated by a blank line, to form a logical record. Each line consists of a field-value pair. If want to find all records where field 'd' has a value of '4' and if it does, I want the value of field 'a' (from the... (4 Replies)
Discussion started by: brawnr
4 Replies

7. Shell Programming and Scripting

Perl parsing compared to Ksh parsing

#! /usr/local/bin/perl -w $ip = "$ARGV"; $rw = "$ARGV"; $snmpg = "/usr/local/bin/snmpbulkget -v2c -Cn1 -Cn2 -Os -c $rw"; $snmpw = "/usr/local/bin/snmpwalk -Os -c $rw"; $syst=`$snmpg $ip system sysName sysObjectID`; sysDescr.0 = STRING: Cisco Internetwork Operating System Software... (1 Reply)
Discussion started by: popeye
1 Replies

8. Shell Programming and Scripting

need help in Parsing a CSV file and generate a new output file

Hi Scripting Gurus, I am trying to parse a csv file and generate a new output file. The input file will be a variable length in turns of rows and columns. output file will have 8 columns. we have three columns from the header for each set. just to give little bit more clarification each row... (15 Replies)
Discussion started by: vkr
15 Replies

9. Shell Programming and Scripting

Finding & Moving Oldest File by Parsing/Sorting Date Info in File Names

I'm trying to write a script that will look in an /exports folder for the oldest export file and move it to a /staging folder. "Oldest" in this case is actually determined by date information embedded in the file names themselves. Also, the script should only move a file from /exports to... (6 Replies)
Discussion started by: nikosey
6 Replies

10. Shell Programming and Scripting

Help me with parsing this file

Hi, I need a shell script that would parse this file /usr/share/i18n/locales/aa_DJ:title "Afar language locale for Djibouti (Cadu/Laaqo Dialects)." /usr/share/i18n/locales/aa_ER:title "Afar language locale for Eritrea (Cadu/Laaqo Dialects)." /usr/share/i18n/locales/aa_ER@saaho:title... (2 Replies)
Discussion started by: eamani_sun
2 Replies
Login or Register to Ask a Question