Extracting data from text file based on configuration set in config file

suparnbector · #1 (**permalink**) 08-09-2007

Hi ,

a:) i have configuration file with pattren
<Range start no>,<Range end no>,<type of records to be extracted from the data file>,<name of the file to store output>

eg:

myfile.confg
9899000000,9899999999,DATA,b.dat
9899000000,9899999999,SMS,a.dat

b:) Stucture of my data file is :
<no>,<type of record>

eg
maindatafile.dat
9899000000,SMS
9899000001,DATA
989901,DATA

Now i want to extract the records from main file
Condition
One check is of range and other will be of Record type defined in configuration file

Output should be like :
File Name : >>>>> b.dat
9899000001,DATA

Similarly seperate files based on range and Record type should be created.

Can anybody help to get this achieved in best possible way...

Thanks in Advance

Klashxx · #2 (**permalink**) 08-09-2007

Check this:

Code:

>cat maindatafile.dat 
9899000000,SMS
989901,DATA
9899000001,DATA
9899001000,SMS
9899001001,DATA

Code:

>cat myfile.confg 
9899000000,9899999999,DATA,b.dat
9899000000,9899999999,SMS,a.dat

Code:

awk -F\, '
BEGIN {
FNR==NR} 
{
if ( NF == 2 )
   {
   i++
   ori[$2,i]=$1
   }
if ( NF == 4 )
   {
   ori[$3]
   if ($3 in ori)
      for(o=1;o<=i;o++)
         if ( ori[$3,o] > $1 && ori[$3,o] < $2 )
            printf("File Name :%s\n%s,%s\n",$4,ori[$3,o],$3)
   }
}' maindatafile.dat myfile.confg
File Name :b.dat
9899000001,DATA
File Name :b.dat
9899001001,DATA
File Name :a.dat
9899001000,SMS

suparnbector · #3 (**permalink**) 08-10-2007

Hi Klashxx ,

Thanx for the solution , but the output is not the way i wanted

output iam looking for is

a.dat file sohuld contain all records in the range defined for SMS record type

so
cat a.dat
9899000000,SMS
9899001000,SMS

Similarly

b.dat file sohuld contain all records in the range defined for DATA record type

cat b.dat
9899000001,DATA
9899001001,DATA

Klashxx · #4 (**permalink**) 08-10-2007

Just a slight modification:
[QUOTE=Klashxx;302131105]Check this:

Code:

>cat maindatafile.dat 
9899000000,SMS
989901,DATA
9899000001,DATA
9899001000,SMS
9899001001,DATA

Code:

>cat myfile.confg 
9899000000,9899999999,DATA,b.dat
9899000000,9899999999,SMS,a.dat

Code:

awk -F\, '
BEGIN {
FNR==NR} 
{
if ( NF == 2 )
   {
   i++
   ori[$2,i]=$1
   }
if ( NF == 4 )
   {
   ori[$3]
   if ($3 in ori)
      for(o=1;o<=i;o++)
         if ( ori[$3,o] > $1 && ori[$3,o] < $2 )
               {
               if ( $3 == "SMS" )
                    print ori[$3,o]","$3>"a.dat"
               if ( $3 == "DATA" )
                   print ori[$3,o]","$3>"b.dat"
               }
   }
}' maindatafile.dat myfile.confg

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Cons: Configuration is done by editing the text-based config file ... - Techworld.com	iBot	UNIX and Linux RSS News	0	10-09-2007 10:10 AM
Extracting Data from a File	oop	UNIX for Dummies Questions & Answers	0	07-31-2007 12:48 PM
Extracting Data from xml file	nishana	Shell Programming and Scripting	3	07-13-2007 08:17 AM
how to insert data in database based on text file?	forevercalz	Shell Programming and Scripting	9	12-20-2005 11:40 PM
getting data from config file	esham	Shell Programming and Scripting	7	11-21-2005 12:24 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by