Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extracting data from text file based on configuration set in config file
Top Forums Shell Programming and Scripting Extracting data from text file based on configuration set in config file Post 302131283 by Klashxx on Friday 10th of August 2007 02:25:07 AM
Old 08-10-2007
Just a slight modification:
[QUOTE=Klashxx;302131105]Check this:

Code:
>cat maindatafile.dat 
9899000000,SMS
989901,DATA
9899000001,DATA
9899001000,SMS
9899001001,DATA

Code:
>cat myfile.confg 
9899000000,9899999999,DATA,b.dat
9899000000,9899999999,SMS,a.dat

Code:
awk -F\, '
BEGIN {
FNR==NR} 
{
if ( NF == 2 )
   {
   i++
   ori[$2,i]=$1
   }
if ( NF == 4 )
   {
   ori[$3]
   if ($3 in ori)
      for(o=1;o<=i;o++)
         if ( ori[$3,o] > $1 && ori[$3,o] < $2 )
               {
               if ( $3 == "SMS" )
                    print ori[$3,o]","$3>"a.dat"
               if ( $3 == "DATA" )
                   print ori[$3,o]","$3>"b.dat"
               }
   }
}' maindatafile.dat myfile.confg

 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

extracting a set of strings from a text file

i have textfiles that contain a series of lines that look like this: string0 .................................................... column3a column4a string1**384y0439 ..................................... column3b column4b... (2 Replies)
Discussion started by: Deanne
2 Replies

2. Shell Programming and Scripting

Extracting data between tags based on search string from unix file

Input file is on Linux box and the input file has data in just one line with 1699741696 characters. Sample Input: <xxx><document coll="uspatfull" version="0"><CMSdoc>xxxantivirus</CMSdoc><tag1>1</tag1></document><document coll="uspatfull"... (5 Replies)
Discussion started by: gaya
5 Replies

3. Shell Programming and Scripting

Extracting data based on the list file

Hi there, Can you help. I need to extract data based on the list file(list.txt) from item.txt as shown below. Please note the actual files are enormous in size. Thank you. item.txt nokia1100 123,000 nokia2100 66,000 samsung123 11,000 samsung456 23,000 iphone432 234,000... (12 Replies)
Discussion started by: shtobias
12 Replies

4. UNIX for Dummies Questions & Answers

Extracting rows from a text file based on the first column

I have a tab delimited text file where the first column can take on three different values : 100, 150, 250. I want to extract all the rows where the first column is 100 and put them into a separate text file and so on. This is what my text file looks like now: 100 rs3794811 0.01 0.3434... (1 Reply)
Discussion started by: evelibertine
1 Replies

5. UNIX for Dummies Questions & Answers

Extracting rows from a text file based on the first column

I have a tab delimited text file where the first column can take on three different values : 100, 150, 250. I want to extract all the rows where the first column is 100 and put them into a separate text file and so on. This is what my text file looks like now: 100 rs3794811 0.01 0.3434 100... (1 Reply)
Discussion started by: evelibertine
1 Replies

6. Shell Programming and Scripting

Filter a .kml file (xml) with data set from text file

I have a .kml file. So I want filter the .kml to get only the tags that have this numeric codes that they are in a text file 11951 11952 74014 11964 11965 11969 11970 11971 11972 60149 74018 74023 86378 11976 11980 11983 11984 11987 (5 Replies)
Discussion started by: pcoj33
5 Replies

7. Shell Programming and Scripting

Extracting a set of patterns from the text file

Hi experts, I need a help in extracting a set of patterns from the text file. Below is my scenario. Input file: I need to extract the data between My output should be as Thanks, Kalai (7 Replies)
Discussion started by: kalpeer
7 Replies

8. UNIX for Dummies Questions & Answers

Extracting lines from a text file based on another text file with line numbers

Hi, I am trying to extract lines from a text file given a text file containing line numbers to be extracted from the first file. How do I go about doing this? Thanks! (1 Reply)
Discussion started by: evelibertine
1 Replies

9. UNIX for Dummies Questions & Answers

Extracting data from one file, based on another file (splitting)

Dear All, I have two files but want to extract data from one based on another... can you please help me file 1 David Tom Ellen and file 2 David|0010|testnamez|resultsz David|0004|testnamex|resultsx Tom|0010|testnamez|resultsz Tom|0004|testnamex|resultsx Ellen|0010|testnamez|resultsz... (12 Replies)
Discussion started by: A-V
12 Replies

LEARN ABOUT DEBIAN

sdpa

SDPA(1) 						      General Commands Manual							   SDPA(1)

NAME

       SDPA - High-performance software package for SemiDefinite Programs

SYNOPSIS

       sdpa DataFile OutputFile [InitialPtFile] [-pt parameters] [-dimacs] [-numThreads  numThreads]
       sdpa [options] files...
       sdpa --version

DESCRIPTION

       sdpa  - "SDPA (SemiDefinite Programming Algorithm)" is one of the most efficient and stable software packages for solving SDPs based on the
       primal-dual interior-point method.

       SDP (SemiDefinite Program) is used for financial engineering, machine learning, control theory, sensor network problem, quantum	chemistry,
       quantum information, combinatorial optimizaiton, polynomial optimization, and so on.

       Futher information on SDP and SDPA can be found at
       http://sdpa.sourceforge.net/

OPTIONS

       ---- option type 1 ----
       sdpa DataFile OutputFile [InitialPtFile] [-pt parameters] [-dimacs] [-numThreads numThreads]
       parameters = 0 default, 1 fast (unstable), 2 slow (stable)
       example1-1: sdpa example1.dat example1.result
       example1-2: sdpa example1.dat-s example1.result
       example1-3: sdpa example1.dat example1.result example1.ini
       example1-4: sdpa example1.dat example1.result -pt 2
       example1-5: sdpa example1.dat example1.result -dimacs
       example1-6: sdpa example1.dat example1.result -numThreads 4
       ---- option type 2 ----
       sdpa [option filename]+
	 -dd : data dense :: -ds : data sparse
	 -id : init dense :: -is : init sparse
	 -o  : output	  :: -p  : parameter
	 -pt : parameters , 0 default, 1 fast (unstable)
			    2 slow (stable)
       example2-1: sdpa -o example1.result -dd example1.dat
       example2-2: sdpa -ds example1.dat-s -o example1.result -p param.sdpa
       example2-3: sdpa -ds example1.dat-s -o example1.result -pt 2
       example2-4: sdpa -ds example1.dat-s -o example1.result -dimacs
       example2-5: sdpa -ds example1.dat-s -o example1.result -numThreads 4
       ---- option type 3 ----
       sdpa --version
       to print out version and exit.

       PARAMETER_FILE
	      is decided by the following priority
		 1: The file assigned by '-p' option of 'option type 2'.
		     For 'option type1', this is skipped.
		 2: ./param.sdpa
		     For 'option type2', this is skipped.
		 3: /usr/share/sdpa/param.sdpa
		 4: Default parameter

       -dimacs
	      printout dimacs information incurring additional computation cost

       -numThreads
	      number of pthreads for internal computation

AUTHOR

       SDPA was written by SDPA Project <sdpa-developers@lists.sourceforge.net>.

       This manual page was written by Makoto Yamashita <Makoto.Yamashita@is.titech.ac.jp>.

								   July 28, 2011							   SDPA(1)
All times are GMT -4. The time now is 10:32 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy