Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Shell script / Grep / Awk to variable and Loop

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Shell script / Grep / Awk to variable and Loop
# 1  
Old 01-26-2010
Question Shell script / Grep / Awk to variable and Loop
Hi,

I have a text file with data in that I wish to extract, assign to a variable and process through a loop.

Kind of the process that I am after:

1: Grep the text file for the values.
Currently using:
cat /root/test.txt | grep TESTING= | awk -F"=" '{ a[i++] = $2 } {print a[1]}' | sort -u

This will print out the first value. (Change the print to then print the second, print a[2] )

2: Assign all occurences of my extracted value to a variable.

3: With each occurrence/ variable pass it through a loop and use it to locate/extract more information.

4: The information will then be output to another file.

For example.

Test.txt content:

Hello Mum
TESTING=FortyFive
Hello World
TESTING=IO432

Assign both grep'd/awk'd data to a variable, because for each it needs to loop through more grep/awk's to find more data.

I want to extract and display in my output file:

TESTING::FortyFive,IO432
TESTED::More extracted data,Even more data
AGAIN::Still more, and again


Therefore the data before the comma related to the first value, FortyFive, the data after the comma in the output file refers to the second value, IO432.

I hope you can understand what I am trying to do.

Hope someone can help.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script use two variable in for loop

I want to create a shell script to add a user and modify its comment field mentioned in a file. 1. File value:- username comment field value xyz123 xyztesting abc123 abctesting def123 deftesting 2. i am using below loop to create user... (2 Replies)
Discussion started by: Anil
2 Replies

2. UNIX for Beginners Questions & Answers

How can I assign awk's variable to shell script's variable?

I have the following script, and I want to assign the output ($10 and $5) from awk to N and L: grdinfo data.grd | awk '{print $10,$5}'| read N L output from gridinfo data.grd is: data.grd 50 100 41 82 -2796 6944 0.016 0.016 3001 2461. where N and L is suppose to be 3001 and 100. I use... (8 Replies)
Discussion started by: geomarine
8 Replies

3. UNIX for Beginners Questions & Answers

How to grep variable in shell script?

Hi Team, I am trying to grep date in a file but it is not working #!/bin/bash d=`date "+ %Y%m%d %H:%M"` cd /scripts /bin/rm -f test1 cat /var/logs/File.txt.0 |grep $"d" >v.txt instead it is showing the complete file output. kindly suggest how should i grep this variable it works... (7 Replies)
Discussion started by: scriptor
7 Replies

4. Shell Programming and Scripting

Unable to pass shell script variable to awk command in same shell script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk... (2 Replies)
Discussion started by: Ashunayak
2 Replies

5. Shell Programming and Scripting

Does a variable lose its value outside the loop in shell script?

hi, when we assign a variable inside a for loop or while loop in a shell script, does it loses its value after comming out of the loop. i am facing this issue. can anyone help me?? (8 Replies)
Discussion started by: Little
8 Replies

6. Shell Programming and Scripting

Issue with passing variable to Grep in a shell script

Hi, I'm trying to check if methods specified in a class have been added to the corrosponding interface. My code below is giving me the following errors: grep: function: No such file or directory grep: import($zipfile): No such file or directory grep: function: No such file or... (1 Reply)
Discussion started by: racshot65
1 Replies

7. Shell Programming and Scripting

How to give a variable output name in a shell script inside a for loop

Hi all I run my program prog.c in the following way : $ ./prog 1 > output.txt where 1 is a user defined initial value used by the program. But now I want to run it for many a thousand initial values, 1-1000, and store all the outputs in different files. Like $ ./prog 1... (1 Reply)
Discussion started by: alice06
1 Replies

8. Shell Programming and Scripting

assign awk's variable to shell script's variable?

Dear All, we have a command output which looks like : Total 200 queues in 30000 Kbytes and we're going to get "200" and "30000" for further process. currently, i'm using : numA=echo $OUTPUT | awk '{print $2}' numB=echo $OUTPUT | awk '{print $5}' my question is : can I use just one... (4 Replies)
Discussion started by: tiger2000
4 Replies

9. Shell Programming and Scripting

Passing a variable to awk while in a shell for loop

I am a newbie to awk and c programming, however am not a unix newbie. However, I do need help with a kshell script I am writing. It is almost complete, the last step is killing me. Any help would be greatly appreciated. What I am trying to do is cat a text file that has usernames. Then, using... (2 Replies)
Discussion started by: synergy_texas
2 Replies

10. UNIX for Dummies Questions & Answers

Speeding up a Shell Script (find, grep and a for loop)

Hi all, I'm having some trouble with a shell script that I have put together to search our web pages for links to PDFs. The first thing I did was: ls -R | grep .pdf > /tmp/dave_pdfs.outWhich generates a list of all of the PDFs on the server. For the sake of arguement, say it looks like... (8 Replies)
Discussion started by: Dave Stockdale
8 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

mail::box::search::grep

Mail::Box::Search::Grep(3pm)				User Contributed Perl Documentation			      Mail::Box::Search::Grep(3pm)

NAME

       Mail::Box::Search::Grep - select messages within a mail box like grep does

INHERITANCE

	Mail::Box::Search::Grep
	  is a Mail::Box::Search
	  is a Mail::Reporter

SYNOPSIS

	use Mail::Box::Manager;
	my $mgr    = Mail::Box::Manager->new;
	my $folder = $mgr->open('Inbox');

	my $filter = Mail::Box::Search::Grep->new
	   ( label => 'selected'
	   , in => 'BODY', match => qr/abc?d*e/
	   );

	my @msgs   = $filter->search($folder);

	my $filter = Mail::Box::Search::Grep->new
	  ( field => 'To'
	  , match => $my_email
	  );

	if($filter->search($message)) {...}

DESCRIPTION

       Try to find some text strings in the header and footer of messages.  Various ways to limit the search to certain header fields, the whole
       header, only the body, the whole message, but even binary multiparts, are provided for.

       The name grep is derived from the UNIX tool grep, which means: "Get Regular Expression and Print".  Although you can search using regular
       expressions (the Perl way of them), you do not have to print those as result.

METHODS

   Constructors
       Mail::Box::Search::Grep->new(OPTIONS)
	   Create a UNIX-grep like search filter.

	    -Option    --Defined in	--Default
	     binaries	 Mail::Box::Search  <false>
	     decode	 Mail::Box::Search  <true>
	     delayed	 Mail::Box::Search  <true>
	     deleted	 Mail::Box::Search  <false>
	     deliver			  undef
	     field			  undef
	     in 	 Mail::Box::Search  <$field ? 'HEAD' : C<'BODY'>>
	     label	 Mail::Box::Search  undef
	     limit	 Mail::Box::Search  0
	     log	 Mail::Reporter   'WARNINGS'
	     logical	 Mail::Box::Search  'REPLACE'
	     match			  <required>
	     multiparts  Mail::Box::Search  <true>
	     trace	 Mail::Reporter   'WARNINGS'

	   binaries => BOOLEAN
	   decode => BOOLEAN
	   delayed => BOOLEAN
	   deleted => BOOLEAN
	   deliver => undef|CODE|'DELETE'|LABEL|'PRINT'|REF-ARRAY
	     Store the details about where the match was found.  The search may take much longer when this feature is enabled.

	     When an ARRAY is specified it will contain a list of references to hashes.  Each hash contains the information of one match.  A match
	     in a header line will result in a line with fields "message", "part", and "field", where the field is a Mail::Message::Field object.
	     When the match is in the body the hash will contain a "message", "part", "linenr", and "line".

	     In case of a CODE reference, that routine is called for each match. The first argument is this search object and the second a
	     reference to same hash as would be stored in the array.

	     The "PRINT" will call printMatchedHead() or printMatchedBody() when any matching header resp body line was found.	The output is
	     minimized by not reprinting the message info on multiple matches in the same message.

	     "DELETE" will flag the message to be deleted in case of a match.  When a multipart's part is matched, the whole message will be
	     flagged for deletion.

	   field => undef|STRING|REGEX|CODE
	     Not valid in combination with "in" set to "BODY".	The STRING is one full field name (case-insensitive).  Use a REGEX to select more
	     than one header line to be scanned. CODE is a routine which is called for each field in the header.   The CODE is called with the
	     header as first, and the field as second argument.  If the CODE returns true, the message is selected.

	   in => 'HEAD'|'BODY'|'MESSAGE'
	   label => STRING
	   limit => NUMBER
	   log => LEVEL
	   logical => 'REPLACE'|'AND'|'OR'|'NOT'|'AND NOT'|'OR NOT'
	   match => STRING|REGEX|CODE
	     The pattern to be search for can be a REGular EXpression, or a STRING.  In both cases, the match succeeds if it is found anywhere
	     within the selected fields.

	     With a CODE reference, that function will be called each field or body-line.  When the result is true, the details are delivered.
	     The call formats are

	      $code->($head, $field);	       # for HEAD searches
	      $code->($body, $linenr, $line);  # for BODY searches

	     The $head resp $body are one message's head resp. body object.  The $field is a header line which matches.  The $line and $linenr
	     tell the matching line in the body.

	     Be warned that when you search in "MESSAGE" the code must accept both formats.

	   multiparts => BOOLEAN
	   trace => LEVEL

   Searching
       $obj->inBody(PART, BODY)
	   See "Searching" in Mail::Box::Search

       $obj->inHead(PART, HEAD)
	   See "Searching" in Mail::Box::Search

       $obj->search(FOLDER|THREAD|MESSAGE|ARRAY-OF-MESSAGES)
	   See "Searching" in Mail::Box::Search

       $obj->searchPart(PART)
	   See "Searching" in Mail::Box::Search

   The Results
       $obj->printMatch([FILEHANDLE], MATCH)
       $obj->printMatchedBody(FILEHANDLE, MATCH)
       $obj->printMatchedHead(FILEHANDLE, MATCH)

   Error handling
       $obj->AUTOLOAD()
	   See "Error handling" in Mail::Reporter

       $obj->addReport(OBJECT)
	   See "Error handling" in Mail::Reporter

       $obj->defaultTrace([LEVEL]|[LOGLEVEL, TRACELEVEL]|[LEVEL, CALLBACK])
       Mail::Box::Search::Grep->defaultTrace([LEVEL]|[LOGLEVEL, TRACELEVEL]|[LEVEL, CALLBACK])
	   See "Error handling" in Mail::Reporter

       $obj->errors()
	   See "Error handling" in Mail::Reporter

       $obj->log([LEVEL [,STRINGS]])
       Mail::Box::Search::Grep->log([LEVEL [,STRINGS]])
	   See "Error handling" in Mail::Reporter

       $obj->logPriority(LEVEL)
       Mail::Box::Search::Grep->logPriority(LEVEL)
	   See "Error handling" in Mail::Reporter

       $obj->logSettings()
	   See "Error handling" in Mail::Reporter

       $obj->notImplemented()
	   See "Error handling" in Mail::Reporter

       $obj->report([LEVEL])
	   See "Error handling" in Mail::Reporter

       $obj->reportAll([LEVEL])
	   See "Error handling" in Mail::Reporter

       $obj->trace([LEVEL])
	   See "Error handling" in Mail::Reporter

       $obj->warnings()
	   See "Error handling" in Mail::Reporter

   Cleanup
       $obj->DESTROY()
	   See "Cleanup" in Mail::Reporter

       $obj->inGlobalDestruction()
	   See "Cleanup" in Mail::Reporter

DIAGNOSTICS

       Error: Package $package does not implement $method.
	   Fatal error: the specific package (or one of its superclasses) does not implement this method where it should. This message means that
	   some other related classes do implement this method however the class at hand does not.  Probably you should investigate this and
	   probably inform the author of the package.

SEE ALSO

       This module is part of Mail-Box distribution version 2.105, built on May 07, 2012. Website: http://perl.overmeer.net/mailbox/

LICENSE

       Copyrights 2001-2012 by [Mark Overmeer]. For other contributors see ChangeLog.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.  See
       http://www.perl.com/perl/misc/Artistic.html

perl v5.14.2							    2012-05-07					      Mail::Box::Search::Grep(3pm)