Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Shell script / Grep / Awk to variable and Loop
Top Forums Shell Programming and Scripting Shell script / Grep / Awk to variable and Loop Post 302389859 by Spoonless on Tuesday 26th of January 2010 08:11:32 AM
Old 01-26-2010
Question Shell script / Grep / Awk to variable and Loop
Hi,

I have a text file with data in that I wish to extract, assign to a variable and process through a loop.

Kind of the process that I am after:

1: Grep the text file for the values.
Currently using:
cat /root/test.txt | grep TESTING= | awk -F"=" '{ a[i++] = $2 } {print a[1]}' | sort -u

This will print out the first value. (Change the print to then print the second, print a[2] )

2: Assign all occurences of my extracted value to a variable.

3: With each occurrence/ variable pass it through a loop and use it to locate/extract more information.

4: The information will then be output to another file.

For example.

Test.txt content:

Hello Mum
TESTING=FortyFive
Hello World
TESTING=IO432

Assign both grep'd/awk'd data to a variable, because for each it needs to loop through more grep/awk's to find more data.

I want to extract and display in my output file:

TESTING::FortyFive,IO432
TESTED::More extracted data,Even more data
AGAIN::Still more, and again


Therefore the data before the comma related to the first value, FortyFive, the data after the comma in the output file refers to the second value, IO432.

I hope you can understand what I am trying to do.

Hope someone can help.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Speeding up a Shell Script (find, grep and a for loop)

Hi all, I'm having some trouble with a shell script that I have put together to search our web pages for links to PDFs. The first thing I did was: ls -R | grep .pdf > /tmp/dave_pdfs.outWhich generates a list of all of the PDFs on the server. For the sake of arguement, say it looks like... (8 Replies)
Discussion started by: Dave Stockdale
8 Replies

2. Shell Programming and Scripting

Passing a variable to awk while in a shell for loop

I am a newbie to awk and c programming, however am not a unix newbie. However, I do need help with a kshell script I am writing. It is almost complete, the last step is killing me. Any help would be greatly appreciated. What I am trying to do is cat a text file that has usernames. Then, using... (2 Replies)
Discussion started by: synergy_texas
2 Replies

3. Shell Programming and Scripting

assign awk's variable to shell script's variable?

Dear All, we have a command output which looks like : Total 200 queues in 30000 Kbytes and we're going to get "200" and "30000" for further process. currently, i'm using : numA=echo $OUTPUT | awk '{print $2}' numB=echo $OUTPUT | awk '{print $5}' my question is : can I use just one... (4 Replies)
Discussion started by: tiger2000
4 Replies

4. Shell Programming and Scripting

How to give a variable output name in a shell script inside a for loop

Hi all I run my program prog.c in the following way : $ ./prog 1 > output.txt where 1 is a user defined initial value used by the program. But now I want to run it for many a thousand initial values, 1-1000, and store all the outputs in different files. Like $ ./prog 1... (1 Reply)
Discussion started by: alice06
1 Replies

5. Shell Programming and Scripting

Issue with passing variable to Grep in a shell script

Hi, I'm trying to check if methods specified in a class have been added to the corrosponding interface. My code below is giving me the following errors: grep: function: No such file or directory grep: import($zipfile): No such file or directory grep: function: No such file or... (1 Reply)
Discussion started by: racshot65
1 Replies

6. Shell Programming and Scripting

Does a variable lose its value outside the loop in shell script?

hi, when we assign a variable inside a for loop or while loop in a shell script, does it loses its value after comming out of the loop. i am facing this issue. can anyone help me?? (8 Replies)
Discussion started by: Little
8 Replies

7. Shell Programming and Scripting

Unable to pass shell script variable to awk command in same shell script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk... (2 Replies)
Discussion started by: Ashunayak
2 Replies

8. UNIX for Beginners Questions & Answers

How to grep variable in shell script?

Hi Team, I am trying to grep date in a file but it is not working #!/bin/bash d=`date "+ %Y%m%d %H:%M"` cd /scripts /bin/rm -f test1 cat /var/logs/File.txt.0 |grep $"d" >v.txt instead it is showing the complete file output. kindly suggest how should i grep this variable it works... (7 Replies)
Discussion started by: scriptor
7 Replies

9. UNIX for Beginners Questions & Answers

How can I assign awk's variable to shell script's variable?

I have the following script, and I want to assign the output ($10 and $5) from awk to N and L: grdinfo data.grd | awk '{print $10,$5}'| read N L output from gridinfo data.grd is: data.grd 50 100 41 82 -2796 6944 0.016 0.016 3001 2461. where N and L is suppose to be 3001 and 100. I use... (8 Replies)
Discussion started by: geomarine
8 Replies

10. Shell Programming and Scripting

Shell script use two variable in for loop

I want to create a shell script to add a user and modify its comment field mentioned in a file. 1. File value:- username comment field value xyz123 xyztesting abc123 abctesting def123 deftesting 2. i am using below loop to create user... (2 Replies)
Discussion started by: Anil
2 Replies

LEARN ABOUT DEBIAN

extract

EXTRACT(1)						      General Commands Manual							EXTRACT(1)

NAME

       extract - determine meta-information about a file

SYNOPSIS

       extract [ -bghLnvV ] [ -H hash-algorithm ] [ -i ] [ -l library ] [ -p type ] [ -x type ] file ...

DESCRIPTION

       This manual page documents version 0.6.0 of the extract command.

       extract	tests  each  file  specified  in the argument list in an attempt to infer meta-information from it.  Each file is subjected to the
       meta-data extraction libraries from libextractor.

       libextractor classifies meta-information (also referred to as keywords) into types. A list of all types can be obtained with the -L option.

OPTIONS

       -b      Display the output in BiBTeX format.

       -g      Use grep-friendly output (all keywords on a single line for each file).	Use the verbose option to print the filename  first,  fol-
	       lowed  by  the keywords.  Use the verbose option twice to also display the keyword types.  This option will not print keyword types
	       or non-textual metadata.

       -h      Print a brief summary of the options.

       -i      Run plugins in-process (for debugging).	By default, each plugin is run in its own process.

       -l libraries
	       Use the specified libraries to extract keywords. The general format of libraries  is  .I  [[-]LIBRARYNAME[:[-]LIBRARYNAME]*]  where
	       LIBRARYNAME  is a libextractor compatible library and typically of the form .Ijpeg. The minus before the libraryname indicates that
	       this library should be removed from the existing list.  To run only a few selected plugins, use -l in combination with -n.

       -L      Print a list of all known keyword types.

       -n      Do not use the default set of extractors (typically all standard extractors, currently mp3, ogg, jpg, gif, png, tiff,  real,  html,
	       pdf and mime-types), use only the extractors specified with the .B -l option.

       -p  type
	       Print  only  the  keywords  matching  the specified type. By default, all keywords that are found and not removed as duplicates are
	       printed.

       -v      Print the version number and exit.

       -V      Be verbose.  This option can be specified multiple times to increase verbosity further.

       -x  type
	       Exclude keywords of the specified type from the output. By default, all keywords that are found and not removed as  duplicates  are
	       printed.

SEE ALSO

       libextractor(3) - description of the libextractor library

EXAMPLES

       $ extract test/test.jpg
       comment - (C) 2001 by Christian Grothoff, using gimp 1.2 1
       mimetype - image/jpeg

       $ extract -V -x comment test/test.jpg
       Keywords for file test/test.jpg:
       mimetype - image/jpeg

       $ extract -p comment test/test.jpg
       comment - (C) 2001 by Christian Grothoff, using gimp 1.2 1

       $ extract -nV -l png.so -p comment test/test.jpg test/test.png
       Keywords for file test/test.jpg:
       Keywords for file test/test.png:
       comment - Testing keyword extraction

LEGAL NOTICE

       libextractor and the extract tool are released under the GPL.  libextractor is a GNU package.

BUGS

       A couple of file-formats (on the order of 10^3) are not recognized...

AUTHORS

       extract	was  originally  written  by  Christian  Grothoff  <christian@grothoff.org> and Vidyut Samanta <vids@cs.ucla.edu>. Use <libextrac-
       tor@gnu.org> to contact the current maintainer(s).

AVAILABILITY

       You can obtain the original author's latest version from http://www.gnu.org/software/libextractor/

libextractor 0.6.0						   Dec 20, 2009 							EXTRACT(1)
All times are GMT -4. The time now is 07:13 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy