Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract pattern from text line
Top Forums Shell Programming and Scripting Extract pattern from text line Post 302246747 by vampirodolce on Tuesday 14th of October 2008 09:46:42 AM
Old 10-14-2008
Quote:
Originally Posted by joeyg
Perhaps not elegant, but it appears to work...
That's the simplest solution and it definitely seems to work. One question though... the whole script (still partial actually) includes a lot of text manipulation, plenty of 'grep', 'tr', 'head', 'tail', and of course several pipes. The source data is downloaded from Yahoo finance via 'lynx -dump' and does not go beyond 250 lines. After dumping the 5 web pages, the CPU usage goes up to 100% for almost a minute (on a PIV, 3GHz). I didn't think this task was supposed to be so CPU-intensive for a modern PC. To be honest I still haven't had a chance to test it under linux, I am using a Win2K workstation and cygwin. What is your opinion on this?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk: need to extract a line before a pattern

Hello , I need your help to extract a line in a big file , and this line is always 11 lines before a specific pattern . Do you know a way via Awk ? Thanks in advance npn35 (17 Replies)
Discussion started by: npn35
17 Replies

2. Shell Programming and Scripting

Extract pattern from text line

Hi, the text line looks like this: "test1" " " "test2" "test3" "test4" "10" "test 10 12" "00:05:58" "filename.bin" "3.3MB" "/dir/name" "18459" what's the best way to select any of it? So I can for example get only the time or size and so on. I was trying awk -F""" '{print $N}' but... (3 Replies)
Discussion started by: TehOne
3 Replies

3. Shell Programming and Scripting

Extract pattern from text line

The text line has the following formats: what.ever.bla.bla.C01G06.BLA.BLA2 what.ever.bla.bla.C11G33.BLA.BLA2 what.ever.bla.bla.01x03.BLA.BLA2 what.ever.bla.bla.03x05.BLA.BLA2 what.ever.bla.bla.Part01.BLA.BLA2 and other similar ones, I need a way to select the "what.ever.bla.bla" part out... (4 Replies)
Discussion started by: TehOne
4 Replies

4. Shell Programming and Scripting

sed: Find start of pattern and extract text to end of line, including the pattern

This is my first post, please be nice. I have tried to google and read different tutorials. The task at hand is: Input file input.txt (example) abc123defhij-E-1234jslo 456ujs-W-abXjklp From this file the task is to grep the -E- and -W- strings that are unique and write a new file... (5 Replies)
Discussion started by: TestTomas
5 Replies

5. Shell Programming and Scripting

extract unique pattern from large text file

Hi All, I am trying to extract data from a large text file , I want to extract lines which contains a five digit number followed by a hyphen , like 12345- , i tried with egrep ,eg : egrep "+" text.txt but which returns all the lines which contains any number of digits followed by hyhen ,... (19 Replies)
Discussion started by: shijujoe
19 Replies

6. Shell Programming and Scripting

get the fifth line of a text file into a shell script and trim the line to extract a WORD

FOLKS , i have a text file that is generated automatically of an another korn shell script, i want to bring in the fifth line of the text file in to my korn shell script and look for a particular word in the line . Can you all share some thoughts on this one. thanks... Venu (3 Replies)
Discussion started by: venu
3 Replies

7. Shell Programming and Scripting

Search for a pattern,extract value(s) from next line, extract lines having those extracted value(s)

I have hundreds of files to process. In each file I need to look for a pattern then extract value(s) from next line and then search for value(s) selected from point (2) in the same file at a specific position. HEADER ELECTRON TRANSPORT 18-MAR-98 1A7V TITLE CYTOCHROME... (7 Replies)
Discussion started by: AshwaniSharma09
7 Replies

8. Shell Programming and Scripting

Extract specific line in an html file starting and ending with specific pattern to a text file

Hi This is my first post and I'm just a beginner. So please be nice to me. I have a couple of html files where a pattern beginning with "http://www.site.com" and ending with "/resource.dat" is present on every 241st line. How do I extract this to a new text file? I have tried sed -n 241,241p... (13 Replies)
Discussion started by: dejavo
13 Replies

9. Shell Programming and Scripting

Extract all the sentences from a text file that matches a pattern list

Hi I have a big text file. I want to extract all the sentences that matches at least 70% (seventy percent) of the words from each sentence based on a word list called A. Say the format of the text file is as given below: This is the first sentence which consists of fifteen words... (4 Replies)
Discussion started by: my_Perl
4 Replies

10. Shell Programming and Scripting

Extract pattern from text

Hi all, I got a txt here and I need to extract all D 8888 44 and D 8888 43 + next field =",g("en")];f._sn&&(f._sn= "og."+f._sn);for(var n in f)l.push("&"),l.push(g(n)),l.push("="),l.push(g(f));l.push("&emsg=");l.push(g(d.name+":"+d.message));var m=l.join("");Ea(m)&&(m=m.substr(0,2E3));c=m;var... (5 Replies)
Discussion started by: stinkefisch
5 Replies

LEARN ABOUT CENTOS

exigrep

EXIGREP(8)                                                    System Manager's Manual                                                   EXIGREP(8)

NAME

       EXIGREP - Search Exim's main log

SYNOPSIS

       exigrep [-l] pattern [log file] ...

DESCRIPTION

       The  exigrep  utility  is  a  Perl script that searches one or more main log files for entries that match a given pattern.  When it finds a
       match, it extracts all the log entries for the relevant message, not just those that match the pattern.  Thus, exigrep can extract complete
       log entries for a given message, or all mail for a given user, or for a given host, for example.

       The -l flag means 'literal', that is, treat all characters in the pattern as standing for themselves.  Otherwise the pattern must be a Perl
       regular expression.  The pattern match is case-insensitive.  If no file names are given on the command line, the standard input is read.

       If the location of a zcat command is known from the definition of ZCAT_COMMAND in Local/Makefile, exigrep  automatically  passes  any  file
       whose name ends in COMPRESS_SUFFIX through zcat as it searches it.

BUGS

       This manual page needs a major re-work. If somebody knows better groff than us and has more experience in writing manual pages, any patches
       would be greatly appreciated.

SEE ALSO

       exim(8), perlre(1), /usr/share/doc/exim4-base/

AUTHOR

       This manual page was stitched together from spec.txt by Andreas Metzler <ametzler at downhill.at.eu.org>, for the Debian  GNU/Linux  system
       (but may be used by others).

                                                                  March 26, 2003                                                        EXIGREP(8)
All times are GMT -4. The time now is 07:26 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy