Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Complex grep command
Top Forums Shell Programming and Scripting Complex grep command Post 302925596 by derekludwig on Tuesday 18th of November 2014 04:59:33 AM
Old 11-18-2014
If one reads your requirement:
Quote:
I need to grep for each pattern on the file for example:
Would it be fair to say that you want to split the original files into N new files, one file for each unique line (pattern) of the original? If so, you do realize that each file will contain one or more copies of the same line (pattern). Perhaps:
Code:
sort file | uniq -c

might be useful? However, if you have to split the files:
Code:
sort -u ${FILE} | while read pattern; do
  grep "^${pattern}$" ${FILE} > "${pattern}.csv"
done

(untested)

which seems clunky since the file is being read N times, one for each pattern. How about:
Code:
sort ${FILE} | uniq -c | while read N pattern; do
  while [[ 0 -lt ${N} ]]; do
    echo "${pattern}"
    (( N = N - 1 ))
  done > "${pattern}.csv"
done

(untested)
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

parse text or complex grep ?

I have the following file (records from db) and I need to retrieve in another file only two variables and their values. I have a command but works only for one value. grep ^mob: R25-subs.ldi | sed 's/mob: //' | sort | uniq >text_output Can someone please help me? dn:... (4 Replies)
Discussion started by: jacost
4 Replies

2. Answers to Frequently Asked Questions

advanced/complex uses of the find command

Perhaps the number one advanced find question is: How to stop find from descending into subdirectories? find command Performing a non-recursive find in Unix Use -prune with find command on AIX Searching for files over 30 days old in current directory disk space used for files with in a... (0 Replies)
Discussion started by: Perderabo
0 Replies

3. Shell Programming and Scripting

complex command substitution

hi, I have to execute this line below from within a shell script; simply backquoting it is not doing the trick; it is mangling up all the options; but when i type it out on a command line, it executes cleanly. Please help me in getting this right; $ vlc -I dummy --sout='#transcode{vcodec=mp4v,... (5 Replies)
Discussion started by: spopuri
5 Replies

4. Shell Programming and Scripting

complex grep command

hi all i have file call "list.log" which contains like this 00300 000024501043846 0 00300 000034531322871 0 00600 000000489100734 0 and so on .. the file goes like this:(example first row) from position 1-5 the lider number(300),position 7-21 id... (0 Replies)
Discussion started by: naamas03
0 Replies

5. Shell Programming and Scripting

Complex find grep or sed command

Haven't worked in bash for ages. did a good bit of shell scripting in regular sh, but have forgotten most of it. I have several thousand php files that now include the following line at the end of the file. There is no LF or CR/LF before it begins, it is just concatenated to the final line of... (3 Replies)
Discussion started by: sjburden
3 Replies

6. Shell Programming and Scripting

Complex Email command in unix

Folks, I have two files, i.e. one.txt and two.dat on unix file system. I need to include the contents of one.txt in the body of the email to the sender and attach two.dat in the same email as an attachment using ksh commands, mailx or uuencode etc... I know how to send them seperately but I... (2 Replies)
Discussion started by: calredd
2 Replies

7. UNIX for Advanced & Expert Users

complex find command

Hi all, I am trying to execute the following command: find 'path' -ls -exec cksum {} \; As you can see this simply finds files from a given path and runs cksum on them. My problem is this, if i have a FIFO in a directory the find tries to execute cksum on it and gets stuck. From the man page i... (9 Replies)
Discussion started by: noam128
9 Replies

8. Shell Programming and Scripting

find command with complex logic

I'm looking to write a script that will do a find of directories and delete them if they are older than x days but keep the last x # of folders even if they are older than x days. The usage is for a deployment location, so we want to keep the location clean but retain maybe the last 2 builds that... (5 Replies)
Discussion started by: MaureenT
5 Replies

9. Shell Programming and Scripting

How to grep for a complex String?

Hi, I have a file hello.log which has the below entry ./logs/mymac/myserver.log:####<Jun 7, 2015 12:56:54 PM EDT> <myserver.my.bank.com> <mymac> < ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <1434640> <BEA-0900> <User user1 in security realm... (3 Replies)
Discussion started by: shifahim
3 Replies

10. Shell Programming and Scripting

Complex Filter using grep, awk or sed

Hi, I'm not very familiar witrh sed or awk and hope the somebody can help me to solve my problem. I need to filter a text report using grep, sed or awk. I would like to cut out text lines with the pattern INFO and if exists the following lines of the pattern DETAILS. I need te keep the lines with... (4 Replies)
Discussion started by: Frankg
4 Replies

LEARN ABOUT OPENDARWIN

fc-pattern

FC-PATTERN(1)															     FC-PATTERN(1)

NAME

       fc-pattern - parse and show pattern

SYNOPSIS

       fc-pattern [ -cdVh ]  [ --config ]  [ --default ]  [  [ -f format ]  [ --format format ]  ]  [ --version ]  [ --help ]

	[ pattern  [ element... ]   ]

DESCRIPTION

       fc-pattern  parses  pattern (empty pattern by default) and shows the parsed result.  If --config is given, config substitution is performed
       on the pattern before being displayed.  If --default is given, default substitution is performed on the pattern before being displayed.

       If any elements are specified, only those are printed.

OPTIONS

       This program follows the usual GNU command line syntax, with long options starting with two dashes (`-'). A summary of options is  included
       below.

       -c     Perform config substitution on pattern.

       -d     Perform default substitution on pattern.

       -f     Format output according to the format specifier format.

       -V     Show version of the program and exit.

       -h     Show summary of options.

       pattern
	      Parses and displays pattern (uses empty pattern by default).

       element
	      If set, the element property is displayed for parsed pattern.

SEE ALSO

       FcNameParse(3)  FcConfigSubstitute(3)  FcDefaultSubstitute(3)  FcPatternPrint(3)  FcPatternFormat(3)  fc-cat(1)	fc-cache(1) fc-list(1) fc-
       match(1) fc-query(1) fc-scan(1)

       The fontconfig user's guide, in HTML format: /usr/share/doc/fontconfig/fontconfig-user.html.

AUTHOR

       This manual page was updated by Behdad Esfahbod <behdad@behdad.org>.

								   Apr 20, 2010 						     FC-PATTERN(1)
All times are GMT -4. The time now is 02:35 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy