Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Parsing the longest match substring
Top Forums Shell Programming and Scripting Parsing the longest match substring Post 302992867 by senhia83 on Thursday 2nd of March 2017 03:32:21 PM
Old 03-02-2017
Quote:
Originally Posted by Don Cragun
Are you saying that what you really want is the longest string that matches an entire line in the file named primary that appears on both sides of the // on each line in the file named scrambled?

To determine whether the time my script spends keeping the lengths[] array in order is worth the effort, how many lines are typically in each of your two real input files?
Not the entire the line, only the shorter split (separated by //) will have the primary signal.

In my original code I use

{ short=length($1)>length($2)? $2:$1 } to determine which of the two fields is shorter in length and just search that for the primary signal if(short~ps).

There are 10k primary signals and 400k scrambled signals at this point. The scrambled signals will be more (~100k per year) as we collect more data.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Finding longest common substring among filenames

I will be performing a task on several directories, each containing a large number of files (2500+) that follow a regular naming convention: YYYY_MM_DD_XX.foo_bar.A.B.some_different_stuff.EXT What I would like to do is automatically discover the part of the filenames that are common to all... (1 Reply)
Discussion started by: cmcnorgan
1 Replies

2. Shell Programming and Scripting

Parsing file to match strings

I have a file with the following format 12g data/datasets/cct 8g data/dataset/cct 10 g data/two 5g data/something_different 10g something_different 5g data/two is there a way to loop through this... (1 Reply)
Discussion started by: yawalias
1 Replies

3. Shell Programming and Scripting

Awk Array doesnt match for substring

Awk Array doesnt match for substring nawk -F"," 'FNR==NR{a=$2 OFS $3;next} a{print $1,$2,a}' OFS="," file1 file2 I want cluster3 in file1 to match with cluster3int in file2 output getting: Output required: Help is appreciated (8 Replies)
Discussion started by: pinnacle
8 Replies

4. Shell Programming and Scripting

shell script: longest match from right?

Return the position of matched string from right, awk match can do from left only. e.g return pos 7 for search string "service" from "AA-service" or return the matched string "service", then caculate the string length. Thanks!. (3 Replies)
Discussion started by: honglus
3 Replies

5. Shell Programming and Scripting

Substring match

Hi, I want to find a file / directory with the name xxxxCELLxxx in the given path. The CELL is can be either in a UPPER or lower case. Thanks (4 Replies)
Discussion started by: youknowme
4 Replies

6. Shell Programming and Scripting

Longest word in a file

I am trying to write a command on just one line, i.e seperated by ';' and '|' etc, that finds the number of characters in the longest word of a file, preferably using the 'tr' and 'wc' commands. i no that wc shows the number of lines words and characters in a file but im not sure how to use it... (5 Replies)
Discussion started by: scotty85
5 Replies

7. UNIX for Dummies Questions & Answers

Deleting files based on Substring match

In folder there are files (eg ABS_18APR2012_XYZ.csv DSE_17APR2012_ABE.csv) . My requirement is to delete all the files except today's timestamp I tried doing this to list all the files not having today's date timestamp #!/bin/ksh DATE=`date +"%d%h%Y"` DIR=/data/rfs/... (9 Replies)
Discussion started by: manushi88
9 Replies

8. Shell Programming and Scripting

Match substring from a column of the second file

I want to merge the lines by matching substring of the first file with first column of the second file. file1: S00739A_ACAGTG_L001_R1.fq.gz S00739A_ACAGTG_L001_R2.fq.gz S00739B_GCCAAT_L001_R1.fq.gz S00739B_GCCAAT_L001_R2.fq.gz S00739D_GTGAAA_L001_R1.fq.gz S00739D_GTGAAA_L001_R2.fq.gz... (14 Replies)
Discussion started by: yifangt
14 Replies

9. Shell Programming and Scripting

Match text to lines in a file, iterate backwards until text or text substring matches, print to file

hi all, trying this using shell/bash with sed/awk/grep I have two files, one containing one column, the other containing multiple columns (comma delimited). file1.txt abc12345 def12345 ghi54321 ... file2.txt abc1,text1,texta abc,text2,textb def123,text3,textc gh,text4,textd... (6 Replies)
Discussion started by: shogun1970
6 Replies

10. UNIX for Beginners Questions & Answers

Replace substring by longest string in common field (awk)

Hi, Let's say I have a pipe-separated input like so: name_10|A|BCCC|cat_1 name_11|B|DE|cat_2 name_10|A|BC|cat_3 name_11|B|DEEEEEE|cat_4 Using awk, for records with common field 2, I am trying to replace all the shortest substrings by the longest string in field 3. In order to get the... (5 Replies)
Discussion started by: beca123456
5 Replies

LEARN ABOUT DEBIAN

empty-page

EMPTY-PAGE(1)							 ExactImage Manual						     EMPTY-PAGE(1)

NAME

       empty-page - empty page detector of the ExactImage toolkit

SYNOPSIS

       empty-page [option...] {-i | --input} input-file

       empty-page {-h | --help}

DESCRIPTION

       ExactImage is a fast C++ image processing library. Unlike many other library frameworks it allows operation in several color spaces and bit
       depths natively, resulting in low memory and computational requirements.

       empty-page counts dark pixels of a black and white image and decides with a threshold whether the page is most probably empty, and thus can
       be removed from the image processing stream.

OPTIONS

       -i file, --input file
	   Read image from the specified file.

       -m n, --margin n
	   Set width of border margin to skip. For speed reasons, the margin has to be a multiple of 8. The default is 16.

       -p x, --percentage x
	   Set fraction of permissible dark pixels. The default is 0.05 (5%).

       -h, --help
	   Display help text and exit.

EXAMPLES

	   $ empty-page -i test.tif
	   The image has 75461 dark pixels from a total of 1060992 (7.11231%).
	   non-empty

EXIT STATUS

       The exit status is 0 if the image is mostly white, 1 otherwise.

SEE ALSO

       exactimage(7)

AUTHORS

       Jakub Wilk <jwilk@debian.org>
	   Wrote this manual page for the Debian system.

       http://www.exactcode.de/site/open_source/exactimage/
	   This manual page incorporates texts found on the ExactImage homepage.

COPYRIGHT

       This manual page was written for the Debian system (and may be used by others).

       Permission is granted to copy, distribute and/or modify this document under the terms of the GNU General Public License, Version 2 or (at
       your option) any later version published by the Free Software Foundation.

       On Debian systems, the complete text of the GNU General Public License can be found in /usr/share/common-licenses/GPL-2.

empty-page							    09/09/2013							     EMPTY-PAGE(1)
All times are GMT -4. The time now is 07:20 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy