Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: AWK/SED line based search
Top Forums Shell Programming and Scripting AWK/SED line based search Post 302586472 by new_one on Monday 2nd of January 2012 06:38:53 AM
Old 01-02-2012
Hi,

Thanks for responding. Expanding on the query, say I have a file with 2 columns, the second column has many numbers which does not concern this search and export. The first column has linearly increasing values, say from 1.000 to 1000000.000. I want to export this big file into smaller files with each file containing a thousand column 1 values (it is not exactly 1000 every time, it is all values between 1 and 1000, 1000 and 2000). There are decimals so between 1 to 1000 there may be more than a thousand values. I used
Code:
awk -vmyvarA=$a -vmyvarB=$b '($1 >= myvarA && $1 <= myvarB) { print $0; }'

to split into smaller files.

As you can see, this is very inefficient if I loop it over all values I need. It will search from the start for every iteration. What I wanted to do was to do the first search, save the last matching line number and continue the next search from that line.

I hope it is clear now.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

search file, change existing value based on input (awk help)

I have a file (status.file) of the form: valueA 3450 valueB -20 valueC -340 valueD 48 I am tailing a data.file, and need to search and modify a value in status.file...the tail is: tail -f data.file | awk '{ print $3, ($NF - $(NF-1)) }' which will produce lines that look like this: ... (3 Replies)
Discussion started by: nortonloaf
3 Replies

2. Shell Programming and Scripting

sed search and replace in next line

Hello, I am hoping someone can provide some guidance on using context based search and replace to search for a pattern and then do a search and replace in the line that follows it. For example, I have a file that looks like this: <bold>bold text </italic> somecontent morecontent... (3 Replies)
Discussion started by: charissaf67
3 Replies

3. Shell Programming and Scripting

using sed to conditionally extract stanzas of a file based on a search string

Dear All, I have a file with the syntax below (composed of several <log ..... </log> stanzas) I need to search this file for a number e.g. 2348022225919, and if it is found in a stanza, copy the whole stanza/section (<log .... </log>) to another output file. The numbers to search for are... (0 Replies)
Discussion started by: aitayemi
0 Replies

4. Shell Programming and Scripting

Append specific lines to a previous line based on sequential search criteria

I'll try explain this as best I can. Let me know if it is not clear. I have large text files that contain data as such: 143593502 09-08-20 09:02:13 xxxxxxxxxxx xxxxxxxxxxx 09-08-20 09:02:11 N line 1 test line 2 test line 3 test 143593503 09-08-20 09:02:13... (3 Replies)
Discussion started by: jesse
3 Replies

5. Shell Programming and Scripting

Printing previous line based on pattern using sed

Hi, I have a written a shell script to get the previous line based on the pattern. For example if a file has below lines: ---------------------------------------------- #UNBLOCK_As _per #As per 205.162.42.92 #BLOCK_As_per #----------------------- #input checks abc.com... (5 Replies)
Discussion started by: Anjan1
5 Replies

6. Shell Programming and Scripting

Split a line based on : using sed

Hi, i have a file say file1 having following data /abc/def:ghi/jkl/ some other text Now i want to extract only ghi/jkl/using sed, can some one please help me. Thanks Sarbjit (2 Replies)
Discussion started by: sarbjit
2 Replies

7. Shell Programming and Scripting

Search several string and convert into a single line for each search string using awk command AIX?.

I need to search the file using strings "Request Type" , " Request Method" , "Response Type" and by using result set find the xml tags and convert into a single line?. below are the scenarios. Cat test Nov 10, 2012 5:17:53 AM INFO: Request Type Line 1.... (5 Replies)
Discussion started by: laknar
5 Replies

8. Shell Programming and Scripting

Multiple line search, replace second line, using awk or sed

All, I appreciate any help you can offer here as this is well beyond my grasp of awk/sed... I have an input file similar to: &LOG &LOG Part: "@DB/TC10000021855/--F" &LOG &LOG &LOG Part: "@DB/TC10000021852/--F" &LOG Cloning_Action: RETAIN &LOG Part: "@DB/TCCP000010713/--A" &LOG &LOG... (5 Replies)
Discussion started by: KarmaPoliceT2
5 Replies

9. Shell Programming and Scripting

awk command to search based on 5 user input fields

Field1=”” Field2=”” Field3=”” Field4=”” Field5=”” USER INPUT UP TO 5 FIELDS awk -F , '{ if ( $3 == Field1 && $6 == Field2 && $8 == Field3 && $9 == Field4 && $10 == Field5) print $0 }' /tmp/rodney.outD INPUT FILE (Rodney.outD): ... (3 Replies)
Discussion started by: rmerrird
3 Replies

10. UNIX for Beginners Questions & Answers

Search a multi-line shell command output and execute logic based on result

The following is a multi-line shell command example: $cargo build Compiling prawn v0.1.0 (/Users/ag/rust/prawn) error: failed to resolve: could not find `setup_panix` in `human_panic` --> src/main.rs:14:22 | 14 | human_panic::setup_panix!(); | ... (2 Replies)
Discussion started by: yogi
2 Replies

LEARN ABOUT MOJAVE

xvsetportattribute

XvSetPortAttribute(3)                                             libXv Functions                                            XvSetPortAttribute(3)

NAME

       XvSetPortAttribute - sets an attribute of a video port

SYNOPSIS

       #include <X11/extensions/Xvlib.h>

       int XvSetPortAttribute(Display *dpy, XvPortID port,
                              Atom attribute, int value);

ARGUMENTS

       dpy            Specifies the connection to the X server.

       port           Specifies the port for which the attribute is to be used.

       attribute      Identifies the port attribute to be set by this request.  Can be one of the table entries under the column "String," below.

       value          Identifies the value to which attribute is to be set.  Can be one of the table entries under the column "Type," below.

DESCRIPTION

       XvSetPortAttribute(3)
        permits a client to set the port attribute to specified values.  This request supports the following values:

       -----------------------------------------------------

              Attribute String   Type             Default
       -----------------------------------------------------
       "XV_ENCODING"      XvEncodingID     Server dependent
       "XV_HUE"           [-1000...1000]   0
       "XV_SATURATION"    [-1000...1000]   0
       "XV_BRIGHTNESS"    [-1000...1000]   0
       "XV_CONTRAST"      [-1000...1000]   0

       The supplied encoding must be one of the encodings listed for the adaptor, otherwise an Encoding error results.

       If  the  adaptor  does  not  support  the exact hue, saturation, brightness, and contrast levels supplied, the closest levels supported are
       assumed.  Use XvGetPortAttribute(3) to query the resulting levels.

       When an XvSetPortAttribute(3) request is processed, a XvPortNotify(3) event is generated for all clients that have  requested  notification
       of port changes using XvSelectPortNotify(3).

RETURN VALUES

       [Success]
               Returned if XvSetPortAttribute(3) completed successfully.

       [XvBadExtension]
               Returned if the Xv extension is unavailable.

       [XvBadAlloc]
               Returned if XvSelectVideoNotify(3) failed to allocate memory to process the request.

DIAGNOSTICS

       [XvBadPort]
               Generated if the requested port does not exist.

       [XvBadEncoding]
               Generated if an encoding is specified that does not exist.

       [BadMatch]
               Generated if the requested attribute atom does not specify an attribute supported by the adaptor.

SEE ALSO

       XvGetPortAttribute(3), XvQueryPortAttributes(3), XvSelectPortNotify(3), XvPortNotify(3)

X Version 11                                                        libXv 1.0.7                                              XvSetPortAttribute(3)
All times are GMT -4. The time now is 01:22 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy