Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk remove/grab lines from file with pattern from other file
Top Forums Shell Programming and Scripting awk remove/grab lines from file with pattern from other file Post 302966265 by RavinderSingh13 on Wednesday 10th of February 2016 08:36:12 AM
Old 02-10-2016
Quote:
Originally Posted by SDohmen
I know i can redirect the output but it still did not remove the lines from the main file. Sorry if that was unclear before.

Omg you are fast with editing Smilie. I tested the revised code and it seems to work fine. I now have 2 files with different output in each. I will test it some more with other files to be sure but it seems to work. Thank you again for the extremly fast helping.
Hello SDohmen,

Here is exactly what you may be looking for.
Code:
cat script.ksh
awk 'FNR==NR{A[$1]=$1;next} ($1 in A){print >> "Output_match_found_file"} !($1 in A){print >> "Output_match_NOT_found_file"}' pattern_file FS=";" main_file
if [[ $? == 0 ]]
then
        mv  main_file main_file_Original
        mv  Output_match_NOT_found_file main_file
else
        echo "Please check there seems to be an issue with awk command."
fi

Above code will create a backup for main_file with name main_file_Original and remvove non-matching lines from main_file too, let me know if this helps you.
EDIT: Also you could try following too. Here if first awk statement fails then off course 2nd statement to change Input_file name will not be executed then.
Code:
 awk 'FNR==NR{A[$1]=$1;next} ($1 in A){print >> "Output_match_found_file"} !($1 in A){print >> "Output_match_NOT_found_file"}' pattern_file FS=";" match_file && mv Output_match_NOT_found_file match_file

Thanks,
R. Singh
Last edited by RavinderSingh13; 02-10-2016 at 09:55 AM.. Reason: Added one more solution on same now.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Search file for pattern and grab some lines before pattern

I want to search a file for a string and then if the string is found I need the line that the string is on - but also the previous two lines from the file (that the pattern will not be found in) This is on solaris Can you help? (2 Replies)
Discussion started by: frustrated1
2 Replies

2. Shell Programming and Scripting

shell script to remove all lines from a file before a line starting with pattern

hi,, i hav a file with many lines.i need to remove all lines before a line begginning with a specific pattern from the file because these lines are not required. Can u help me out with either a perl script or shell script example:- if file initially contains lines: a b c d .1.2 d e f... (2 Replies)
Discussion started by: raksha.s
2 Replies

3. Shell Programming and Scripting

Getting lines before and until next pattern in file /awk, sed

Hi, I need to get specific parts in a large file. I need to: Get a line containing an IP address, and read from there to another line saying ***SNMP-END*** So, I have the start and the end well defined, but the problem is that apparently the awk command using the -F option doesn't work... (17 Replies)
Discussion started by: ocramas
17 Replies

4. Shell Programming and Scripting

How to grab a block of data in a file with repeating pattern?

I need to send email to receipient in each block of data in a file which has the sender address under TO and just send that block of data where it ends as COMPANY. I tried to work this out by getting line numbers of the string HELLO but unable to grab the next block of data to send the next... (5 Replies)
Discussion started by: loggedout
5 Replies

5. UNIX for Dummies Questions & Answers

awk -remove pattern from file

I have a file like this - I want to remove the 2015 (or any four digit #) from column $4 so I can get: Nov 05 1997 /ifs/inventory2/ for example. Im not sure how. Should I use an if statement with awk? Jan 16 2015 23:45 /ifs/sql_file Jan 16 2015 23:45 /ifs/sql_file Nov 05 2015 1997... (4 Replies)
Discussion started by: newbie2010
4 Replies

6. Shell Programming and Scripting

awk to remove lines in file if specific field matches

I am trying to remove lines in the target.txt file if $5 before the - in that file matches sorted_list. I have tried grep and awk. Thank you :). grep grep -v -F -f targets.bed sort_list grep -vFf sort_list targets awk awk -F, ' > FILENAME == ARGV {to_remove=1; next} > ! ($5 in... (2 Replies)
Discussion started by: cmccabe
2 Replies

7. Shell Programming and Scripting

Using awk to remove lines from file that match text

I am trying to remove each line in which $2 is FP or RFP. I believe the below will remove one instance but not both. Thank you :). file 12 123 FP 11 10 RFP awk awk -F'\t' ' $2 != "FP"' file desired output 12 11 (6 Replies)
Discussion started by: cmccabe
6 Replies

8. UNIX for Beginners Questions & Answers

awk function to remove lines that contain contents of another file

Hi, I'd be grateful for your help with the following. I have a file (file.txt) with 10 columns and about half a million lines, which in simplified form looks like this: ID Col1 Col2 Col3.... a 4 2 8 b 5 6 1 c 8 4 1 d... (4 Replies)
Discussion started by: aberg
4 Replies

9. UNIX for Beginners Questions & Answers

awk to remove pattern and lines above pattern

In the awk below I am trying to remove all lines above and including the pattern Test or Test2. Each block is seperated by a newline and Test2 also appears in the lines to keep but it will always have additional text after it. The Test to remove will not. The awk executed until the || was added... (2 Replies)
Discussion started by: cmccabe
2 Replies

10. UNIX for Beginners Questions & Answers

awk with sed to combine lines and remove specific odd # pattern from line

In the awk piped to sed below I am trying to format file by removing the odd xxxx_digits and whitespace after, then move the even xxxx_digit to the line above it and add a space between them. There may be multiple lines in file but they are in the same format. The Filename_ID line is the last line... (4 Replies)
Discussion started by: cmccabe
4 Replies

LEARN ABOUT DEBIAN

graphics::primitive::component

Graphics::Primitive::Component(3pm)			User Contributed Perl Documentation		       Graphics::Primitive::Component(3pm)

NAME

       Graphics::Primitive::Component - Base graphical unit

DESCRIPTION

       A Component is an entity with a graphical representation.

SYNOPSIS

	 my $c = Graphics::Primitive::Component->new({
	   origin => Geometry::Primitive::Point->new({
	       x => $x, y => $y
	   }),
	   width => 500, height => 350
	 });

LIFECYCLE

       prepare
	   Most components do the majority of their setup in the prepare.  The goal of prepare is to establish it's minimum height and width so
	   that it can be properly positioned by a layout manager.

	     $driver->prepare($comp);

       layout
	   This is not a method of Component, but a phase introduced by the use of Layout::Manager.  If the component is a container then each of
	   it's child components (even the containers) will be positioned according to the minimum height and width determined during prepare.
	   Different layout manager implementations have different rules, so consult the documentation for each for details.  After this phase has
	   completed the origin, height and width should be set for all components.

	     $lm->do_layout($comp);

       finalize
	   This final phase provides and opportunity for the component to do any final changes to it's internals before being passed to a driver
	   for drawing.  An example might be a component that draws a fleuron at it's extremities.  Since the final height and width isn't known
	   until this phase, it was impossible for it to position these internal components until now.	It may even defer creation of this
	   components until now.

	   It is not ok to defer all action to the finalize phase.  If you do not establish a minimum hieght and width during prepare then the
	   layout manager may not provide you with enough space to draw.

	       $driver->finalize($comp);

       draw
	   Handled by Graphics::Primitive::Driver.

	      $driver->draw($comp);

METHODS

   Constructor
       new Creates a new Component.

   Instance Methods
       background_color
	   Set this component's background color.

       border
	   Set this component's border, which should be an instance of Border.

       callback
	   Optional callback that is fired at the beginning of the "finalize" phase.  This allows you to add some sort of custom code that can
	   modify the component just before it is rendered.  The only argument is the component itself.

	   Note that changing the position or the dimensions of the component will not re-layout the scene.  You may have weird results of you
	   manipulate the component's dimensions here.

       class
	   Set/Get this component's class, which is an abitrary string.  Graphics::Primitive has no internal use for this attribute but provides
	   it for outside use.

       color
	   Set this component's foreground color.

       fire_callback
	   Method to execute this component's "callback".

       get_tree
	   Get a tree for this component.  Since components are -- by definiton -- leaf nodes, this tree will only have the one member at it's
	   root.

       has_callback
	   Predicate that tells if this component has a "callback".

       height
	   Set this component's height.

       inside_bounding_box
	   Returns a Rectangle that defines the edges of the 'inside' box for this component.  This box is relative to the origin of the
	   component.

       inside_height
	   Get the height available in this container after taking away space for padding, margin and borders.

       inside_width
	   Get the width available in this container after taking away space for padding, margin and borders.

       margins
	   Set this component's margins, which should be an instance of Insets.  Margins are the space outside the component's bounding box, as in
	   CSS.  The margins should be outside the border.

       maximum_height
	   Set/Get this component's maximum height.  Used to inform a layout manager.

       maximum_width
	   Set/Get this component's maximum width.  Used to inform a layout manager.

       minimum_height
	   Set/Get this component's minimum height.  Used to inform a layout manager.

       minimum_inside_height
	   Get the minimum height available in this container after taking away space for padding, margin and borders.

       minimum_inside_width
	   Get the minimum width available in this container after taking away space for padding, margin and borders.

       minimum_width
	   Set/Get this component's minimum width.  Used to inform a layout manager.

       name
	   Set this component's name.  This is not required, but may inform consumers of a component.  Pay attention to that library's
	   documentation.

       origin
	   Set/Get the origin point for this component.

       outside_height
	   Get the height consumed by padding, margin and borders.

       outside_width
	   Get the width consumed by padding, margin and borders.

       finalize
	   Method provided to give component one last opportunity to put it's contents into the provided space.  Called after prepare.

       padding
	   Set this component's padding, which should be an instance of Insets.  Padding is the space inside the component's bounding box, as in
	   CSS.  This padding should be between the border and the component's content.

       page
	   If true then this component represents stand-alone page.  This informs the driver that this component (and any children) are to be
	   renderered on a single surface.  This only really makes sense in formats that have pages such as PDF of PostScript.

       prepare
	   Method to prepare this component for drawing.  This is an empty sub and is meant to be overridden by a specific implementation.

       preferred_height
	   Set/Get this component's preferred height.  Used to inform a layout manager.

       preferred_width
	   Set/Get this component's preferred width.  Used to inform a layout manager.

       to_string
	   Get a string representation of this component in the form of:

	     $name $x,$y ($widthx$height)

       visible
	   Set/Get this component's visible flag.

       width
	   Set/Get this component's width.

AUTHOR

       Cory Watson, "<gphat@cpan.org>"

BUGS

       Please report any bugs or feature requests to "bug-geometry-primitive at rt.cpan.org", or through the web interface at
       http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Geometry-Primitive <http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Geometry-Primitive>.  I
       will be notified, and then you'll automatically be notified of progress on your bug as I make changes.

COPYRIGHT &; LICENSE
       Copyright 2008-2009 by Cory G Watson.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

perl v5.12.3							    2011-06-02				       Graphics::Primitive::Component(3pm)
All times are GMT -4. The time now is 06:14 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy