Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk remove/grab lines from file with pattern from other file
Top Forums Shell Programming and Scripting awk remove/grab lines from file with pattern from other file Post 302966263 by SDohmen on Wednesday 10th of February 2016 08:29:27 AM
Old 02-10-2016
Quote:
Originally Posted by RavinderSingh13
Hello SDohmen,

You could redirect the output to a Output_file as follows then.
Code:
awk 'FNR==NR{A[$1]=$1;next} ($1 in A){print}' pattern_file FS=";" main_file  >  Output_file

Thanks,
R. Singh
I know i can redirect the output but it still did not remove the lines from the main file. Sorry if that was unclear before.


Omg you are fast with editing Smilie. I tested the revised code and it seems to work fine. I now have 2 files with different output in each. I will test it some more with other files to be sure but it seems to work. Thank you again for the extremly fast helping.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Search file for pattern and grab some lines before pattern

I want to search a file for a string and then if the string is found I need the line that the string is on - but also the previous two lines from the file (that the pattern will not be found in) This is on solaris Can you help? (2 Replies)
Discussion started by: frustrated1
2 Replies

2. Shell Programming and Scripting

shell script to remove all lines from a file before a line starting with pattern

hi,, i hav a file with many lines.i need to remove all lines before a line begginning with a specific pattern from the file because these lines are not required. Can u help me out with either a perl script or shell script example:- if file initially contains lines: a b c d .1.2 d e f... (2 Replies)
Discussion started by: raksha.s
2 Replies

3. Shell Programming and Scripting

Getting lines before and until next pattern in file /awk, sed

Hi, I need to get specific parts in a large file. I need to: Get a line containing an IP address, and read from there to another line saying ***SNMP-END*** So, I have the start and the end well defined, but the problem is that apparently the awk command using the -F option doesn't work... (17 Replies)
Discussion started by: ocramas
17 Replies

4. Shell Programming and Scripting

How to grab a block of data in a file with repeating pattern?

I need to send email to receipient in each block of data in a file which has the sender address under TO and just send that block of data where it ends as COMPANY. I tried to work this out by getting line numbers of the string HELLO but unable to grab the next block of data to send the next... (5 Replies)
Discussion started by: loggedout
5 Replies

5. UNIX for Dummies Questions & Answers

awk -remove pattern from file

I have a file like this - I want to remove the 2015 (or any four digit #) from column $4 so I can get: Nov 05 1997 /ifs/inventory2/ for example. Im not sure how. Should I use an if statement with awk? Jan 16 2015 23:45 /ifs/sql_file Jan 16 2015 23:45 /ifs/sql_file Nov 05 2015 1997... (4 Replies)
Discussion started by: newbie2010
4 Replies

6. Shell Programming and Scripting

awk to remove lines in file if specific field matches

I am trying to remove lines in the target.txt file if $5 before the - in that file matches sorted_list. I have tried grep and awk. Thank you :). grep grep -v -F -f targets.bed sort_list grep -vFf sort_list targets awk awk -F, ' > FILENAME == ARGV {to_remove=1; next} > ! ($5 in... (2 Replies)
Discussion started by: cmccabe
2 Replies

7. Shell Programming and Scripting

Using awk to remove lines from file that match text

I am trying to remove each line in which $2 is FP or RFP. I believe the below will remove one instance but not both. Thank you :). file 12 123 FP 11 10 RFP awk awk -F'\t' ' $2 != "FP"' file desired output 12 11 (6 Replies)
Discussion started by: cmccabe
6 Replies

8. UNIX for Beginners Questions & Answers

awk function to remove lines that contain contents of another file

Hi, I'd be grateful for your help with the following. I have a file (file.txt) with 10 columns and about half a million lines, which in simplified form looks like this: ID Col1 Col2 Col3.... a 4 2 8 b 5 6 1 c 8 4 1 d... (4 Replies)
Discussion started by: aberg
4 Replies

9. UNIX for Beginners Questions & Answers

awk to remove pattern and lines above pattern

In the awk below I am trying to remove all lines above and including the pattern Test or Test2. Each block is seperated by a newline and Test2 also appears in the lines to keep but it will always have additional text after it. The Test to remove will not. The awk executed until the || was added... (2 Replies)
Discussion started by: cmccabe
2 Replies

10. UNIX for Beginners Questions & Answers

awk with sed to combine lines and remove specific odd # pattern from line

In the awk piped to sed below I am trying to format file by removing the odd xxxx_digits and whitespace after, then move the even xxxx_digit to the line above it and add a space between them. There may be multiple lines in file but they are in the same format. The Filename_ID line is the last line... (4 Replies)
Discussion started by: cmccabe
4 Replies

LEARN ABOUT DEBIAN

test::regression

Test::Regression(3pm)					User Contributed Perl Documentation				     Test::Regression(3pm)

NAME

       Test::Regression - Test library that can be run in two modes; one to generate outputs and a second to compare against them

VERSION

       Version 0.05

SYNOPSIS

	 use Test::Regression;
	 ok_regression(sub {return "hello world"}, "t/out/hello_world.txt");

DESCRIPTION

       Using the various Test:: modules you can compare the output of a function against what you expect.  However if the output is complex and
       changes from version to version, maintenance of the expected output could be costly. This module allows one to use the test code to
       generate the expected output, so that if the differences with model output are expected, one can easily refresh the model output.

EXPORT

       ok_regression

FUNCTIONS

   ok_regression
       This function requires two arguments: a CODE ref and a file path.  The CODE ref is expected to return a SCALAR string which can be compared
       against previous runs.  If the TEST_REGRESSION_GEN is set to a true value, then the CODE ref is run and the output written to the file.
       Otherwise the output of the file is compared against the contents of the file.  There is a third optional argument which is the test name.

ENVIRONMENT VARIABLES

   TEST_REGRESSION_GEN
       If the TEST_REGRESSION_GEN environment file is unset or false in a perl sense, then the named output files must exist and be readable and
       the test will run normally comparing the outputs of the CODE refs against the contents of those files. If the environment variable is true
       in a perl sense, then model output files will be overwritten with the output of the CODE ref.

AUTHOR

       Nicholas Bamber, "<nicholas at periapt.co.uk>"

BUGS

       Please report any bugs or feature requests to "bug-test-regression at rt.cpan.org", or through the web interface at
       <http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Test-Regression>.  I will be notified, and then you'll automatically be notified of
       progress on your bug as I make changes.

   testing of STDERR
       The testing of stderr from this module is not as thorough as I would like. Test::Builder::Tester allows turning off of stderr checking but
       not matching by regular expression. Handcrafted efforts currently fall foul of Test::Harness.  Still it is I believe adequately tested in
       terms of coverage.

SUPPORT

       You can find documentation for this module with the perldoc command.

	   perldoc Test::Regression

       You can also look for information at:

       o   RT: CPAN's request tracker

	   <http://rt.cpan.org/NoAuth/Bugs.html?Dist=Test-Regression>

       o   AnnoCPAN: Annotated CPAN documentation

	   <http://annocpan.org/dist/Test-Regression>

       o   CPAN Ratings

	   <http://cpanratings.perl.org/d/Test-Regression>

       o   Search CPAN

	   <http://search.cpan.org/dist/Test-Regression/>

ACKNOWLEDGEMENTS

       Some documentation improvements have been suggested by toolic (http://perlmonks.org/?node_id=622051).
       Thanks to Filip GraliXski for pointing out I need to test against output of zero length and providing a patch.

COPYRIGHT &; LICENSE
       Copyright 2009-10 Nicholas Bamber.

       This program is free software; you can redistribute it and/or modify it under the terms of either: the GNU General Public License as
       published by the Free Software Foundation; or the Artistic License.

       See http://dev.perl.org/licenses/ for more information.

perl v5.10.1							    2010-08-29						     Test::Regression(3pm)
All times are GMT -4. The time now is 06:58 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy