Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: ksh Loop through file one, remove lines from file two
Top Forums Shell Programming and Scripting ksh Loop through file one, remove lines from file two Post 302920923 by neutronscott on Monday 13th of October 2014 03:51:48 PM
Old 10-13-2014
You might be able to do this with just grep.

Code:
mute@thedoctor:~$ cat biglist.txt
foo
something
bar
else
mute@thedoctor:~$ cat smallerlist.txt
foo
bar
mute@thedoctor:~$ grep -F -v -f smallerlist.txt biglist.txt
something
else

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Loop through file and write out lines to file(s)

Hi, I am new to ksh scripting so your help will be much appreciated. I have a file called file.txt which looks like this Header 20050702 20050703 ABC DEF Header 20050703 20050704 123 456 Header 20050704 20050705 XXX YYY What I am trying to do is write out each of the record... (7 Replies)
Discussion started by: Jtrinh
7 Replies

2. Shell Programming and Scripting

Remove duplicate lines from first file comparing second file

Hi, I have two files with below data:: file1:- 123|aaa|ppp 445|fff|yyy 999|ttt|jjj 555|hhh|hhh file2:- 445|fff|yyy 555|hhh|hhh The records present in file1, not present in file 2 should be writtent to the out put file. output:- 123|aaa|ppp 999|ttt|jjj Is there any one line... (3 Replies)
Discussion started by: gani_85
3 Replies

3. Shell Programming and Scripting

How to remove blank lines in a file and save the file with same name?

I have a text file which has blank lines. I want them to be removed before upload it to DB using SQL *Loader. Below is the command line, i use to remove blank lines. sed '/^ *$/d' /loc/test.txt If i use the below command to replace the file after removing the blank lines, it replace the... (6 Replies)
Discussion started by: vel4ever
6 Replies

4. Shell Programming and Scripting

Remove lines from one file that exist in another file

Hello Everyone, I'm currently have a requirement where I've generated a list of files with specific attributes and I need to know what lines are similar between the two files. For example: -File 1- line1 line2 line3 -File 2- line1 line2 line4 line5 -Desires Output- line1 line2... (5 Replies)
Discussion started by: omnivir
5 Replies

5. Shell Programming and Scripting

ksh Remove and replace repeated in file

Hi, i need to read a line from a file and count the number of times it appear in, then continuous to the second line with the same. So when i count a line i have to remove all duplicates in the file to not count it another time. while read line do n=$(grep -c $line File) print "$line... (5 Replies)
Discussion started by: ToniX
5 Replies

6. Shell Programming and Scripting

Help with ksh-to read ip file & append lines to another file based on pattern match

Hi, I need help with this- input.txt : L B white X Y white A B brown M Y black Read this input file and if 3rd column is "white", then add specific lines to another file insert.txt. If 3rd column is brown, add different set of lines to insert.txt, and so on. For example, the given... (6 Replies)
Discussion started by: prashob123
6 Replies

7. Shell Programming and Scripting

Zip the file in a loop in ksh 88

Hi Team, Version : Ksh 88 The Requirement is to zip every file in a folder(which is in for loop) and move the zipped file to another folder I tried like the below , but didn't observe any change ( Infact more size ) after the file is zipped . #!/bin/ksh src_dir=/home/etc/Src_dat... (5 Replies)
Discussion started by: smile689
5 Replies

8. Shell Programming and Scripting

Using sed in a loop/to remove lines contained in variable from file

I've tried numerous commands, but I am not sure how to use sed in a loop. This is what I have: VARZ contains CARD_FILE_LIST and it also contains CARD_FILE_LIST2 so echo "$VARZ" CARD_FILE_LIST CARD_FILE_LIST2 I have a file with 60 lines in /tmp/testfile it and I want those lines deleted... (3 Replies)
Discussion started by: newbie2010
3 Replies

9. Shell Programming and Scripting

awk remove/grab lines from file with pattern from other file

Sorry for the weird title but i have the following problem. We have several files which have between 10000 and about 500000 lines in them. From these files we want to remove lines which contain a pattern which is located in another file (around 20000 lines, all EAN codes). We also want to get... (28 Replies)
Discussion started by: SDohmen
28 Replies

10. UNIX for Beginners Questions & Answers

Remove lines from File.A based on criteria in File.B

Hello, I have two files of the following form. I would like to remove from File.A where the first three colum matches values in File.B to give the output in File.C File.A 121 54321 PQR CAT 122 765431 ABC DOG 124 98765 ZXY TIGER 125 86432 GEF LION File.B 122 765431 ABC 125 86432 GEF... (4 Replies)
Discussion started by: Gussifinknottle
4 Replies

LEARN ABOUT SUSE

pdbtxt2html

pdbtxt2html(1)						      General Commands Manual						    pdbtxt2html(1)

NAME

       pdbtxt2html - Doc Text to HTML converter for Palm Pilots

SYNOPSIS

       pdbtxt2html [ -t ] file.txt [ file.html ]
       pdbtxt2html -v

DESCRIPTION

       pdbtxt2html converts text converted from a Doc(4) file via txt2pdbdoc(1) to HTML.  If no HTML filename is given, the generated HTML is sent
       to standard output.

   Document Title
       The first line of the file is used for the HTML document title.

   Bookmarks
       The last line of the file is examined and, if it contains a string enclosed between < and >, that is taken to be the bookmark marker.   The
       entire file is then scanned looking for lines beginning with it (ignoring leading whitespace).  These lines are converted to HTML headings.

       The  number  of whitespace characters after the first bookmark marker is used for heading level 1.  The level of subsequent headings is set
       to the number of whitespace characters between the bookmark marker and the bookmark text minus the number for the first bookmark plus one.

   Embedded URLs
       Valid URLs (according to RFC 1630) embedded in the text are turned into hyperlinks.  The ftp, gopher, http, https,  mailto,  news,  telnet,
       and wais URLs are recognized.

OPTIONS

       -t   Compile a table of contents and insert it between the first heading and the body.

       -v   Print the version number to standard output and exit.

EXAMPLE

       To convert a Doc file to HTML:

	    txt2pdbdoc alice.pdb alice.txt
	    pdbtxt2html alice.txt alice.html

SEE ALSO

       html2pdbtxt(1), txt2pdbdoc(1), doc(4), pdb(4)

       Tim Berners Lee.  Universal Resource Identifiers in WWW, Network Working Group of the Internet Engineering Task Force, June 1994.
	    http://info.internet.isi.edu/in-notes/rfc/files/rfc1630.txt

AUTHOR

       Paul J. Lucas <pauljlucas@mac.com>

txt2pdbdoc							 January 21, 2005						    pdbtxt2html(1)
All times are GMT -4. The time now is 06:09 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy