Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Script to remove same content from other file
Top Forums Shell Programming and Scripting Script to remove same content from other file Post 302850917 by Mr_47 on Friday 6th of September 2013 03:55:35 AM
Old 09-06-2013
Script to remove same content from other file
Hi/ Hello all Guru here,

I am trying to create script to remove same content from other file, already tested few idea and found that in unix it is limited to sort and uniq. There is many script for removing duplicate content however to delete all same content is non. Need your help and guide . thx

so here the situation

1. a.out a file with content that we need to delete in other file
Code:
more a.out
a
b
c
d


2. b.out a file that

Code:
more b.out
a
a
a
b
b
c
d
d
e
f


3. the result should be like c.out file

Code:
more c.out
e
f


note: the data is around 1.5 million list.

---------- Post updated at 03:55 PM ---------- Previous update was at 03:53 PM ----------

tested and not working and most only to delete duplication and im lost

Code:
sed -e "s/Text_1/TextA/" -e "s/Text1/TextB/" <your_file.txt>your_file_new.txt

cat deleteme.txt deleteme.txt masterlist.txt | sort | uniq -u > newmasterlist.txt

diff file-a file-b --new-line-format="" --old-line-format="%L" --unchanged-line-format="" > file-a

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove content from file

hey all, I have a file with records in following format 8-29-2006 13:01:45|ABC|45 8-29-2006 14:23:12|DEF|21 8-30-2006 00:04:57|ABC|34 I want to remove all yesterday records. Can anyone show me how? Thanks! (10 Replies)
Discussion started by: mpang_
10 Replies

2. Shell Programming and Scripting

remove space from file content

i am a bit new to shell scripting i have a file containing xxxx xx xx but i want to output the content as xxxxxxxx. thus removing the space. any idea how i can do this (4 Replies)
Discussion started by: blackzinga
4 Replies

3. Shell Programming and Scripting

Remove specific content in a file

Hi, I have a file called fl_list consists of files i have to archive. I want to create a exception parm called except_parm, so if it finds the directory it will not archive these files and remove from fl_list. $ cat fl_list /apps/dev/ihub/ready/IA003B/IA003B_Deal_Header_yyyymmdd_hhmmss.txt... (1 Reply)
Discussion started by: k9cheung
1 Replies

4. Shell Programming and Scripting

Help with remove duplicate content and only keep the first content detail

Input data_10 SSA data_2 TYUE data_3 PEOCV data_6 SSAT data_21 SSA data_19 TYUEC data_14 TYUE data_15 SSA data_32 PEOCV . . Desired Output data_10 SSA data_2 TYUE data_3 PEOCV data_6 SSAT data_19 TYUEC (9 Replies)
Discussion started by: patrick87
9 Replies

5. Shell Programming and Scripting

Shell script to remove some content in a file

How can I remove all data that contain domain e.g zzgh@something.com, sdd@something.com.my and gg@something.my in one file? so that i only have data without the domain in the file. Here is the file structure "test.out" more test.out 1 zzztop@b.com 1 zzzulll 1 zzzullll@s.com.my ... (4 Replies)
Discussion started by: Mr_47
4 Replies

6. Shell Programming and Scripting

Remove the file content based on the Header of the file

Hi All, I want to remove the content based on the header information . Please find the example below. File1.txt Name|Last|First|Location|DepId|Depname|DepLoc naga|rr|tion|hyd|1|wer|opr Nava|ra|tin|gen|2|wera|opra I have to search for the DepId and remove the data from the... (5 Replies)
Discussion started by: i150371485
5 Replies

7. Shell Programming and Scripting

Remove some content from a verilog file

Hi, I have a verilog file which looks like module xyz (x, y, z, a, b, c); input x; input y; input z; output a; output b; output c; initial begin ... end always ... ... endmodule (7 Replies)
Discussion started by: matbrow
7 Replies

8. Shell Programming and Scripting

Shell script to monitor new file in a directory and mail the file content

Hi I am looking for a help in designing a bash script on linux which can do below:- 1) Look in a specific directory for any new files 2) Mail the content of the new file Appreciate any help Regards Neha (5 Replies)
Discussion started by: neha0785
5 Replies

9. Shell Programming and Scripting

Remove the duplicate content in a file

Here is the contents of test.txt Dependencies Resolved Changes in packages about to be updated: ChangeLog for: 1:perl-Archive-Extract-0.38-131.el6_4.x86_64, - Resolves: #915692 - CVE-2013-1667 (DoS in rehashing code) Dependencies Resolved Changes in packages about to be updated: ... (5 Replies)
Discussion started by: ashokvpp
5 Replies

10. Shell Programming and Scripting

How to remove exisiting file content from a file and have to append new file content?

hi all, i had the below script x=`cat input.txt |wc -1` awk 'NR>1 && NR<'$x' ' input.txt > output.txt by using above script i am able to remove the head and tail part from the input file and able to append the output to the output.txt but if i run it for second time the output is... (2 Replies)
Discussion started by: hemanthsaikumar
2 Replies

LEARN ABOUT DEBIAN

hotswaprc

HOTSWAPRC(5)							File Formats Manual						      HOTSWAPRC(5)

NAME

       hotswaprc - configuration file for  hotswap

DESCRIPTION

       /etc/hotswaprc is the global configuration file for the hotswap utility.

       It  allows system administrators to specify arbitrary shell scripts to be run after a device is inserted, as well as before and after it is
       removed. Scripts are selected according to the model name retrieved from the device. This is particularly helpful for automatic	configura-
       tion of CD-RW drives, which require SCSI emulation and bypass normal access via the IDE subsystem.

       hotswaprc  is  implemented  as  an  Extensible Mark-up Language (XML) application.  XML documents are structured using elements of the form
       <tag-name> content <tag-name>. A Document Type Definition (DTD) describes the possible content of each element.

       Please refer to the XML specification for more information. The hotswap distribution also contains an example file,  doc/hotswaprc.example,
       which includes the DTD for the configuration file format.

ELEMENTS

       <hotswap>
	      This is the root element of the document. Each valid hotswaprc must contain exactly one <hotswap> element. The <hotswap> element may
	      contain an arbitrary number of <device> elements.

       <device>
	      The configuration file contains one <device> element for every device for which scripts are defined. The <device>  element  is  com-
	      posed of the following elements in this order: <name>, <post-insert>, <pre-remove>, <post-remove>. All but <name> are optional.

       <name> The content of this element is the model identification string of the IDE device the current <device> element refers to.

       <post-insert>
	      Contains the shell script that is to be executed after the device has been inserted and registered with the kernel.

       <pre-remove>
	      Contains the shell script that is to be run before hotswap attempts to unregister the device.

       <post-remove>
	      Contains the shell script that is to be run after the device had been unregistered.

REPORT BUGS

       Report bugs to t.stadelmann1@physics.ox.ac.uk.

AUTHOR

       Written by Tim Stadelmann.

SEE ALSO

       hotswap(1), xhotswap(1).

COPYRIGHT

       Copyright (c) 2002-2003 Tim Stadelmann.

       Permission is granted to copy, distribute and/or modify this document under the terms of the GNU General Public License (GPL), Version 2 or
       any later version published by the Free Software Foundation.

								26th November 2002						      HOTSWAPRC(5)
All times are GMT -4. The time now is 05:17 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy