Shell Script to Create non-duplicate lists from two lists Post: 302410381

Sponsored Content

Top Forums Shell Programming and Scripting Shell Script to Create non-duplicate lists from two lists Post 302410381 by mlv_99 on Monday 5th of April 2010 09:05:26 PM

04-05-2010

Registered User

Shell Script: Compare 2 Files and Extract Unique Elements of Each File into 2 New Files

Thanks for the reply danmero. I made a mistake in the description. Let me re-phrase the question again.

File_A contains Strings and content's elements are NOT IN ANY ORDER OR PATTERN AND file varies in size from one run to the next run:
a <- in both File_A and File_B
b <- unique to File_A
c <- in both File_A and File_B
d <- unique to File_A

File_B contains Strings and content's elements are NOT IN ANY ORDER OR PATTERN AND file varies in size from one run to the next run:
a <- in both File_A and File_B
c <- in both File_A and File_B
z <- unique to File_B

Need to have script written in either sh or ksh. Resultant files (File_New_A and File_New_B) is derived from comparing contents of files File_A and File_B where resultant string elements in File_New_A and File_New_B are listed below. Resultant File_New_A will contain only unique elements found only in File_A when compared with File_B. File_New_B will contain only unique elements found in only File_B when compared with File_A.

Resultant files:
File_New_A contains String:
b <- unique to File_A
d <- unique to File_A

File_New_B contains String:
z <- unique to File_B

++++++++++++++++++++++++++++++++++++++

The next run could have

File_A contains Strings and content's elements are NOT IN ANY ORDER OR PATTERN AND file varies in size from one run to the next run:
m <- only in File_A
n <- only in File_A
o <- only in File_A
p <- only in File_A
q <- in both File_A and File_B
r <- in both File_A and File_B

File_B contains Strings and content's elements are NOT IN ANY ORDER OR PATTERN AND file varies in size from one run to the next run:
q <- in both File_A and File_B
r <- in both File_A and File_B

Resultant files after comparing File_A and File_B:

Resultant files:
File_New_A contains String:
m <- unique to File_A
n <- unique to File_A
o <- unique to File_A
p <- unique to File_A

File_New_B contains String:

No elements in File_New_B since File_B have no unique elements to File_B, all files in File_B are also in File_A; therefore File_New_B is empty.

I hope this is more clearer.

Thank you.

Matt

mlv_99

View Public Profile for mlv_99

Find all posts by mlv_99

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Check lists for Unix Shell Programming

Hi all, Can anyone provide me any checklists or a list of steps I should follow before executing my scripts. Could also tell me if there are any other standards to be followed while shell programming like naming conventions for variables etc. Your help would be much appreciated. Regards,...

2. Shell Programming and Scripting

Help with a shell script to concatenate lists together

Below is a description of what im trying to achieve: Write a shell script to concatenate lists together, and output the resulting list. Do not include any argument that is a sub-list of the entire list. (The script will clean the list of any redundant items.) You must preserve the original order...

3. Shell Programming and Scripting

Editing lists of integers in 1d files with bash shell

Hi, I need a script that will: 1. Go through about 20 different folders, each containing about 20 1d files. The 1d files go something like this: 22.253 37.707 78.117 112.374 127.944 156.067 180.956 233.785 249.256 ...

4. Shell Programming and Scripting

C shell: Working with lists

Hello Unix Gurus, I have: A list of parameters that repeat (in .txt file) Example: params.txt Series: XYZ Manufacturer: ... Software Version: ... Year made: ... Series Series: XYZ Manufacturer: ... Software Version: ... Year made: ... Series Series: ABC Manufacturer: ... ...

5. Shell Programming and Scripting

Bash script to compare two lists

Hi, I do little bash scripting so sorry for my ignorance. How do I compare if the two variable not match and if they do not match run a command. I was thinking a for loop but then I need another for loop for the 2nd list and I do not think that would work as in the real world there could...

6. Shell Programming and Scripting

Shell script that lists files with different owner than the folder

Hello, I'm trying to write a script which is listing files based on different preferences, like filetype or permissions. All is fine, except for one: I want to list files in /home which has a different owner than the home directory it is in. Here is an example: /home/UserA is the directory, and...

7. Shell Programming and Scripting

get the lists

I expert, I may cross post something similar but I dirtyed my quesion somehow to be clear in the thread #cat file1 88dee gcc: Grok for callconvention-hard to enable hard float a2ad2 eglibc: package mtrace separately 61487 python: bump PR of packages after update of distutils.bbclass...

8. Shell Programming and Scripting

Removing duplicate entries from edge-lists

I have a file which has connections given as: A B 0.1 B C 5.8 C B 5.8 E F 0.67 B A 0.1 A B and B A are same, so I want to remove one of them. Same with BC and CB. Desired output: A B 0.1 B C 5.8 E F 0.67

9. Shell Programming and Scripting

� Write a shell script that upon invocation shows the time and date and lists all the logged-in user

help me

10. UNIX for Beginners Questions & Answers

How to get script to create a new file that lists folder content sorted by size?

I have a script that sorts and processes unsorted files to newly created directories. Its working great, but I am trying to understand the leanest method to get the script to create an additional file within each newly created directory that: Contains a list of all files in the directory...

LEARN ABOUT OSX

ecppl

ecppl(1)							Tntnet users guide							  ecppl(1)

NAME

       ecppl - language-extractor for ecpp

SYNOPSIS

       ecppl [-I dir] [-ln] [-o output-filename] ecpp-filename

DESCRIPTION

       Ecppl  is  the  language-extractor  for ecpp.  Ecpp - the template-language used with tntnet - supports internationalized applications.	In
       ecpp-templates a tag <i18n> changes the meaning of curly braces.  A phrase, which is enclosed in curly braces, can be translated.  At  run-
       time the phrase is looked up in a language-library.  This mode can be quit with the tag </i18n>.  Phrases must not have newlines or tabs.

       Every  phrase,  which  is  marked as translatable, is extracted with ecppl and written to standard output or to a specified output-filename
       line by line.

OPTIONS

       -I dir Search include-files in directory.  This option can be passed multiple times.  All specified directories are searched  in  turn  for
	      include-files.

       -l     Extract language-phrases (the default)

       -n     Extract non-language-phrases

       -o filename
	      Specify output filename

AUTHOR

       This manual page was written by Tommi Makitalo <tommi@tntnet.org>.

SEE ALSO

       tntnet(1), ecpp(7), ecppll(1).

Tntnet								    2006-08-26								  ecppl(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Check lists for Unix Shell Programming

Discussion started by: srikanth_ksv

2. Shell Programming and Scripting

Help with a shell script to concatenate lists together

Discussion started by: rfourn

3. Shell Programming and Scripting

Editing lists of integers in 1d files with bash shell

Discussion started by: ac130pilot

4. Shell Programming and Scripting

C shell: Working with lists

Discussion started by: lapiduslost