Shell Programming and Scripting

Could it be possible to find common lines between all of the files in one folder? Just like comm -12 . So all of the files two at a time. I would like all of the outcomes to be written to a different files, and the file names could be simply numbers - 1 , 2 , 3 etc. All of the file names contain dash signs, usually they have between one and six dash signs, I hope it won't disturb? The folder has a 100 files or more , sometimes I have to work even with 200 files.
Sincerely grateful if anyone can help!

Of course it is possible... Why don't you start with some of the suggestions in your first thread in this forum Find common lines with one file and with all of the files in another folder and build on top of that to do what you're requesting here.

Please, when starting a thread in this forum, always tell us what operating system and shell you're using so we don't waste our time making suggestions that won't work in your environment. And, tell us whether or not our suggestions work for you (and if not) tell us clearly what worked and what didn't.

If you keep on just making requests and don't do any of the work yourself, it'll get really boring for us to waste time trying to help you and you won't learn anything from our efforts. We want to help you learn how to do things like the on your own; not to act as your unpaid programming staff.

Pretty sure, yes. More details would help, as always. How would you approach the problem, given the proposals in your other thread , adapted to the new problem?

What have you tried so far?

And please give us examples of the filenames.

The way you worded it, we can find only duplicates in two files. Once we move to the next two we would find a possibly distinct set of new duplicate lines.

If you actually want a set of lines that are duplicated anywhere the logic look like this

Code:

awk '{arr[0]++ }  END {for(i in arr) { if(arr[i]>1) {print i } } \
           find . -type f -name 'filenames_I_want*'  > my_duplicated_lines

EDIT: oops we all answered at the same time....

We need lots of clarification to help....

I'm really sorry for the inconvenience caused...
This thread is my last question to you, if I can get it working I won't bother you again.
I'm using Windows 7 and Unix subsystems for Windows. I'm using C Shell.

And the filename examples are:

Code:

AC-FOUR-136-ZEL2-ZECO-111
AC-SEVEN-56-ZEL4-ZECO-68
AC-NINE-994-ZEL3-ZECO-811
AC-ONE-4-ZEL1-ZECO-544
AC-NINE-4-53-ZEL3-ZECO-811
AC-ELEVEN-66-788-ZEL4-ZECO-87
AC-TWO-32-7788-ZEL4-ZECO-95
AC-SIX-56-111-ZEL4-ZECO-87
AC-FOURTEEN-59-1561-ZEL2-ZECO-5

In case of this solution I got an error - Unmatched '
I noticed that there is also an unequal number of these signs { } could it be a problem?

Code:

awk '{arr[0]++ }  END {for(i in arr) { if(arr[i]>1) {print i } } \
           find . -type f -name 'filenames_I_want*'  > my_duplicated_lines

---------- Post updated at 05:46 PM ---------- Previous update was at 05:38 PM ----------

I forgot to mention that all of the files are sorted

Edited code - please see correction above.

What do you want to compare?
File names or file contents?