Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Compare Only "File Names" in 2 Files with file lists having different directory structure
Top Forums Shell Programming and Scripting Compare Only "File Names" in 2 Files with file lists having different directory structure Post 302988643 by Don Cragun on Friday 30th of December 2016 07:04:08 AM
Old 12-30-2016
Quote:
Originally Posted by sumang24
I am on Bash.

I am not a unix expert, can you please give me the code to print the final result with difference in both the list files assuming the first file name is all-xml-file-list.lst and combinted batch file with list is "batch-file-list.lst". Please note the *.lst files do have file names with directory structure in them.

Thanks

---------- Post updated at 05:15 AM ---------- Previous update was at 04:58 AM ----------

Please ignore my previous update. I was able to pull only the file names using your AWK script. Now I am using the compare using grep -f -v option.

Thanks

---------- Post updated at 05:22 AM ---------- Previous update was at 05:15 AM ----------

grep -v -f batch-file-list batch-file-list.lst > /tmp/difference.lst

Am I using the correct command to print the difference in /tmp/difference.lst? It's been running for a while
I am completely at a loss from your above statements. In your first post in this thread you said you had two files (one that you referred to as arch_all and one that you said "Combined file with files from batch1 batch2 batch3 and batch4" which my script assumed was named combined). If you had given the names of those two files (in that order) as the names of the files on the last line of the script I provided, the output would have been the output you requested! I.e., the names of the files in 1st input file (after discarding the directories in which those files were located) that were not found in the 2nd input file (after discarding the directories in which those files were located). So, what are you now trying to do with grep -v -f that wasn't already done by the code I provided???
These 2 Users Gave Thanks to Don Cragun For This Post:
jim mcnamara sumang24
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

File names that contain "01" act hidden

Haveing an issue. Anytime a file is created with "01" (zero one) in the name - it cannot be viewed by LS or any other file listing command. Although the file is there, it cannot be seen. I can edit it, run it, anything, except see it..... What happened? Any ideas? (8 Replies)
Discussion started by: n9ninchd
8 Replies

2. UNIX for Dummies Questions & Answers

total number of files which have "aaa" in files whose names are File*_bbb*

I am getting the list of all the files which have "aaa" from files whose name is File*_bbb*. grep -l "aaa" File*_bbb* But I want to count the number of files. That is I want the total number of files which have "aaa" in files File*_bbb* If I run the following for getting number of... (1 Reply)
Discussion started by: sudheshnaiyer
1 Replies

3. Shell Programming and Scripting

"sed" to check file size & echo " " to destination file

Hi, I've modified the syslogd source to include a thread that will keep track of a timer(or a timer thread). My intention is to check the file size of /var/log/messages in every one minute & if the size is more than 128KB, do a echo " " > /var/log/messages, so that the file size will be set... (7 Replies)
Discussion started by: jockey007
7 Replies

4. Shell Programming and Scripting

Delete files older than "x" if directory size is greater than "y"

I wrote a script to delete files which are older than "x" days, if the size of the directory is greater than "y" #!/bin/bash du -hs $1 while read SIZE ENTRY do if ; then find $1 -mtime +$2 -exec rm -f {} \; echo "Files older than $2 days deleted" else echo "free Space available"... (4 Replies)
Discussion started by: JamesCarter
4 Replies

5. Shell Programming and Scripting

Compare file names and select correct elements to include in "for each loop"

Hi everyone, I`ll try to be most clear I can explaining my help request. I have 2 folders Folder A-->This folder receives files through FTP constantly Folder B-->The files from Folder A are unzipped and then processed in Folder B Sometimes Folder A doesn`t contain all... (2 Replies)
Discussion started by: cgkmal
2 Replies

6. Shell Programming and Scripting

awk command to replace ";" with "|" and ""|" at diferent places in line of file

Hi, I have line in input file as below: 3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL My expected output for line in the file must be : "1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL" Can someone... (7 Replies)
Discussion started by: shis100
7 Replies

7. Shell Programming and Scripting

The "read" command misinterprets file names containing spaces

The "read" command, which is built into bash, takes words from the standard input. However, "read" is not good at taking file names if the file names contain spaces. I would like my bash script to ask the user to enter file names, which may contain spaces. Can you think about any technique for... (14 Replies)
Discussion started by: LessNux
14 Replies

8. UNIX for Dummies Questions & Answers

Using "mailx" command to read "to" and "cc" email addreses from input file

How to use "mailx" command to do e-mail reading the input file containing email address, where column 1 has name and column 2 containing “To” e-mail address and column 3 contains “cc” e-mail address to include with same email. Sample input file, email.txt Below is an sample code where... (2 Replies)
Discussion started by: asjaiswal
2 Replies

9. Shell Programming and Scripting

Bash script - Print an ascii file using specific font "Latin Modern Mono 12" "regular" "9"

Hello. System : opensuse leap 42.3 I have a bash script that build a text file. I would like the last command doing : print_cmd -o page-left=43 -o page-right=22 -o page-top=28 -o page-bottom=43 -o font=LatinModernMono12:regular:9 some_file.txt where : print_cmd ::= some printing... (1 Reply)
Discussion started by: jcdole
1 Replies

10. AIX

Apache 2.4 directory cannot display "Last modified" "Size" "Description"

Hi 2 all, i have had AIX 7.2 :/# /usr/IBMAHS/bin/apachectl -v Server version: Apache/2.4.12 (Unix) Server built: May 25 2015 04:58:27 :/#:/# /usr/IBMAHS/bin/apachectl -M Loaded Modules: core_module (static) so_module (static) http_module (static) mpm_worker_module (static) ... (3 Replies)
Discussion started by: penchev
3 Replies

LEARN ABOUT DEBIAN

ibdmchk

IBDMCHK(1)						       IB DATA MODEL PACKAGE							IBDMCHK(1)

NAME

       IBDM - Network Checker and Attributes Analyzer

SYNOPSYS

       ibdmchk has two operation modes: design and verification.

       DESIGN:

       ibdmchk [-v][-h][-u][-a <roots file>] -t <topology file> -n <SM Node>
	 -p <SM Port> [-e] [-l <lmc>]

       VERIFICATION:

       ibdmchk [-v][-h][-r <roots file>] [-s <subnet file>] [-f <fdb file>]
	 [-l <lmc>]

DESIGN MODE DESCRIPTION

       The Design mode is intended to be used before the cluster is built. It provides basic checks of the specified network as described by a
       topology file. After simulating the SM LID assignment and routing algorithms it provides reports of the (H)CA to (H)CA paths depth his-
       togram and credit deadlock potential in the resulting routing scheme.

ARGUMENTS
:
       -t|--topo <topo file>
	      The topology file specifying the network. See man ibdm-topology-file

       -n|--node <SM Node>
	      The name of the Subnet Manager node (syntax: <Topo-File-System>/U1)

       -p|--port <SM Port>
	      The port number by which the SM nodes is attached to the fabric.

OPTIONS

       -v|--verbose
	      Verbsoe mode

       -h|--help
	      Provides this help message

       -l|--lmc <lmc>
	      LMC value > 0 means assigning 2^lmc lids to each port.

       -e|--enh
	      Use enhanced routing algorithm when LMC > 0 and report the resulting paths correlation (using same system/node) histogram

       -u|--updn
	      Use up/down routing algorithm instead of OpenSM min-hop.

       -r|--roots <roots file> A file with all the roots node names (one on each line).

VERIFICATION MODE DESCRIPTION

       After the cluster is built and OpenSM is run (using flag -D 0x43) it reports the subnet and FDB tables into the files osm-subnet.lst,
       osm.fdbs and osm.fdbs in /var/log/ (or subnet.lst, osm.fdbs and osm.mcfdbs into /tmp in older OpenSM versions).	Based on these files the
       utility checks all CA to CA connectivity. Further analysis for credit deadlock potential is performed and reported.  In case of an LMC > 0
       it reports histograms for how many systems and nodes are common between the different paths for the same port pairs.

ARGUMENTS

       -l|--lmc <lmc>
	      The LMC value used while running OpenSM. Mandatory if not the default 0.

OPTIONS

       -v|--verbose
	      Verbsoe mode

       -h|--help
	      Provides this help message

       -s|--subnet <file>
	      OpenSM subnet.lst file (default is /var/log/osm-subnet.lst or /tmp/subnet.lst)

       -f|--fdb <file>
	      OpenSM dump of Ucast LFDB. Use -D 0x41 to generate it (default is /var/log/osm.fdbs or /tmp/osm.fdbs).

       -m|--mcfdb <file>
	      OpenSM dump of Multicast LFDB. Use -D 0x41 to generate it (default is /var/log/osm.mcfdbs or /tmp/osm.mcfdbs).

       -r|--roots <roots file>
	      A file holding all root nodes guids (one per line).

AUTHOR

       Eitan Zahavi, Mellanox Technologies LTD, eitan@mellanox.co.il

IBDM 1.0							    2008-06-16								IBDMCHK(1)
All times are GMT -4. The time now is 01:12 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy