12-30-2016
Quote:
Originally Posted by
sumang24
I am on Bash.
I am not a unix expert, can you please give me the code to print the final result with difference in both the list files assuming the first file name is all-xml-file-list.lst and combinted batch file with list is "batch-file-list.lst". Please note the *.lst files do have file names with directory structure in them.
Thanks
---------- Post updated at 05:15 AM ---------- Previous update was at 04:58 AM ----------
Please ignore my previous update. I was able to pull only the file names using your AWK script. Now I am using the compare using grep -f -v option.
Thanks
---------- Post updated at 05:22 AM ---------- Previous update was at 05:15 AM ----------
grep -v -f batch-file-list batch-file-list.lst > /tmp/difference.lst
Am I using the correct command to print the difference in /tmp/difference.lst? It's been running for a while
I am completely at a loss from your above statements. In your first post in this thread you said you had two files (one that you referred to as
arch_all and one that you said "
Combined file with files from batch1 batch2 batch3 and batch4" which my script assumed was named
combined). If you had given the names of those two files (in that order) as the names of the files on the last line of the script I provided, the output would have been the output you requested! I.e., the names of the files in 1st input file (after discarding the directories in which those files were located) that were not found in the 2nd input file (after discarding the directories in which those files were located). So, what are you now trying to do with
grep -v -f that wasn't already done by the code I provided???
These 2 Users Gave Thanks to Don Cragun For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Haveing an issue. Anytime a file is created with "01" (zero one) in the name - it cannot be viewed by LS or any other file listing command. Although the file is there, it cannot be seen. I can edit it, run it, anything, except see it.....
What happened? Any ideas? (8 Replies)
Discussion started by: n9ninchd
8 Replies
2. UNIX for Dummies Questions & Answers
I am getting the list of all the files which have "aaa" from files whose name is File*_bbb*.
grep -l "aaa" File*_bbb*
But I want to count the number of files. That is I want the total number of files which have "aaa" in
files File*_bbb*
If I run the following for getting number of... (1 Reply)
Discussion started by: sudheshnaiyer
1 Replies
3. Shell Programming and Scripting
Hi,
I've modified the syslogd source to include a thread that will keep track of a timer(or a timer thread). My intention is to check the file size of /var/log/messages in every one minute & if the size is more than 128KB, do a echo " " > /var/log/messages, so that the file size will be set... (7 Replies)
Discussion started by: jockey007
7 Replies
4. Shell Programming and Scripting
I wrote a script to delete files which are older than "x" days, if the size of the directory is greater than "y"
#!/bin/bash
du -hs $1
while read SIZE ENTRY
do
if ;
then
find $1 -mtime +$2 -exec rm -f {} \;
echo "Files older than $2 days deleted"
else
echo "free Space available"... (4 Replies)
Discussion started by: JamesCarter
4 Replies
5. Shell Programming and Scripting
Hi everyone,
I`ll try to be most clear I can explaining my help request.
I have 2 folders
Folder A-->This folder receives files through FTP constantly
Folder B-->The files from Folder A are unzipped and then processed in Folder B
Sometimes Folder A doesn`t contain all... (2 Replies)
Discussion started by: cgkmal
2 Replies
6. Shell Programming and Scripting
Hi,
I have line in input file as below:
3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL
My expected output for line in the file must be :
"1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL"
Can someone... (7 Replies)
Discussion started by: shis100
7 Replies
7. Shell Programming and Scripting
The "read" command, which is built into bash, takes words from the standard input. However, "read" is not good at taking file names if the file names contain spaces. I would like my bash script to ask the user to enter file names, which may contain spaces. Can you think about any technique for... (14 Replies)
Discussion started by: LessNux
14 Replies
8. UNIX for Dummies Questions & Answers
How to use "mailx" command to do e-mail reading the input file containing email address, where column 1 has name and column 2 containing “To” e-mail address
and column 3 contains “cc” e-mail address to include with same email.
Sample input file, email.txt
Below is an sample code where... (2 Replies)
Discussion started by: asjaiswal
2 Replies
9. Shell Programming and Scripting
Hello.
System : opensuse leap 42.3
I have a bash script that build a text file.
I would like the last command doing :
print_cmd -o page-left=43 -o page-right=22 -o page-top=28 -o page-bottom=43 -o font=LatinModernMono12:regular:9 some_file.txt
where :
print_cmd ::= some printing... (1 Reply)
Discussion started by: jcdole
1 Replies
10. AIX
Hi 2 all,
i have had AIX 7.2
:/# /usr/IBMAHS/bin/apachectl -v
Server version: Apache/2.4.12 (Unix)
Server built: May 25 2015 04:58:27
:/#:/# /usr/IBMAHS/bin/apachectl -M
Loaded Modules:
core_module (static)
so_module (static)
http_module (static)
mpm_worker_module (static)
... (3 Replies)
Discussion started by: penchev
3 Replies
LEARN ABOUT DEBIAN
genbackupdata
GENBACKUPDATA(1) General Commands Manual GENBACKUPDATA(1)
NAME
genbackupdata - generate backup test data
SYNOPSIS
genbackupdata [--chunk-size=SIZE] [--config=FILE] [-c=SIZE] [--create=SIZE] [--depth=DEPTH] [--dump-config] [--dump-setting-names]
[--file-size=SIZE] [--generate-manpage=TEMPLATE] [-h] [--help] [--list-config-files] [--log=FILE] [--log-keep=N] [--log-level=LEVEL]
[--log-max=SIZE] [--max-files=MAX-FILES] [--no-default-configs] [--output=FILE] [--quiet] [--seed=SEED] [--version]
DESCRIPTION
genbackupdata generates test data sets for performance testing of backup software. It creates a directory tree filled with files of dif-
ferent sizes. The total size and the distribution of sizes between small and big are configurable. The program can also modify an exist-
ing directory tree by creating new files, and deleting, renaming, or modifying existing files. This can be used to generate test data for
successive generations of backups.
The program is deterministic: with a given set of parameters (and a given pre-existing directory tree), it always creates the same output.
This way, it is possible to reproduce backup tests exactly, without having to distribute the potentially very large test sets.
The data set consists of plain files and directories. Files are either small text files or big binary files. Text files contain the
"lorem ipsum" stanza, binary files contain randomly generated byte streams. The percentage of file data that is small text or big binary
files can be set, as can the sizes of the respective file types.
Files and directories are named "fileXXXX" or "dirXXXX", where "XXXX" is a successive integer, separate successions for files and directo-
ries. There is an upper limit to how many files a directory may contain. After the file limit is reached, a new sub-directory is created.
The first set of files go into the root directory of the test set.
You have to give one of the options --create, --delete, --rename, or --modify for the program to do anything. You can, however, give more
than one of them, if DIR already exists. (Giving the same option more than once means that only the last instance is counted.) (DIR) is
created if it doesn't exist already.
OPTIONS
--chunk-size=SIZE
generate data in chunks of this size (default: 16384)
--config=FILE
add FILE to config files
-c, --create=SIZE
how much data to create (default: 0)
--depth=DEPTH
depth of directory tree (default: 3)
--dump-config
write out the entire current configuration
--dump-setting-names
write out all names of settings and quit
--file-size=SIZE
size of one file (default: 16384)
--generate-manpage=TEMPLATE
fill in manual page TEMPLATE
-h, --help
show this help message and exit
--list-config-files
list all possible config files
--log=FILE
write log entries to FILE
--log-keep=N
keep last N logs (10)
--log-level=LEVEL
log at LEVEL, one of debug, info, warning, error, critical, fatal (default: debug)
--log-max=SIZE
rotate logs larger than SIZE, zero for never (default: 0)
--max-files=MAX-FILES
max files/dirs per dir (default: 128)
--no-default-configs
clear list of configuration files to read
--output=FILE
write output to FILE, instead of standard output
--quiet
do not report progress
--seed=SEED
seed for random number generator (default: 0)
--version
show program's version number and exit
EXAMPLES
Create data for the first generation of a backup:
genbackupdata --create=10G testdir
Modify an existing set of backup data to create a new generation:
genbackupdata -c 5% -d 2% -m 5% -r 0.5% testdir
The above command can be run for each new generation.
GENBACKUPDATA(1)