08-22-2005
How to concatenate all files.
Hi, I'm totally new to Unix. I'm an MVS mainframer but ran into a situation where a Unix server I have available will help me. I want to be able to remotely connect to another server using FTP, login and MGET all files from it's root or home directory, logout, then login as a different user and do the same thing. I need to do this for 7 accounts. Each accounts home directory will have 0 or a number of files (but not more then about ten files). Once I'm done transfering all these files to a local directory, I'll want to concatenate all the transfered files into one large file for subsequent batch processing.
I thought I would write a Unix script to:
1) switch directories to a local working directory
2) remove any residual files in the local working directory
3) run FTP connecting and transferring files from 7 different accounts into the local working directory
4) concatenate all the transferred files to one large file.
5) run FTP again this time sending the one large file to an MVS mainframe.
My question is how do I accomplish item number 4? I was thinking I could use grep and pipe. I just want to concatenate all the files into one. The input filenames will be unknown, but I do want to specify the target filename.
Is this possibe? It has to be no?
Thanks in advance.
Bob
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I need a script to concatenate several files in one step, I have 3 header files say file.S, file.X and file.R, I need to concatenate these 3 header files to data files, say file1.S, file1.R, file1.X so that the header file "file.S" will be concatenated to all data files with .S extentions and so on... (3 Replies)
Discussion started by: docaia
3 Replies
2. Shell Programming and Scripting
I have directory structure sales_only under which i have multiple directories for each dealer
example:
../../../Sales_Only/xxx_Dealer
../../../Sales_Only/yyy_Dealer
../../../Sales_Only/zzz_Dealer
Every day i have one file produce under each directory when the process runs.
The requirement... (3 Replies)
Discussion started by: mohanmuthu
3 Replies
3. Shell Programming and Scripting
Hi, I want to create a batch(bash) file to combine 23 files together. These files have the same extension. I want the final file is save to a given folder. Once it is done it will delete the 23 files.
Thanks for help. Need script. (6 Replies)
Discussion started by: zhshqzyc
6 Replies
4. UNIX for Dummies Questions & Answers
Hi,
I have a bunch of files (around 500) with the .log extension and each having a different name. Is there an easy way to concatenate them all into a single file?
I've tried:
cat *.log > complete.log
and it seems that files are overlapping each other...thus the new file is not complete.... (2 Replies)
Discussion started by: amarn
2 Replies
5. Shell Programming and Scripting
I have a file named "file1" which has the following data
10000
20000
30000
And I have a file named "file2" which has the following data
ABC
DEF
XYZ
My output should be
10000ABC
20000DEF (3 Replies)
Discussion started by: bobby1015
3 Replies
6. UNIX for Dummies Questions & Answers
HI all,
could please help me in this code. I have 560 files containing the same columns but different rows. i want to concatenate all these files in one big file. i want to keep the header of the first file then add the dat from other files horizontally.
the name of my files contains 2 variables... (7 Replies)
Discussion started by: biopsy
7 Replies
7. UNIX for Dummies Questions & Answers
Hi All,
Need your help.
I will need to concatenate around 100 files but each end of the file I will need to insert my name DIRT1228 on each of the file and before the next file is added and arrived with just one file for all the 100files.
Appreciate your time.
Dirt (6 Replies)
Discussion started by: dirt1228
6 Replies
8. UNIX for Dummies Questions & Answers
Hi
I am trying to learn linux step by step an i am wondering
can i use cat command for concatenate files but i want to place context of file1 to a specific position in file2 place of file 2 and not at the end as it dose on default?
Thank you. (3 Replies)
Discussion started by: iliya24
3 Replies
9. UNIX for Dummies Questions & Answers
- Concatenate files and delete source files. Also have to add a comment.
- I need to concatenate 3 files which have the same characters in the beginning and have to remove those files and add a comment and the end.
Example:
cat REJ_FILE_ABC.txt REJ_FILE_XYZ.txt REJ_FILE_PQR.txt >... (0 Replies)
Discussion started by: eskay
0 Replies
10. UNIX for Dummies Questions & Answers
Hi,
I would like to batch concatenate files by pairs. I have quite a few of them so I would not like to do that pair by pair separately.
the names of the file is of the type:
file1.fastq
newfile1_new.fastq
file2.fastq
newfile2_new.fastq
and so on...
I would like to concatenate file1... (2 Replies)
Discussion started by: jawad
2 Replies
LEARN ABOUT REDHAT
ncftpbatch
ncftpbatch(1) General Commands Manual ncftpbatch(1)
NAME
ncftpbatch - Individual batch FTP job processor
SYNOPSIS
ncftpbatch -d
ncftpbatch -l
ncftpbatch -D
OPTIONS
Command line flags:
-d Begin background processing of FTP jobs in the current user's $HOME/.ncftp/spool directory. This returns immediately, because a
daemon process is spawned and ran in the background.
-l Lists the contents of the user's job queue.
-D This is like -d, except that the process does not become a daemon.
DESCRIPTION
This program is responsible for processing background FTP requests. It is normally only run by ncftp and not manually by a human being,
however you can run it to manually process the FTP job queue.
The jobs are spool files written to a user's $HOME/.ncftp/spool directory and have a special format and file-naming convention (which con-
tains when the job is to be run). ncftp runs this program when it needs to, but if the ncftpbatch daemon dies unexpectedly the jobs that
are left in the queue will not be processed until another instance of ncftpbatch is run.
ncftpget and ncftpput can also be used to submit jobs for batch processing, using those utilities' -b command-line flag. If desired, you
can also manually create the spool files although this procedure is not documented here (see the manual page for ncftpspooler for more
information on how to do that).
DIAGNOSTICS
ncftpbatch writes to its own log file, the $HOME/.ncftp/spool/log file. This file should be examined to determine if any ncftpbatch pro-
cesses are actively working on jobs.
AUTHOR
Mike Gleason, NcFTP Software (mgleason@ncftp.com).
SEE ALSO
ncftp(1), ncftpput(1), ncftpget(1).
Software NcFTP ncftpbatch(1)