Sponsored Content
Top Forums UNIX for Beginners Questions & Answers Automate splitting of files , scp files as each split completes and combine files on target server Post 303033449 by rbatte1 on Friday 5th of April 2019 12:59:55 PM
Old 04-05-2019
Hello malaika,

I would like to bring up a few things to consider:-
  • How do you know that the file is complete before you try to split it? Perhaps it gets transferred as filename.partial then renamed to filename when complete or there is a flag file such as filename.OKAY created in the next step
  • Why break up the file to send it and reassemble? Have you considered rsync? If there is an interruption it can restart to catch up. You might be able to set it up to transfer then remove the original. Trial this with small files though Smilie

Does this help/hinder/miss the point?




Kind regards,
Robin
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to combine to flat files which are there in remote server ?

:mad: I have to write a script in informatica, which is used to combine two remote flat files (3 Replies)
Discussion started by: srinivasaraju.m
3 Replies

2. Shell Programming and Scripting

Splitting input files into multiple files through AWK command

Hi, I needs to split *.txt files from single directory depends on the some mutltiple input values. i have wrote the code like below for file in *.txt do grep -i -h "value1|value2" $file > $file; done. My requirment is more input values needs to be given in grep; let us say 50... (3 Replies)
Discussion started by: arund_01
3 Replies

3. Shell Programming and Scripting

Shell script to transfer the files from source to target server.

I need to write a shell script to transfer the files every hour from source - target server. The cron job should be running every hour and shouldn't copy already copied files to the remote server ? I was able to write intial script but not able to get the logic for (in the next run it should... (12 Replies)
Discussion started by: radhirk
12 Replies

4. Shell Programming and Scripting

copy files from remote server (B) to target server (A)?

Hi All, what is the comand to log off the remote server? I have 2 servers A, B. I need to find all files older than 7 days on server B and copy over to server A. My logic is: login the remote server: ================= ssh hostB cd /data/test find . -mtime -7 -ls | awk '{print... (4 Replies)
Discussion started by: Beginer0705
4 Replies

5. Shell Programming and Scripting

scp files from other server with check

Hi all, I am new to this forum,and it has been really a great pleasure to be a part of this forum:) well,i m trying to write a shell script where i m transfering a set of files from other server to my own server. for this i m using scp... (1 Reply)
Discussion started by: prasson_ibm
1 Replies

6. Shell Programming and Scripting

script for Copying files from one server to another using scp

Hi Scripting experts, I am new to the unix scripting. Please help me out for solving the condition given below I am trying to develop a script for Copying files which are getting generated in server A to server B using scp. In serverA files are generating as for eg abc1.txt, abc2.txt,... (5 Replies)
Discussion started by: rohithji
5 Replies

7. Shell Programming and Scripting

combine multiple files by column into one files already sorted!

I have multiple files; each file contains a certain data in a column view simply i want to combine all those files into one file in columns example file1: a b c d file 2: 1 2 3 4 file 3: G (4 Replies)
Discussion started by: ahmedamro
4 Replies

8. Shell Programming and Scripting

scp files that are 3 days older from remote server-

hello, i am trying to get a list of files to be scped from the remote server by running the below in my local unix server ( note - there is a passwordless connectivity setup made between the local and remote server) and, we use KSH. --- ssh $scp_host "find /a/b/c/*/ -iname "$remote_file"" >... (4 Replies)
Discussion started by: billpeter3010
4 Replies

9. Shell Programming and Scripting

Need shell script to compare directories and delete files on target server

Hello, I need help in writing the shell script for below mentioned case. There are 2 servers(server A, server B). A cronjob syncs files between these 2 servers. Existing script is copying files from A to B. This is done using the command rsync. However, the files are not deleted... (2 Replies)
Discussion started by: SravaniVedam11
2 Replies

10. UNIX for Beginners Questions & Answers

scp of multiple files to remote server

Hello, I would like to scp multiple files to a remote server that requires a password for the process to be completed. I have 30 folders (x_1, x_2 ... x_30), each containing 25 files. What I want to do is scp 1 out of the 25 files (file called bvals) for all my folders to a remote server and... (3 Replies)
Discussion started by: nasia.m
3 Replies
GKRELLKAM-LIST(5)						File Formats Manual						 GKRELLKAM-LIST(5)

NAME
gkrellkam-list - format of the list description files used by GKrellKam DESCRIPTION
GKrellKam lists describe a series of image sources, used in order or at random by the GKrellKam plugin. Online lists (downloadable by GKrellKam with HTTP) use this same syntax. Blank lines and comments (beginning with '#') in GKrellKam lists are ignored. Every line of text that does not begin with a tab character is considered an image source. An image source can be one of several types: image Sources of type image consist of a complete local filename to an image file. url Type url is just that; a ftp:// or http:// URL pointing at an online image file. script Type script is a system command, executed in a shell by GKrellKam when it's time to get this image. The output of the command is assumed to be a complete filename of a local image file, optionally terminated with newlines/whitespace. The corresponding image is loaded. list Type list causes a different GKrellKam list to be included in the current one. Each image source line should look like this: type: name The "type: " part of the line can be omitted for images and URLs, to make these list files backwards compatible with earlier versions of GKrellKam, but it is suggested that you specify them. It will enhance the readability of the list file. There are also properties that can be applied to types image, url, and script. Properties must follow the image source line that they mod- ify, and must begin with a tab character. These include: tooltip This sets the message shown when the mouse is kept over the image panel in GKrellKam for a few seconds. If not set, the image's filename or URL is shown instead. seconds This changes the number of seconds that an image will remain displayed. If not set, the "Default number of seconds" set for that panel in the GKrellM configuration window will be used. refresh If set, this sets the minimum length of time that must elapse before the image is re-loaded. If the image cycles up before that time, the old image will be used. For script types, this means that the script will not be re-run. For url types, the image will not be fetched using wget. When this property is not set, url images will be downloaded every time they are displayed, and scripts will be run every time. EXAMPLE
This is a simple example of a GKrellKam list. For a better example, see example.list from this distribution. # .krellkam.list # This list rotates through ~/pics/mypic[1-4].jpg along with a # webcam, and then displays the pictures in ~/lists/sub.list image: /home/paul/pics/mypic1.jpg /home/paul/pics/mypic2.jpg image: /home/paul/pics/mypic3.jpg http://www.usu.edu/webcam/fullsize.jpg [tab] tooltip: This is the building where I work image: /home/paul/pics/mypic4.jpg [tab] seconds: 4 [tab] tooltip: Don't display this one very long list: /home/paul/lists/sub.list FILES
$HOME/.krellkam.list - The default source for the first GKrellKam panel example.list - A sample GKrellKam list AUTHOR
GKrellKam was written by paul cannon <paul@cannon.cs.usu.edu>. This manual page was written by the same author for inclusion in the GKrel- lKam distribution, and may be used by others. SEE ALSO
wget(8) Dec 7, 2001 GKRELLKAM-LIST(5)
All times are GMT -4. The time now is 07:31 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy