Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: SFTP Shell Script Get & Delete && Upload & Delete
Top Forums Shell Programming and Scripting SFTP Shell Script Get & Delete && Upload & Delete Post 302982119 by weesiong on Saturday 24th of September 2016 07:22:05 AM
Old 09-24-2016
Most important question first: Does your script do what it is intended for? If not, post what goes wrong. If yes, here's some comments on it:

- do you really need to run it continuously, i.e. will any of the files AAA*/BBB*/CCC* be recreated periodically?
YES, customer will upload filename with AAA_%% or BBB_%%...
- while [ 1 ] works (creating an infinite loop) as would while [ 0 ]. Is that what you intended to do?
YES, I want run this as Services
- you want a download as well as an upload. In the same script? Switchable? File names changing?
Can split in 2 script
- you want "specified filenames" to be down-/uploaded. This can be easily done as lines in "here documents" are expanded by the shell. Any idea on how to supply the filenames?
It is random filename, only know the prefix name
- adding comments is good behaviour in programming, but try to be more illustrative, don't state the obvious.

---------- Post updated at 06:22 AM ---------- Previous update was at 06:16 AM ----------

After 8hours research, I've this auto download script:
Code:
#!/bin/bash
Server=".ssh/xxxxx@10.x.x.x"
Logfile="ftp_log.log"
Processed_Logfile="ftp_log.processed"
Script_Logfile="ftp_log.script"
Directory="test"
Sleep=300

# -----------------------------------------------------
# Function get and remove file from server
# -----------------------------------------------------
getdelete() {
sftp -o IdentityFile=$Server <<-EOF  >$Processed_Logfile 2>&1
cd $Directory
lcd $2
get $1
echo $(date '+%Y/%m/%d %H:%M:%S') "     downloaded     " $1
rm $1
echo $(date '+%Y/%m/%d %H:%M:%S') "     deleted        " $1
!
EOF
}

# -----------------------------------------------------
# Loop job
# -----------------------------------------------------
while [ 1 ]
do
# -----------------------------------------------------
# Connect remote server get the directory list
# Save directory list in ftp_log.temp
# -----------------------------------------------------
sftp -o IdentityFile=$Server <<-EOF >$Logfile 2>&1
cd $Directory
ls -1
!
EOF
# -----------------------------------------------------
# Process line from list
# Get and remove file from remote server
# -----------------------------------------------------

while read p; do
  if [[ $p == *txt ]]
  then
    if [[ $p == AAA* ]]; then
      getdelete $p "/home/AAA/"
    elif [[ $p == BBB* ]]; then
      getdelete $p "/home/BBB/"
    elif [[ $p == CCC* ]]; then
      getdelete $p "/home/CCC/"
    elif [[ $p == DDD* ]]; then
      getdelete $p "/home/DDD/"
    elif [[ $p == EEE* ]]; then
      getdelete $p "/home/EEE/"
    fi
  fi
done < $Logfile

  #sleep in second
  sleep $Sleep
done >> $Script_Logfile 2>&1 &

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell script delete log files from folder & subfolders on space usage

Hi, I am trying to write a shell script to delete logs generate by db when space in the folder reaches 70%. i am getting space values from db, find the files at OS and remove them by using a cron job runs every 5minutes. I have to keep the latest 5 files at any time, my problem is that log files... (3 Replies)
Discussion started by: saha
3 Replies

2. UNIX for Advanced & Expert Users

Network Shell Script & Blade Logic & Network Security

I am going to take up a position in Data & Network Security. I would need to write network shell scripts doing the following task: Going to around 2000 servers and findout which groups has access to each servers and which ids are there in each group that has access. I need to implement... (1 Reply)
Discussion started by: pinnacle
1 Replies

3. UNIX for Dummies Questions & Answers

Problem with xterm & tcsh & sourcing a script in a single command

Hi friends, I have a script that sets the env variable path based on different conditions. Now the new path variable setting should not done in the same terminal or same shell. Only a new terminal or new shell should have the new path env variable set. I am able to do this only as follows: >cd... (1 Reply)
Discussion started by: sowmya005
1 Replies

4. Shell Programming and Scripting

PHP read large string & split in multidimensional arrays & assign fieldnames & write into MYSQL

Hi, I hope the title does not scare people to look into this thread but it describes roughly what I'm trying to do. I need a solution in PHP. I'm a programming beginner, so it might be that the approach to solve this, might be easier to solve with an other approach of someone else, so if you... (0 Replies)
Discussion started by: lowmaster
0 Replies

5. Shell Programming and Scripting

replace & with &amp; xml file

Hello All I have a xml file with many sets of records like this <mytag>mydata</mytag> <tag2>data&</tag2> also same file can be like this <mytag>mydata</mytag> <tag2>data&</tag2> <tag3>data2&amp;data3</tag3> Now i can grep & and replace with &amp; for whole file but it will replace all... (4 Replies)
Discussion started by: lokaish23
4 Replies

6. Shell Programming and Scripting

Replace & sign to &amp word

Hi, I have text file abc.txt. In this file, I have the following data. Input: Mr Smith &amp Mrs Smith Mr Smith &apos Mrs Smith Mr Smith & Mrs Smith Mr Smith& Mrs Smith Mr Smith &Mrs Smith Output: Mr Smith &amp Mrs Smith Mr Smith &apos Mrs Smith Mr Smith &amp Mrs Smith Mr Smith&amp... (4 Replies)
Discussion started by: naveed
4 Replies

7. Red Hat

Need Script to ZIP/SAVE & then DELETE Log file & DELETE ZIPS older than 12 months

ENVIROMENT Linux: Fedora Core release 1 (Yarrow) iPlanet: iPlanet-WebServer-Enterprise/6.0SP1 Log Path: /usr/iplanet/servers/https-company/logs I have iPlanet log rotation enabled rotating files on a daily basis. The rotated logs are NOT compressed & are taking up too much space. I... (7 Replies)
Discussion started by: zachs
7 Replies

8. Shell Programming and Scripting

[Solved] Get files & delete them by shell script

I want to use my script to get any file then delete it once it transfers to my side , I manage to create below script to generate "list" file which contains all file names in "10.10.1.1" then I made "a.out" file which contains the commands that I want to run it on "10.10.1.1" to get & delete the... (2 Replies)
Discussion started by: arm
2 Replies

9. Shell Programming and Scripting

Script needed to delete to the list of files in a directory based on last created & delete them

Hi My directory structure is as below. dir1, dir2, dir3 I have the list of files to be deleted in the below path as below. /staging/retain_for_2years/Cleanup/log $ ls -lrt total 0 drwxr-xr-x 2 nobody nobody 256 Mar 01 16:15 01-MAR-2015_SPDBS2 drwxr-xr-x 2 root ... (2 Replies)
Discussion started by: prasadn
2 Replies

10. Shell Programming and Scripting

Need Script to ZIP/SAVE & then DELETE Log file & send a mail conformation for any error

ENVIROMENT Linux: RHEL 6.4 Log Path: /usr/iplanet/servers/https-company/logs Log Format: user.log.03-15-2015 I have log4j log rotation enabled rotating files on a daily basis. The rotated logs are NOT compressed & are taking up too much space. I need a script that will run daily that... (1 Reply)
Discussion started by: admin_job_admin
1 Replies

LEARN ABOUT DEBIAN

sftp-server

SFTP-SERVER(8)						    BSD System Manager's Manual 					    SFTP-SERVER(8)

NAME

     sftp-server -- SFTP server subsystem

SYNOPSIS

     sftp-server [-ehR] [-f log_facility] [-l log_level] [-u umask]

DESCRIPTION

     sftp-server is a program that speaks the server side of SFTP protocol to stdout and expects client requests from stdin.  sftp-server is not
     intended to be called directly, but from sshd(8) using the Subsystem option.

     Command-line flags to sftp-server should be specified in the Subsystem declaration.  See sshd_config(5) for more information.

     Valid options are:

     -e      Causes sftp-server to print logging information to stderr instead of syslog for debugging.

     -f log_facility
	     Specifies the facility code that is used when logging messages from sftp-server.  The possible values are: DAEMON, USER, AUTH,
	     LOCAL0, LOCAL1, LOCAL2, LOCAL3, LOCAL4, LOCAL5, LOCAL6, LOCAL7.  The default is AUTH.

     -h      Displays sftp-server usage information.

     -l log_level
	     Specifies which messages will be logged by sftp-server.  The possible values are: QUIET, FATAL, ERROR, INFO, VERBOSE, DEBUG, DEBUG1,
	     DEBUG2, and DEBUG3.  INFO and VERBOSE log transactions that sftp-server performs on behalf of the client.	DEBUG and DEBUG1 are
	     equivalent.  DEBUG2 and DEBUG3 each specify higher levels of debugging output.  The default is ERROR.

     -R      Places this instance of sftp-server into a read-only mode.  Attempts to open files for writing, as well as other operations that
	     change the state of the filesystem, will be denied.

     -u umask
	     Sets an explicit umask(2) to be applied to newly-created files and directories, instead of the user's default mask.

     For logging to work, sftp-server must be able to access /dev/log.	Use of sftp-server in a chroot configuration therefore requires that
     syslogd(8) establish a logging socket inside the chroot directory.

SEE ALSO

     sftp(1), ssh(1), sshd_config(5), sshd(8)

     T. Ylonen and S. Lehtinen, SSH File Transfer Protocol, draft-ietf-secsh-filexfer-00.txt, January 2001, work in progress material.

HISTORY

     sftp-server first appeared in OpenBSD 2.8.

AUTHORS

     Markus Friedl <markus@openbsd.org>

BSD
								  January 9, 2010							       BSD
All times are GMT -4. The time now is 01:55 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy