Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Ftp bash script appends to file using cron instead of coping new file
Top Forums Shell Programming and Scripting Ftp bash script appends to file using cron instead of coping new file Post 302949435 by akallenberger on Friday 10th of July 2015 01:35:53 PM
Old 07-10-2015
Ftp bash script appends to file using cron instead of coping new file
I have a bash script that is running a mysql query and creating a csv file with a time stamp. It then uploads that to a ftp server. Everything works great when I manually run it. But then I have a cron job set to run every monday, wednesday and friday at 5am est. When the cron job runs, it appends to the last file. For example, the file that ran wednesday is called 15-07-08_report.csv. On Friday the cron job runs and instead of creating a new file called 15-07-10_report.csv, it just appends to the file called 15-07-08_report.csv. If I run it manually without the cron job, the bash script will create a new file on the ftp server called 15-07-10_report.csv and leave the file from wednesday. That what I want to happen when the cron job runs.

bash script:
Code:
#!/bin/bash
#DB server details

server_ip='mysql_server.com';

db_user='user';
db_pass='password';
db_name='db_name';


#Delete all previous csv files

rm *.csv

#create new file

csv_file="$(date -d now +%y-%m-%d)_report.csv";

touch $csv_file

#Query to be execute in MySql and save data in csv file

mysql -u$db_user -p$db_pass -h$server_ip < /var/www/html/tools/report-script/report.sql $db_name | sed 's/\t/","/g;s/^/"/;s/$/"/;s/\n//g' >> $csv_file

#Open FTP and put files there
echo "start ftp"

#Your FTP IP or URL
HOST="ftp.upload.com"

#FTP user name
USER="user_me"
echo "pass"
#FTP user password
PASSWD="my_pass"

echo "change"

#Change to directory where the original csv file is located

cd /var/www/html/tools/report-script

echo "transfer file"
ftp -n $HOST <<END_SCRIPT
quote USER $USER
quote PASS $PASSWD

!#Folder on the FTP server you want to save to.  By default it will save to the user's home directory
cd /folder

!# Turn off prompting yes or no to transfer file
prompt

!#copies the cvs file to ftp server
mput *.csv

quit
END_SCRIPT
exit 0

cron job:
Code:
0 5 * * 1,3,5 /var/www/html/tools/report-script/test_report.sh

Any help is much appreciated. I can't figure out why the behavior would be different by using cron to run the script vs running it manually. Thanks!
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Script That Appends

I am trying to write a bash script that takes a file as an argument and appends my name if this file ends in .txt... I am not sure how to do this though. Any help is greatly appreciated! (4 Replies)
Discussion started by: GTRocker8824
4 Replies

2. Shell Programming and Scripting

Not able to FTP a file with root cron

Hi All, I am facing a difficulty with root cron. There is a script which is running in root's cron for every 3 minutes. I am having a different but i have the access to change the script which is running in root's cron.In the script the output is already going to a file in /tmp.I have just added... (1 Reply)
Discussion started by: usha rao
1 Replies

3. Shell Programming and Scripting

Progress bar while coping a file needed.

Hi guys I want to create a script which will show the amount of data that is been copied from one location to another location. For example: Say i have a file called abc.img which is approximately 4 gb of size therfore everytime i copy the file from one location to another i want a progress bar... (3 Replies)
Discussion started by: pinga123
3 Replies

4. UNIX for Dummies Questions & Answers

echo appends to a read-only file

echo command can append to a read-only file too. If the file is read-only, with w flag removed, then even echo should not be able to append to the file. But it is possible. Can anybody explain the below behaviour? /root > echo 'sample text' > file /root > cat file sample text /root >... (2 Replies)
Discussion started by: anand_bh
2 Replies

5. Shell Programming and Scripting

end of file error bash ftp script

Hello kind programmers :) I am a newbie and running into an error "line 28: syntax error: unexpected end of file" on the script shown below. Any help would be greatly appreciated. Thanks! #! /bin/bash if ($#argv <3) then echo 'Usage get_modis_snow ' echo 'ftp script for MYD10A2... (2 Replies)
Discussion started by: cmshreve
2 Replies

6. Shell Programming and Scripting

Problems coping a file in a shl script

I have the following in a shl script: SCRIPT_PATH="/u01/app/banner/test/skid/plus/"; FILE_PATH="/nfs/mercury/u03/banner/test/skid/log"; LIST_FILE_PATH="/u01/banjobs/TEST"; SCRIPT_NAME="szpcal1.sql"; FILE_NAME='new_applicant_list'; I want to copy the file FILE_NAME to LIST_FILE_PATH ... (10 Replies)
Discussion started by: rechever
10 Replies

7. Shell Programming and Scripting

Bash script for new file in ftp folder

Hello, I'm trying to make a bash script that send me e-mail if there is any new file in my ftp folder. cat inotify.sh #!/bin/sh /usr/bin/inotifywait -e create \ -mrq /home/mrowcp | while read line; do echo -n "$line " >> /var/log/inotify.log echo `date | cut -d " " -f1-4` >>... (3 Replies)
Discussion started by: mrowcp
3 Replies

8. UNIX for Advanced & Expert Users

cron job to extact lines from files to another file and ftp to new server

i have a text file in this format: which creates a new one everyday in the form of filename _zing__r200_2012_8_10_log.txt Fri Aug 10 07:29:17 EDT 2012, usera(192.168.0.245) to anotheruser: hey top, this is a private test Fri Aug 10 07:29:28 EDT 2012, anotheruser(192.168.0.245) to usera: got... (2 Replies)
Discussion started by: bkkid
2 Replies

9. Shell Programming and Scripting

Needed script to FTP a File and generate a quality checksum file

hi all i want a script to FTP a file and should generate a quality checksum file means when I FTP a file from one server to another server it should generate a QC file which should contain timestamp,no.of records in that file Thanks in advance saikumar (3 Replies)
Discussion started by: hemanthsaikumar
3 Replies

10. Shell Programming and Scripting

Ftp with bash, append file where left off

I'm working on a bash script to finish uploading a file. I need a way to get $filesize so that "restart $filesize" will work. Here is my script: ftp -n -v <<END_SCRIPT open ftp.$domain user $user@$domain $password size $file restart $filesize put $file quit END_SCRIPTWayne Sallee... (9 Replies)
Discussion started by: WayneSallee
9 Replies

LEARN ABOUT CENTOS

mysql_fix_privilege_tables

MYSQL_FIX_PRIVILE(1)					       MySQL Database System					      MYSQL_FIX_PRIVILE(1)

NAME

       mysql_fix_privilege_tables - upgrade MySQL system tables

SYNOPSIS

       mysql_fix_privilege_tables --password=root_password

DESCRIPTION

	   Note
	   In MySQL 5.1.7, mysql_fix_privilege_tables was superseded by mysql_upgrade, which should be used instead. See mysql_upgrade(1).

       Some releases of MySQL introduce changes to the structure of the system tables in the mysql database to add new privileges or support new
       features. When you update to a new version of MySQL, you should update your system tables as well to make sure that their structure is up
       to date. Otherwise, there might be capabilities that you cannot take advantage of.

       mysql_fix_privilege_tables is an older script that previously was used to uprade the system tables in the mysql database after a MySQL
       upgrade.

       Before running mysql_fix_privilege_tables, make a backup of your mysql database.

       On Unix or Unix-like systems, update the system tables by running the mysql_fix_privilege_tables script:

	   shell> mysql_fix_privilege_tables

       You must run this script while the server is running. It attempts to connect to the server running on the local host as root. If your root
       account requires a password, indicate the password on the command line like this:

	   shell> mysql_fix_privilege_tables --password=root_password

       The mysql_fix_privilege_tables script performs any actions necessary to convert your system tables to the current format. You might see
       some Duplicate column name warnings as it runs; you can ignore them.

       After running the script, stop the server and restart it so that any changes made to the system tables take effect.

       On Windows systems, MySQL distributions include a mysql_fix_privilege_tables.sql SQL script that you can run using the mysql client. For
       example, if your MySQL installation is located at C:Program FilesMySQLMySQL Server 5.1, the commands look like this:

	   C:> cd "C:Program FilesMySQLMySQL Server 5.1"
	   C:> binmysql -u root -p mysql
	   mysql> SOURCE share/mysql_fix_privilege_tables.sql

	   Note
	   Prior to version 5.1.17, the mysql_fix_privilege_tables.sql script is found in the scripts directory.

       The mysql command will prompt you for the root password; enter it when prompted.

       If your installation is located in some other directory, adjust the path names appropriately.

       As with the Unix procedure, you might see some Duplicate column name warnings as mysql processes the statements in the
       mysql_fix_privilege_tables.sql script; you can ignore them.

       After running the script, stop the server and restart it.

COPYRIGHT

       Copyright 2007-2008 MySQL AB, 2008-2010 Sun Microsystems, Inc.

       This documentation is free software; you can redistribute it and/or modify it only under the terms of the GNU General Public License as
       published by the Free Software Foundation; version 2 of the License.

       This documentation is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
       MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

       You should have received a copy of the GNU General Public License along with the program; if not, write to the Free Software Foundation,
       Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA or see http://www.gnu.org/licenses/.

SEE ALSO

       For more information, please refer to the MySQL Reference Manual, which may already be installed locally and which is also available online
       at http://dev.mysql.com/doc/.

AUTHOR

       Sun Microsystems, Inc. (http://www.mysql.com/).

MySQL 5.1							    04/06/2010						      MYSQL_FIX_PRIVILE(1)
All times are GMT -4. The time now is 03:27 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy