help creating gzip of directory files via cron


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers help creating gzip of directory files via cron
# 1  
Old 01-31-2012
help creating gzip of directory files via cron

**BTW- very new to scripting**

I have created a shell script to gzip the public_html files on our website. I have tested this script on another directory on our site and it worked, but when I replaced the directory with the public_html directory it failed.

I am executing this script via a cron job.

This is the script that works.
Code:
gzip -c9 /home/abc/abc-1_4_2/*.* >/home/abc/backups/week_`date +'%d%b'`_backup.gz

This is the script that does not work
Code:
gzip -c9 /home/abc/public_html/*.* >/home/abc/backups/week_`date +'%d%b'`_backup.gz

I ran the cron job twice. This is the error the cron job gives me:
Code:
/home/mtpub/db_backups/magentozip.sh: line 1:  5501 Killed    or 
/home/mtpub/db_backups/magentozip.sh: line 1:  1002 Killed

Am I missing something in the formatting? Would simply changing the directories cause the error? I have tried asking our host if there is something special about the public_html directory that would prevent this, but alas... no help there!

Thanks.

Last edited by Franklin52; 02-07-2012 at 08:56 AM.. Reason: Please use code tags for code and data samples, thank you
# 2  
Old 01-31-2012
What does the line (exactly) look like in your crontab (crontab -l will list it for you)
# 3  
Old 02-01-2012
Code:
23     11     *     *     *     /home/abc/backups/zip.sh

This is set up in our cPanel cronjobs. The name of the file I have it in is zip.sh.
The file ran successfully with this cron to the first directory, but not to the public_html directory.

Should I try running the script directly from the cron tab instead of from the shell file?

---------- Post updated 02-01-12 at 01:01 PM ---------- Previous update was 01-31-12 at 05:35 PM ----------

Thanks for help. My host told me that it was an issue with the size of our site (1.5GB) vs. a timeout script they have running on the shared server. Smilie

Last edited by Franklin52; 02-07-2012 at 08:57 AM.. Reason: Please use code tags for code and data samples, thank you
# 4  
Old 02-06-2012
could you post the full script , or you can check this with after define the correct path.
# 5  
Old 02-06-2012
Full script is posted above. It is a simple one line script.

My host has told me that it is working, but because we are on a shared server, it takes too long to execute and their (server's) kill/time-out scripts are causing mine to fail. I had the same problem with our database dump script.

I know... "Find a new host"...

Thanks for all the help.
# 6  
Old 02-06-2012
Try leaving off the '9'. It makes gzip much much slower, for extremely small compression benefits.

Compressing 1.5 gigabyte files on a daily basis isn't such a terrific idea in any case, your host may not be in the wrong here.
# 7  
Old 02-06-2012
Thanks. I will try that. -- I am not doing it daily. It is a weekly backup.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

gzip files inside directory

Hello folks I hope every one is fine. I need to ask one question. I have directory /xx/abcd/data/ inside that data there are files like 11.txt 23.txt 12.txt *.txt i want that i will do compress each txt file inside that directory /xx/abcd/data/. But it will not gzip data... (1 Reply)
Discussion started by: learnbash
1 Replies

2. Shell Programming and Scripting

Bash: Gzip files in Directory and itīs Subdirectories

Hello dear Community, I have a task to wrtie a script which will gzip not zipped files in a directory and itīs subdirectories. I succeeded in gzippung the directory but not the subdirectories: #/bin/bash #go to the directory where to zip cd $1 #Zip unzipped files for i in `ls | xargs... (2 Replies)
Discussion started by: JamesCarter
2 Replies

3. UNIX for Dummies Questions & Answers

Creating a list of files in directory?

Hi All, I would like to do a loop on all the files with extension .out in my directory this files should be sorted alphabetically. Then I need to assign to each of them a progressive ID of three digits (maybe in HEX format?). First I tried to list manually the files as ARRAY=( A-001.out ... (5 Replies)
Discussion started by: f_o_555
5 Replies

4. UNIX for Dummies Questions & Answers

Creating a file to count how many files in the directory

hello there i want to creat a file that count how many files i have in the directory. for this i use the command find . -type f | wc -l > 1In1.myfile the problem with this command is that it not update after i add a new file in the directory. Anyone got any ideas how i can... (5 Replies)
Discussion started by: AntiPin
5 Replies

5. UNIX for Dummies Questions & Answers

Help with cron: copying all files in a directory to another...

Here's what I have thus far: cp -r /home/mydom/public_html/products/Widget/ /home/mydom/public_html/ This works fine but suppose the folder in public_html has a different name (Main_Widget). The cron above needs to copy the files within the folder (Widget) instead of the folder itself. How... (1 Reply)
Discussion started by: ashleyquick
1 Replies

6. Shell Programming and Scripting

Creating date directory and moving files into that directory

I have list of files named file_username_051208_025233.log. Here 051208 is the date and 025233 is the time.I have to run thousands of files daily.I want to put all the files depending on the date of running into a date directory.Suppose if we run files today they should put into 05:Dec:08... (3 Replies)
Discussion started by: ravi030
3 Replies

7. UNIX for Dummies Questions & Answers

gzip all the files in a directory

Hi, There are multiple files in a directory with different names.How can they be gzipped such that the timestamp of the files is not changed. (2 Replies)
Discussion started by: er_ashu
2 Replies

8. UNIX for Dummies Questions & Answers

extract tar files without creating directory

I received a tar file of a directory with 50,000 files in it. Is it possible to extract the files in the tar file without first creating the directory? ie. Doing tar -xvf filename.tar extracts as follows: x directory/file1.txt x directory/file2.txt . . . I would like to avoid... (4 Replies)
Discussion started by: here2learn
4 Replies

9. Programming

creating object files in a specific directory

hello, i have a makefile in which i am specifying the option for creating the object files of the source files. The option which i am using is this : gcc -c main.c first.c by default these object files are created in the same directory in which the makefile is present. what option... (1 Reply)
Discussion started by: svh
1 Replies

10. UNIX for Dummies Questions & Answers

CRON. How to delete files within a directory

I'd like to delete ALL files on a daily basis within a directory that are over a day old. Anyone know how I can automate this through Cron as I have 146 websites to administer. I've tried... 30 02 * * * /home/myspace/tmp/webalizer -atime + 1\! -type d -exec rm -f {} \; but all i get is an... (1 Reply)
Discussion started by: southoxon
1 Replies
Login or Register to Ask a Question