Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Need script to remove millions of tmp files in /html/cache/ directory
Top Forums Shell Programming and Scripting Need script to remove millions of tmp files in /html/cache/ directory Post 302519561 by methyl on Wednesday 4th of May 2011 09:37:59 AM
Old 05-04-2011
Can we get a more exact sizing of the problem:

How big is the directory file itself?
Code:
ls -lad /html/cache

How long does it take to traverse the tree? And how many files in the tree?
Code:
date ; find /html/cache/ -type f -print | wc -l  ; date


Can you expand a bit about your CentOS VPS?
Are you renting a virtual computer from somewhere on the internet, or is this something you manage yourself?

If this is long-distance, the volume of output from commands must be important, but I can't see how running file deletes can hang the VPS. This is assuming that there is no rollback facility or something which would be crippled by high volumes of file deletes. I must assume that it did not collapse when the files were created - which is surely a similar load.

Assuming /html/cache is a simple directory structure and can be quiesced with no files open I'd be tempted to rename the directory, create a new replacement with identical permissions, and then delete the original at my leisure.
Last edited by methyl; 05-09-2011 at 09:18 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to remove all empty files within the directory structure?

Hi I need to write a shell script which basically searches for all the empty files within the directory structure, lists them before asking the user to confirm if they would like to delete them. If the user deletes the file then a notice would appear confirming the file is deleted. I've be... (5 Replies)
Discussion started by: cat123
5 Replies

2. Shell Programming and Scripting

perl script related /tmp directory

hi friends. i have to make a perl script to generate all users and space(how much they are using) and files(how much files they have) and time(how much time that accessed /tmp buffer) from /tmp directory. please provide me guidance. regards pranesh b. mishra (2 Replies)
Discussion started by: praneshmishra08
2 Replies

3. Web Development

html link to images in /tmp directory

Because of permission issues, I need to link to images in my web page which are stored in /tmp which of course is located in the root directory but my actual html page is much further down in another directory. I thought the the following code should work, but the image comes up as a broken link:... (2 Replies)
Discussion started by: Solerous
2 Replies

4. Shell Programming and Scripting

Script That Can navigate to 3 differents directory & remove files under them

Hi I am Trying to Write a script that can goto 4 different directorys on the server & remove the Files older then 30 days ?? /logs logs1 logs2 logs3 Now I need to remove files under logs1 logs2 logs3 which are older then 30 days whose name stat 'sit' , 'mig','bld' . in... (3 Replies)
Discussion started by: Beginner123
3 Replies

5. Shell Programming and Scripting

How to remove urls from html files

Does anybody know how to remove all urls from html files? all urls are links with anchor texts in the form of <a href="http://www.anydomain.com">ANCHOR</a> they may start with www or not. Goal is to delete all urls and keep the ANCHOR text and if possible to change tags around anchor to... (2 Replies)
Discussion started by: georgi58
2 Replies

6. Shell Programming and Scripting

Script to search for a character in files in a Directory & remove it

Hi All, Am new to both Unix & this Forum - Need some help on a script that I am trying to write: In a Directory i have few text files which might or might not contain some text that I am trying to find. Once that text is found in any of the files, it needs to be removed from the file ... (6 Replies)
Discussion started by: rituparna_gupta
6 Replies

7. UNIX for Dummies Questions & Answers

Redirecting tmp files of SORT into different directory

Hey Guys, I am facing an annoying scenario, fewer times when I execute the sort command, it throws out on error saying that "No Space on available on /var/tmp/<temp file name>. May be it is set to /var/tmp directory. I was wondering, if I cant redirect the temporary file creation to any other... (3 Replies)
Discussion started by: abhisheksunkari
3 Replies

8. UNIX for Dummies Questions & Answers

Script to remove zip files from a directory

Hi Folks, There is a job which generates a .zip files every day at /usr/app/generated directory , now please advise for the script that will delete this zip files permanently.but while deleting it should make sure that it will not delete the last two days recently generated zip files and this... (1 Reply)
Discussion started by: punpun66
1 Replies

9. Shell Programming and Scripting

Parse multiple html files in directory

I have downloaded source code for 97 files using: wget -x -i link.txt then run a rename loop: for file in * do mv $file $file.txt done to keep the html tags but make the file a text that can be parsed. In each of the 97 txt files the gene # is variable, but the gene is associated... (15 Replies)
Discussion started by: cmccabe
15 Replies

10. Shell Programming and Scripting

Shell script to find the GB files in /tmp directory in remote server

Hi, i need help on shell scripting. Main intention of the script is step 1: ssh to remote server Step 2: cd /tmp in remote server Step 3: in tmp i want to grep only files and directories which are in GB sizes All the servers list file is - tmpsrv.txt vi tmpsrv.txt ... (17 Replies)
Discussion started by: kumar85shiv
17 Replies

LEARN ABOUT DEBIAN

dtc_setup_vps_disk

dtc_setup_vps_disks(8)					      System Manager's Manual					    dtc_setup_vps_disks(8)

NAME

       dtc_setup_disk - setup LVM disks for using it as a VM

SYNOPSIS

       dtc_setup_vps_disk.sh VPS_NUMBER HDD_SIZE SWAP_SIZE [ lvm|loopback ]

DESCRIPTION

       dtc_setup_vps_disk.sh This shell script is a part of the dtc-xen package that is to be used by the dtc panel to manage a Xen VPS server.

       This script is used to create partitions to be used by a VPS later on.  It will create a normal partition that will be used as a root disk,
       and a swap partition.

       dtc_setup_disk is to be used by the dtc-xen SOAP server, but can also be used as a standalone userland tool.

       If the partition(s) exists, then this script will delete it/them first.

OPTIONS

       VPS_NUMBER has to be a number between 01 and 19. Let's say the number is 16, and that dtc-xen is configured to use the volume group  called
       lvm1, then this script will create /dev/lvm1/xen16 and /dev/lvm1/xen16swap.

       HDD_SIZE Size in MB of the VPS partition to create.

       SWAP_SIZE  Size in MB of the VPS swap partition to create. If the dtc-xen SOAP server is used to create the VPS, then it will create a swap
       partition of the exact same size as the memory.

       IMAGE_TYPE This parameter can have 2 values: either lvm or loopback. If ommited, then lvm is used. If lvm is used, then	this  script  will
       create a partition using lvmcreate, otherwise it will create an image file. Both will later be used for the VPS.

EXAMPLE

       dtc_setup_vps_disk 04 15360 256 lvm

       This will create 2 LVM partition to be used by the VPS named xen04, the first one being a root partition of 15 GB, and the second one being
       a swap partition of 256 MB.

VERSION

       This documentation describes dtc_setup_vps_disk version 0.3.15.	See http://www.gplhost.com/software-dtc-xen.html for updates.

SEE ALSO

       dtc_reinstall_os(8), dtc_kill_vps_disk(8)

															    dtc_setup_vps_disks(8)
All times are GMT -4. The time now is 08:52 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy