Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Split/create directories on basis of their size

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Split/create directories on basis of their size
# 1  
Old 07-28-2005
Split/create directories on basis of their size
Hi,

I would really apprciate it if someone expert in shell, "shell guru" scripting can help me.

with a shell command how can I create directories and populate on basis of size.
Before I confuse you, let me tell you the scenerio.

We take hot database backup of oracle on disk, and compress/gzip it.
This is done by a shell script which softlinks every last days backup as LATEST (create a soft link to mon,tue,wed,thur,fri,sat,sun whatever is the last day).
As this backup goes into days(moin tue,wed,thur etc) directory. Because the size after compression is more then 250 Gb, netbackup takes ages to back it up.

What I am looking for is, that database backup should be splitted into different directories on basis of size, 25Gb each dir. The script should be able to create directory dir1_1, dir1_2 etc and then put all the *.dbf etc in each directory not more then 25Gb and when it reach the limit it should create another dir, dir1_3 and so on, and copy the file over and so on untill all the *.dbf files in the "last days" dir are copied.
The problem is it should only to dir where symbolic link LATEST points to wether it's monday or tue etc.
So netbackup can back it up in parallel.

Thanks
Amit
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Split large file into 24 small files on one hour basis

I Have a large file with 24hrs log in the below format.i need to split the large file in to 24 small files on one hour based.i.e ex:from 09:55 to 10:55,10:55-11:55 can any one help me on this.! ... (20 Replies)
Discussion started by: Raghuram717
20 Replies

2. UNIX for Beginners Questions & Answers

Split a txt file on the basis of line number

I have to split a file containing 100 lines to 5 files say from lines ,1-20 ,21-30 ,31-40 ,51-60 ,61-100 Here is i can do it for 2 file but how to handle it for more than 2 files awk 'NR < 21{ print >> "a"; next } {print >> "b" }' $input_file Please advidse. Thanks (4 Replies)
Discussion started by: abhaydas
4 Replies

3. Shell Programming and Scripting

List directories on the basis of name

I have below directories. All directories create as per some some logging software by today so all directories current time is today date. Direct 2013-08-12 23123 Direct 2013-08-13 24121 Direct 2013-08-14 34513 Direct 2013-08-31 15435 ........... Direct 2013-09-12 53145 Direct... (5 Replies)
Discussion started by: learnbash
5 Replies

4. Shell Programming and Scripting

Directories above particular size

Hi guys, i'm searching for a command, which gives me back all the directories which are greater than a particular size? thx for helping so far :b: guti (2 Replies)
Discussion started by: guti_rocks
2 Replies

5. Shell Programming and Scripting

Split one file to Multiple file with report basis in unix

Hi, Please help on this. i want split the below file(11020111.CLT) to more files with some condition. :b: 1) %s stating of the report 2) %e ending of the report example starting of the report: %sAEGONCA| |MUMBAI | :EXPC|N|D ending of the report %eAEGONCA| |MUMBAI | :EXPC 3)so the... (10 Replies)
Discussion started by: krbala1985
10 Replies

6. Shell Programming and Scripting

How to list all the directories, sub directories in a mount along with size in ascending order?

Hi , I am very new to unix as well as shell scripting. I have to write a script for the following requirement. In a particular mount, have to list all the directories and sub directories along with size of the directory and sub directory in ascending order. Please help me in this regard and many... (4 Replies)
Discussion started by: nmakkena
4 Replies

7. Shell Programming and Scripting

split on the basis of 2nd and 3rd column

file A aa 22 48 ab 22 48 tcf 50 76 gf 50 76 h 89 100 yh 89 100 how can we split the file on the basis of common 2 and third column output like file A-1 aa 22 48 ab 22 48 file A-2 cf 50 76 gf 50 76 (3 Replies)
Discussion started by: cdfd123
3 Replies

8. Shell Programming and Scripting

check if multiple directories exist else create missing directories

Hi , I 'm trying to check if multiple directories exist on a server, if not create the missing ones and print " creating missing directory. how to write this in a simple script, I have made my code complex if ; then taskStatus="Schema extract directory exists, checking if SQL,Count and... (7 Replies)
Discussion started by: ramky79
7 Replies

9. Shell Programming and Scripting

Hiding Directories on a Session by Session basis

Hi, Apologies if anyone has read my recent post on the same subject in the Linux forum, just thought actually the solution might more likely come from scripting. Essentially, I am trying to restrict access to directories based on the user's name AND their location on a session-by-session... (3 Replies)
Discussion started by: en7smb
3 Replies

10. HP-UX

Directories Size

Hi All I want to plan my backups, but 1st i would like to know what is the size of each directory. Is there any command which can show me the size of directories? Regards (2 Replies)
Discussion started by: cgege
2 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

rbash

RBASH(1)						      General Commands Manual							  RBASH(1)

NAME

       rbash - restricted bash, see bash(1)

RESTRICTED SHELL

       If  bash  is  started with the name rbash, or the -r option is supplied at invocation, the shell becomes restricted.  A restricted shell is
       used to set up an environment more controlled than the standard shell.  It behaves identically to bash with the exception that the  follow-
       ing are disallowed or not performed:

       o      changing directories with cd

       o      setting or unsetting the values of SHELL, PATH, ENV, or BASH_ENV

       o      specifying command names containing /

       o      specifying a file name containing a / as an argument to the .  builtin command

       o      specifying a filename containing a slash as an argument to the -p option to the hash builtin command

       o      importing function definitions from the shell environment at startup

       o      parsing the value of SHELLOPTS from the shell environment at startup

       o      redirecting output using the >, >|, <>, >&, &>, and >> redirection operators

       o      using the exec builtin command to replace the shell with another command

       o      adding or deleting builtin commands with the -f and -d options to the enable builtin command

       o      using the enable builtin command to enable disabled shell builtins

       o      specifying the -p option to the command builtin command

       o      turning off restricted mode with set +r or set +o restricted.

       These restrictions are enforced after any startup files are read.

       When a command that is found to be a shell script is executed, rbash turns off any restrictions in the shell spawned to execute the script.

SEE ALSO

       bash(1)

GNU Bash-4.0							    2004 Apr 20 							  RBASH(1)