Script to determine Date,TotalFile,total size of file based on date


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Script to determine Date,TotalFile,total size of file based on date
# 1  
Old 12-02-2014
Script to determine Date,TotalFile,total size of file based on date

I have file listed like below
Code:
-rw-r--r--+ 1 test test  17M Nov 26 14:43 test1.gz
-rw-r--r--+ 1 test test    0 Nov 26 14:44 test2.gz
-rw-r--r--+ 1 test test    0 Nov 27 10:41 test3.gz
-rw-r--r--+ 1 test test 244K Nov 27 10:41 test4.gz
-rw-r--r--+ 1 test test  17M Nov 27 10:41 test5.gz

I need output as below
Code:
DATE TOTALFILE SIZE
Nov26   2       17M
Nov27   3       17.244M

Able to determine the DATE and TOTALFILE using below script

Code:
echo " "
echo  "DATE TOTALFILE"
cd /Mydir
ls -lrth | grep "^-" | awk '{
key=$6$7
freq[key]++
}
END {
for (date in freq)
       
        printf "%s\t%d\n", date, freq[date]
}'

Can someone help me to get the size as well based on date.
# 2  
Old 12-02-2014
Hello,

If I am correct, you are doing the file listing using "ls -lh", instead you can do just "ls -l" which make sure that file sizes are listed in bytes.

if you do so, it would be easy to add the bytes and convert it into MB or KB.

Something like this:
Code:
ls -lrt | grep "^-" | awk '{
key=$6$7
freq[key]++
a[freq[key]]=a[freq[key]]+$5;
}
END {
for (date in freq)

        printf "%s\t%d\t%f\n", date, freq[date],a[freq[date]]/(1024*1024)
}'


Last edited by panyam; 12-02-2014 at 03:42 AM..
# 3  
Old 12-02-2014
Yes you are correct Panyam. i am doing
Code:
ls -lrth

. In my script you can see that.
# 4  
Old 12-02-2014
Pls, re read my previous post again.
# 5  
Old 12-02-2014
This is similar to your script adding the size (as long as you don't mind actual byte counts instead of sums of "human readable" approximations):
Code:
printf '\nDATE\tFILES\tSIZE\n'
cd /Mydir
ls -lrt | grep "^-" | awk '
{	key=$6$7
	freq[key]++
	size[key] += $5
}
END {	for (date in freq)
		printf("%s\t%d\t%d\n", date, freq[date], size[date])
}'

Like your script, the output is not necessarily in date order. If you'd like the output in date order, you could try something more like:
Code:
printf '\nDATE\tFILES\tSIZE\n'
cd /Mydir
ls -lrt | grep "^-" | awk '
{	nkey = $6$7
	if(key != nkey && key != "") {
		printf("%s\t%d\t%d\n", key, freq, size)
		freq = 1;
		size = $5
	} else {freq++
		size += $5
	}
	key = nkey
}
END {	printf("%s\t%d\t%d\n", key, freq, size)
}'

Neither of these have been tested, but they should come close to what you need. I will leave the conversion of actual bytes to human readable form as an exercise for the reader. (I prefer the actual byte counts.)

If you want to use panyam's code I think you would need to change all occurrences of a[freq[key]] to a[key] and change a[freq[date]] to a[date].
# 6  
Old 12-02-2014
Thanks Don!!!

Tested and getting expected result

Code:
DATE TOTALFILE TOTALSIZE
Nov26   2       17506702
Nov27   26      2429166955
Dec1    1        133

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Run shell script based on date file

Hi Team, I have a to run a script based on a date present in a different file which updates everyday. Kindly help with the solution. My current execution : ksh scriptname.sh 10152019. But here i want to enter this date from a file which gets updated daily. My appraoch : date file location:... (3 Replies)
Discussion started by: midhun3108
3 Replies

2. HP-UX

HP/UX command to pull file name/date based on date

HI, Can anyone tell me how to pull the date and file name separated by a space using the find command or any other command. I want to look through several directories and based on a date timeframe (find -mtime -7), output the file name (without the path) and the date(in format mmddyyyy) to a... (2 Replies)
Discussion started by: lnemitz
2 Replies

3. UNIX for Dummies Questions & Answers

Find the count of files by last created date based on the given date range

My unix version is IBM AIX Version 6.1 I tried google my requirement and found the below answer, find . -newermt “2012-06-15 08:13" ! -newermt “2012-06-15 18:20" But newer command is not working in AIX version 6.1 unix I have given my requirement below: Input: atr files: ... (1 Reply)
Discussion started by: yuvaa27
1 Replies

4. UNIX for Dummies Questions & Answers

Looking for command line to find dirs based on size and date

Hi, My first time on this site, please excuse me if I've come to the wrong forum. I'm fairly new to Unix/Linux and hoping you can help me out. I'm looking for a command line that will return a list of directories that are larger than 50M and older than 2 days. I thought it may be... (6 Replies)
Discussion started by: Wisconsingal
6 Replies

5. Shell Programming and Scripting

Needed shell script to get the latest file based on date

hi i need the shell script to get the file with latest date. for example in my input folder i have files like file_20130212.txt file_20130211.txt now my output folder should have the file with latest date i.e..file_20120212.txt i want to get the latest file .. i.e is should take... (6 Replies)
Discussion started by: hemanthsaikumar
6 Replies

6. Shell Programming and Scripting

Checking the total size of all files from a particular date

Hi I have some set of files for a particular date. What is the command that I need to put in for finding the total size of all the files for that particular date. The following command is fetching me the size of all individual files seperately du -h *20101010* 16M file1.20101010 120K... (10 Replies)
Discussion started by: bobby1015
10 Replies

7. Shell Programming and Scripting

How to FTP the latest file, based on date, from a remote server through a shell script?

How to FTP the latest file, based on date, from a remote server through a shell script? I have four files to be FTP'ed from remote server. They are of the following format. build1_runtime_mmddyyyy.txt build2_runtime_mmddyyyy.txt build3_runtime_mmddyyyy.txt buifile_count_mmddyyyy.txt ... (9 Replies)
Discussion started by: imran_affu
9 Replies

8. Shell Programming and Scripting

Perl Script to check file date and size

Hi guys, i am new to perl. I started reading the perl documents and try to come up with some logic. I am trying to create a script that would go into a location, search for todays files, then searches for all .txt files from today. If todays not found, its an error If file size is less... (26 Replies)
Discussion started by: DallasT
26 Replies

9. Shell Programming and Scripting

sort files by date, delete oldest, if total size bigger than

hello people i need your help please i want to achieve the following with the simplest, most efficient shell-tools: i have a directory with a lot of files from users. the script should check which partition the dir is on if the partition with the directory is more than 90% full ... (2 Replies)
Discussion started by: scarfake
2 Replies

10. Shell Programming and Scripting

Determine date and time the file was created through shell scripts

Can I determine when the particular file was created, in korn-shell. Can please someone help me. If possible please mail the solution to me. my mail id: bharat.surana@gmail.com (1 Reply)
Discussion started by: BharatSurana
1 Replies
Login or Register to Ask a Question