10-25-2019
Need help with listing file name and modified date on a huge directory
hi,
We have a huge directory that ha 5.1 Million files in it. We are trying to get the file name and modified timestamp of the most recent 3 years from this huge directory for a migration project.
However, the ls command (background process) to list the file names and timestamp is running for more than 24 hrs and it aborted after sometime.
Is there an efficient way to get the file names and modified timestamp in such huge directory in a relatively quicker time?
Appreciate any options/feedback. Thanks.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I am trying to load a group of files and their last dates modified into a text file that will in turn be used with SQL*Loader to load these files into Oracle. I am using a *.ksh script. I am getting the name of the file in by using the following:
for file_ext in 'cat loaddir.ext';
do
find... (2 Replies)
Discussion started by: akpopa
2 Replies
2. UNIX for Advanced & Expert Users
how to directly open a last modified file in a directory? Please help (5 Replies)
Discussion started by: apsprabhu
5 Replies
3. UNIX for Dummies Questions & Answers
I only know how to list all sub-directories or files in specified directory. I don't know how to order them by modified date, furthermore, I don't know how to get the top one file in the sorted list. Wish you can do me a favor. Thanks in advance! (3 Replies)
Discussion started by: crest.boy
3 Replies
4. UNIX for Dummies Questions & Answers
Hi
How to list all the files in a directory that are modified on a particular date?
Also need to know the count,i.e number of files modified on a particular date.
Thanks
Ashok (1 Reply)
Discussion started by: ashok.k
1 Replies
5. UNIX for Advanced & Expert Users
Hi,
I am new bie to Unix. Might be a simple question I am asking.
I want to find the last modified time of a file and find the difference between the currrent time and the last modified time. Appreciate, if someone can throw some light on what commands can be used.
Cheers,
James (2 Replies)
Discussion started by: JamesJoe
2 Replies
6. Shell Programming and Scripting
Hi there
Im trying to find a way to test whether the last modified time is older than 1 day or not
so
#!/bin/bash
if ; then
$TOUCHED = "recently"
else
$TOUCHED = "not so recently"
fi
ive seen loads of posts where people are using find and the -mtime property but i... (2 Replies)
Discussion started by: rethink
2 Replies
7. Shell Programming and Scripting
I wan to pick the latest modified file name and redirect it to a file ..
ls -tr | tail -1 >file
but this is printing file ins side the filename ,
can anyone help me out (5 Replies)
Discussion started by: vishwakar
5 Replies
8. Shell Programming and Scripting
Hi ,
In my directory , i have many days file but i want to see all those which are of todays date.
i tried this but it gives all the files
mtime -0 |ls -ltr
I tried the below option as well.
19635 find -iname "*.LOG" -mtime
19636 ls -ltr *.LOG -mtime -1
19637 ls -ltr *.LOG... (7 Replies)
Discussion started by: guddu_12
7 Replies
9. AIX
I'm using a script that I need to get a file's "last modified date" in a format like 01:51:14 PM. We are running on AIX 6.1.0.0. I can't seem to find the right command parameters. Help! (4 Replies)
Discussion started by: mattadams1983
4 Replies
10. OS X (Apple)
Hi,
Am performing a find based on filename and result can contain multiple files being found
Let's say my find command is
find /Archive -f -name 12345.pdf
and result of find command is
/Archive/Folder A/12345.pdf
/Archive/Folder B/12345.pdf
please note white space in folder names
I... (2 Replies)
Discussion started by: gigagigosu
2 Replies
LEARN ABOUT CENTOS
cheatmake
CHEATMAKE(1) [FIXME: manual] CHEATMAKE(1)
NAME
cheatmake - fool make into not rebuilding certain files
SYNOPSIS
cheatmake [hidechangefile] [show] [whyfile]
DESCRIPTION
cheatmake is used to save time when recompiling. It can fool make into skipping files that haven't changed in a meaningful way. This can be
used for instance when you change a comment in a file but none of the actual code.
This utility is part of the KDE Software Development Kit.
OPTIONS
hidechange file
Hides the fact that file was changed by setting the timestamp into the past. Use with care!
show
Lists what files make currently needs to rebuild
why file
Explains why make must rebuild file
ENVIRONMENT
One of the following variables (but not both) should be set if the source directory is different from the build directory. If the build
directory is simply a subdirectory of the source directory, the simpler variable OBJ_SUBDIR should be used.
OBJ_SUBJDIR
Indicates that the build directory is in the given subdirectory of the source directory. For instance, if the source directory is
kdesdk and the build directory is kdesdk/obj-i386-linux, then OBJ_SUBDIR should be set to obj-i386-linux.
OBJ_REPLACEMENT
A sed expression that is used to transform the source directory into the build directory. For instance, if the source directory is
kdesdk/obj-i386-linux, then OBJ_REPLACEMENT should be set to s#kdesdk#kdesdk-obj#.
SEE ALSO
make(1)
AUTHORS
cheatmake was written by David Faure<faure@kde.org>. This manual page was prepared by Ben Burton<bab@debian.org> for the Debian
GNU/Linux(R) system (but may be used by others).
[FIXME: source] March 8, 2003 CHEATMAKE(1)