2 File transfer problems since time change on Nov 6th


 
Thread Tools Search this Thread
Operating Systems Solaris 2 File transfer problems since time change on Nov 6th
# 1  
Old 11-24-2011
2 File transfer problems since time change on Nov 6th

We are in a hosting environment.Everyday a FTP server on client side follows predefined schedules to get files from a file server on hosting side.

On the file server, the files are originally saved in /data folder; after the remote FTP server gets them, the files will be moved to /archive folder, while the filenames will have timestamps appended to show the time that the files were successfully processed by the FTP server.

Everything was ok until the next day of time change which was Nov 6th. Starting from Nov 7th, in the /data folder, we start to see files like .nfsxxxx. They have the same size as the good data files, accumulating in both file server and FTP server, consume a lot of space and we don't know whether there is any impact to the data files. We did do homework on those NFS files, but as far as we know, there is no known process or userid trying to open the files while they are being transferred by FTP server. We also can't figure out why the problem happened right after time change.

The 2nd problem happened since yesterday. The client FTP server can no longer get data files. The log shows "No Such File". However, on hosting side, the files were moved to /archive with a timestamp as if they were moved successfully by FTP server.

Below are what happened before the problem, hopefully can give some clue:
1. On client side, on Nov 6th, the date configuration related to the FTP transfer cycle was modified so that the transfer time is the same after time change. E.g., file was transferred at 6:00am before the time change; file is still transferred at 6:00am after the time change. We did the same config change twice on Nov 2010 and March 2011, no problems.

2. On hosting side, things usually are not transparent to us. We only know the file server is a Solaris. We requested to use "lsof" against a .nfsxxxx file, the result pointed to a kernel patch 144488-17 performed on Oct 16th.

Now no one admits it's their problem. My theory is that the kernel patch doesn't work correctly somehow after the time change but I can't prove it. I did review the patch detail but can't tell what could be the potential problem.

If anyone can help, I greatly appreciate.

Thanks in advance.
Max
# 2  
Old 11-27-2011
Is the hosted environment set to your timezone? You are on solaris 10 - that patch is for 10.

I have to deal with some hosted apps, it is a pain in the but because the B team on the other end answers most of the problems; doesn't know a patch from Christmas tree. That is why you had to spend days trying find the cause - you are guilty until proven innocent.

Join the club. Get your manager to escalate help on the other side - it seems like the problem is at least partly due to their system.

Is Verizon hosting your system? If so, you have my sympathies.

Last edited by jim mcnamara; 11-27-2011 at 12:39 PM..
# 3  
Old 11-27-2011
Hi Jim, thanks for sharing experience. It's not Verizon , but doesn't surprise me if hosting vendors have something in common. Well, if they can figure out the issue silently and suddenly problems disappear, I am completely fine with that. :-)
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Transfer file from a server takes long time

It takes 6 hrs for a 90 GB zip file that i am copying / transferring from serverA onto serverB. scp user1@serverA:/opt/setup/cash.zip . Output: cash.zip 21% 19GB 4.7MB/s 4:11:46 ETA uname -a SunOS serverB 5.11 11.2 sun4v sparc sun4vCan you please suggest if i could do... (11 Replies)
Discussion started by: mohtashims
11 Replies

2. Shell Programming and Scripting

How to change modification time of file?

Explain it with proper e.g (4 Replies)
Discussion started by: sidpatil
4 Replies

3. Shell Programming and Scripting

Create new file when time change

Hi, I have one script, which is tailing from a log file. And I want to separate the output in different files based on the timestamp. Something like that: ./script.sh >> log_`date '+%Y%m%d%H'`.log When I start the script it creates file, e.g. log_2013042314.log, and it is appending the... (6 Replies)
Discussion started by: apenkov
6 Replies

4. Shell Programming and Scripting

how to change modified time of a file

A files last modified time is like 03/02/2012 xx:xx:xx So what would be the command to convert the last modified in the given signature Thanks for giving time and replying..:) (2 Replies)
Discussion started by: ezee
2 Replies

5. UNIX for Advanced & Expert Users

2 File transfer problems since time change on Nov 6th

We are in a hosting environment.Everyday a FTP server on client side follows predefined schedules to get files from a file server on hosting side. On the file server, the files are originally saved in /data folder; after the remote FTP server gets them, the files will be moved to /archive... (1 Reply)
Discussion started by: madmax123
1 Replies

6. UNIX for Dummies Questions & Answers

File access time does not change on some files

Hey All, I want to get the access time of files in a directory. I used ls -lu on a directory and picked a file that had the access time of Mar 1 and used cat to get the contents of the file. Then I used the ls -lu again and the access time changed on that file. Perfect !! Now if I cat a... (10 Replies)
Discussion started by: vipulgupta0
10 Replies

7. Shell Programming and Scripting

Change time stamp of a file

Hi, As i know , we can change the time stamp of a file by touch command, i did change in a file and it is looking as given # ls -l abcd -rw-r--r-- 1 batsoqa sicusers 0 Feb 17 2010 abcd actually i want to see the output like this -rw-r--r-- 1 batsoqa sicusers ... (3 Replies)
Discussion started by: apskaushik
3 Replies

8. Shell Programming and Scripting

Execution Problems with scan and change file data content

Input file >Read_1 XXXXXXXXXXSDFXXXXXDS ASDRXXXXXTGAGTXXXXXT TGTGATXXXXXAXXXXGXXA . . Desired output file >Read_1 XXXXXXXXXXXXXXXXXXDS ASDRXXXXXTGAGTXXXXXT TGTGATXXXXXXXXXXXXXA . . (5 Replies)
Discussion started by: patrick87
5 Replies

9. UNIX for Dummies Questions & Answers

How to change the file modification time of a file on nfs mount point

Hi I am accessing a file on nfs mounted device, after completing using of the file, i am tring to restore the access time and modification times of the file. So i got the previous modified time of the file using stat() function and trying to set the date and time for the file, To set these... (6 Replies)
Discussion started by: deepthi.s
6 Replies

10. Shell Programming and Scripting

change the time stamp of file

can we change the timestamp of a file to old date. -rwxrwxrwx 1 root other 330 Jul 1 16:03 abc.txt it shows creation time is 16.03 can i change it to previous time :) (2 Replies)
Discussion started by: anish19
2 Replies
Login or Register to Ask a Question