Sponsored Content
Top Forums Shell Programming and Scripting rsync from partition to partition fastest Post 302475240 by jaysunn on Saturday 27th of November 2010 11:22:06 AM
Old 11-27-2010
Hi Pludi,

The files are made up of a flat file database. The data is in a directory for each day of the month and they go back to 2008. The database is also binary so I cannot view the contents. Here is a listing for one day.


Code:
[rubedo@NYOTS01 20101126]$ ls -lah
total 1.3G
drwxr-xr-x   2 rubedo rubedo 3.8K Nov 27 00:27 .
drwxrwxr-x 971 rubedo rubedo 2.0K Nov 27 00:27 ..
-rw-r--r--   1 rubedo rubedo 1.3G Nov 27 00:27 data_unassigned
-rw-r--r--   1 rubedo rubedo 1.5M Nov 27 00:27 index
-rw-r--r--   1 rubedo rubedo  786 Nov 27 00:27 meta_data
-rw-r--r--   1 rubedo rubedo  83K Nov 27 00:27 symbols

Hope this helps with your diagnosing of the correct tool to use. Right now I have been running rsync and we are only in the month of March from 2008 and I have to go to present.

jaysunn

---------- Post updated at 11:22 AM ---------- Previous update was at 10:58 AM ----------

pludi,

Code:
rsync -av ...

This seems to be much faster. Thanks
jaysunn
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

partition

How do I create a new Disk partition in HP-unix machine??? (1 Reply)
Discussion started by: chakradharm
1 Replies

2. UNIX for Dummies Questions & Answers

partition

i have a second HD installed on my computer, which came partioned in 3 fragments..how do i get rid of the partitions... i dont know how to use F disk thanks:D (5 Replies)
Discussion started by: pops
5 Replies

3. UNIX for Dummies Questions & Answers

Partition

Hi, wondering if anyone can help a self teaching lad out....I want to partition my windows 2000 box and install Redhat 7.2 on it...I know how to get to the disk management section...but how do I make a new partition..I clicked on the icons and read the help but it is very hard to read for some... (4 Replies)
Discussion started by: jonas27
4 Replies

4. UNIX for Dummies Questions & Answers

understanding logical partition, physical partition

hi, 1) is logical partition the same as physical partition except that one is physical and the other is logical? 2) then it must a one to one ratio? (3 Replies)
Discussion started by: yls177
3 Replies

5. UNIX for Dummies Questions & Answers

I've created a partition with GNU Parted, how do I mount the partition?

I've created a partition with GNU Parted, how do I mount the partition? The manual information at http://www.gnu.org/software/parted/manual/parted.html is good, but I am sure about how I mount the partition afterwards. Thanks, --Todd (1 Reply)
Discussion started by: jtp51
1 Replies

6. Linux

Partition

Why the hard drive can only have 4 primary partition. If i want do more, what should i do? (3 Replies)
Discussion started by: RaNoNeR
3 Replies

7. Solaris

Partition overlaps another partition while creating new parition in solaris

hi all while formatting hard disk i am getting following error. Partition 1 ends at 266338338 It must be between 34 and 143374704. label error: EFI Labels do not support overlapping partitions Partition 8 overlaps partition 1. Warning: error writing EFI. Label failed. I have formatted the... (2 Replies)
Discussion started by: nikhil kasar
2 Replies

8. UNIX for Dummies Questions & Answers

Partition

Hi, Can anyone explain me the concepts of partitioning and mounting in unix. As i am new to unix. Thanks, Manju (1 Reply)
Discussion started by: Kashyap
1 Replies

9. Filesystems, Disks and Memory

Ask concept soft partition vs hard partition

Hi Experts I would like to know different between soft partition concept and hard partition concept on solaris. Here is little explanation between soft partition concept and hard partition concept on solaris. Soft Partition: 1TB total space available in storage in all mapped to the OS to... (2 Replies)
Discussion started by: edydsuranta
2 Replies

10. Red Hat

Shrink LVM partition & create new Linux Primary partition

Hello All, I have a Red Hat Linux 5.9 Server installed with one hard disk & 2 Partitions created on it as follows, /boot - Linux Partition & another is LVM - One VG & under that 5-6 Logical volumes(var,opt,home etc). Here my requirement is to take out 1GB of space from LVM ( Any logical... (5 Replies)
Discussion started by: gr8_usk
5 Replies
curl_getdate(3)                                                   libcurl Manual                                                   curl_getdate(3)

NAME
curl_getdate - Convert a date string to number of seconds since January 1, 1970 SYNOPSIS
#include <curl/curl.h> time_t curl_getdate(char *datestring, time_t *now ); DESCRIPTION
This function returns the number of seconds since January 1st 1970 in the UTC time zone, for the date and time that the datestring parame- ter specifies. The now parameter is not used, pass a NULL there. NOTE: This function was rewritten for the 7.12.2 release and this documentation covers the functionality of the new one. The new one is not feature-complete with the old one, but most of the formats supported by the new one was supported by the old too. PARSING DATES AND TIMES
A "date" is a string containing several items separated by whitespace. The order of the items is immaterial. A date string may contain many flavors of items: calendar date items Can be specified several ways. Month names can only be three-letter english abbreviations, numbers can be zero-prefixed and the year may use 2 or 4 digits. Examples: 06 Nov 1994, 06-Nov-94 and Nov-94 6. time of the day items This string specifies the time on a given day. You must specify it with 6 digits with two colons: HH:MM:SS. To not include the time in a date string, will make the function assume 00:00:00. Example: 18:19:21. time zone items Specifies international time zone. There are a few acronyms supported, but in general you should instead use the specific relative time compared to UTC. Supported formats include: -1200, MST, +0100. day of the week items Specifies a day of the week. Days of the week may be spelled out in full (using english): `Sunday', `Monday', etc or they may be abbreviated to their first three letters. This is usually not info that adds anything. pure numbers If a decimal number of the form YYYYMMDD appears, then YYYY is read as the year, MM as the month number and DD as the day of the month, for the specified calendar date. EXAMPLES
Sun, 06 Nov 1994 08:49:37 GMT Sunday, 06-Nov-94 08:49:37 GMT Sun Nov 6 08:49:37 1994 06 Nov 1994 08:49:37 GMT 06-Nov-94 08:49:37 GMT Nov 6 08:49:37 1994 06 Nov 1994 08:49:37 06-Nov-94 08:49:37 1994 Nov 6 08:49:37 GMT 08:49:37 06-Nov-94 Sunday 94 6 Nov 08:49:37 1994 Nov 6 06-Nov-94 Sun Nov 6 94 1994.Nov.6 Sun/Nov/6/94/GMT Sun, 06 Nov 1994 08:49:37 CET 06 Nov 1994 08:49:37 EST Sun, 12 Sep 2004 15:05:58 -0700 Sat, 11 Sep 2004 21:32:11 +0200 20040912 15:05:58 -0700 20040911 +0200 STANDARDS
This parser was written to handle date formats specified in RFC 822 (including the update in RFC 1123) using time zone name or time zone delta and RFC 850 (obsoleted by RFC 1036) and ANSI C's asctime() format. These formats are the only ones RFC2616 says HTTP applications may use. RETURN VALUE
This function returns -1 when it fails to parse the date string. Otherwise it returns the number of seconds as described. If the year is larger than 2037 on systems with 32 bit time_t, this function will return 0x7fffffff (since that is the largest possible signed 32 bit number). Having a 64 bit time_t is not a guarantee that dates beyond 03:14:07 UTC, January 19, 2038 will work fine. On systems with a 64 bit time_t but with a crippled mktime(), curl_getdate will return -1 in this case. REWRITE
The former version of this function was built with yacc and was not only very large, it was also never quite understood and it wasn't pos- sible to build with non-GNU tools since only GNU Bison could make it thread-safe! The rewrite was done for 7.12.2. The new one is much smaller and uses simpler code. libcurl 7.0 12 Aug 2005 curl_getdate(3)
All times are GMT -4. The time now is 04:53 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy