Write Speed into a big file (in Gb's)


 
Thread Tools Search this Thread
Special Forums Hardware Filesystems, Disks and Memory Write Speed into a big file (in Gb's)
# 1  
Old 01-20-2009
Write Speed into a big file (in Gb's)

If a file size increases in Linux/UNIX to say in GB's then will there be a decrease in write speed.
I mean will it take more time to write to a large file then to a small one??

Please clarify?

Thanks in advance
# 2  
Old 01-20-2009
Let's assume an average write speed of 50MB/s. A file with 10KB will take about 0.0002 seconds to write, whereas a file with 50 GB will need about 17 minutes. So yes, it will take more time to write a large file than a small one.
But if you mean if it takes more time to change a large file than a smaller one, that depends more on the structure and the program accessing it than the filesystem/OS. As an example, mmap()-ing a small file is very fast, but with large files you'll run into problems quickly. On the other hand, accessing data that's stored as a binary tree, with an application optimized for it, is almost always quicker than a linear search through a smaller file (O(log n) vs O(n))
# 3  
Old 01-20-2009
Thanks Pludi..it makes sense..
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Speed : awk command to count the occurrences of fields from one file present in the other file

Hi, file1.txt AAA BBB CCC DDD file2.txt abc|AAA|AAAabcbcs|fnwufnq bca|nwruqf|AAA|fwfwwefwef fmimwe|BBB|fnqwufw|wufbqw wcdbi|CCC|wefnwin|wfwwf DDD|wabvfav|wqef|fwbwqfwfe i need the count of rows of file1.txt present in the file2.txt required output: AAA 2 (10 Replies)
Discussion started by: mdkm
10 Replies

2. Hardware

Hardware Correction: How to change DVD write speed

I am now on Kernel 2.6.32-26 For me 16x CD write speed is okay. I have old hardware which was able to write DVDs at 1x, back in previous linux version. Now, I dont get speed of less than 4x. Tested on k3b, xfburn, and brasero. But all start at bottom 4x write speed. k3b forced back to... (0 Replies)
Discussion started by: makh
0 Replies

3. UNIX for Dummies Questions & Answers

Find the file which is growing at high speed

Hi, A log file which is growing at high speed, don't know the name of it. How to find the respective file? Many thanks. (2 Replies)
Discussion started by: venkatesht
2 Replies

4. Filesystems, Disks and Memory

Disk read and write speed.

Being a novice user to linux i m little unaware of how would i check disk read write speed. One of my mate is suggesting to create a file using dd command and check how much time it takes to create a 30 gb file . I think this has a little sense however i would also like to take your reviews... (5 Replies)
Discussion started by: pinga123
5 Replies

5. UNIX for Dummies Questions & Answers

How big is too big a config.log file?

I have a 5000 line config.log file with several "maybe" errors. Any reccomendations on finding solvable problems? (2 Replies)
Discussion started by: NeedLotsofHelp
2 Replies

6. Filesystems, Disks and Memory

data from blktrace: read speed V.S. write speed

I analysed disk performance with blktrace and get some data: read: 8,3 4 2141 2.882115217 3342 Q R 195732187 + 32 8,3 4 2142 2.882116411 3342 G R 195732187 + 32 8,3 4 2144 2.882117647 3342 I R 195732187 + 32 8,3 4 2145 ... (1 Reply)
Discussion started by: W.C.C
1 Replies

7. Filesystems, Disks and Memory

dmidecode, RAM speed = "Current Speed: Unknown"

Hello, I have a Supermicro server with a P4SCI mother board running Debian Sarge 3.1. This is the "dmidecode" output related to RAM info: RAM speed information is incomplete.. "Current Speed: Unknown", is there anyway/soft to get the speed of installed RAM modules? thanks!! Regards :)... (0 Replies)
Discussion started by: Santi
0 Replies

8. UNIX for Dummies Questions & Answers

How to view a big file(143M big)

1 . Thanks everyone who read the post first. 2 . I have a log file which size is 143M , I can not use vi open it .I can not use xedit open it too. How to view it ? If I want to view 200-300 ,how can I implement it 3 . Thanks (3 Replies)
Discussion started by: chenhao_no1
3 Replies
Login or Register to Ask a Question