File access:


 
Thread Tools Search this Thread
Top Forums Programming File access:
# 8  
Old 09-18-2008
Thanks Jim. Well i have to do evaluate buffer size for repeated random file access. im sorry but being a novice.. i dint get what your shell script does here?
# 9  
Old 09-18-2008
I am trying to randomly read a file from a simple C program, how can i clear cache from there before each read? any ideas?
# 10  
Old 09-18-2008
if you force OS to read big enough file[s] before running your program, the cache would become irrelevant. Under *nix you can say
wc -c some-big-files > /dev/null
so OS will read those files and pages from your file that your program reads will hopefully be eliminated from cache
# 11  
Old 09-19-2008
The post from jim mcnamara is a good demo showing the effect of buffer sizes on the time taken to read a large file. From the table it looks like 4kb is the optimal size for the buffer most likely because that is the system pagesize.

@jim:
The math doesn't add up for the last three rows of that table that is User + System != Elapsed...
Quote:
Originally Posted by jim mcnamara
Code:
Buffer: 262144  Reads:        628  Elapsed:  4.21 User:  0.37 System:  0.08
Buffer: 524288  Reads:        314  Elapsed:  3.79 User:  0.42 System:  0.08
Buffer: 1048576 Reads:        157  Elapsed:  3.24 User:  0.46 System:  0.07

The skewness introduced by caching can be offset to some extent by starting the program with the highest buffer size and reducing it at every step.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to access multiple file and operate on single file

We have three files as mentioned below: 1. main_file.txt: This is the file in which all operations will be done. Which means this file will be signed by using the below two files 2. signature_file.txt: This is a status file and contains two signatures. 3. command.txt:file contains two commands... (2 Replies)
Discussion started by: chetanojha
2 Replies

2. Proxy Server

How to use Squid on Linux to control certain IP to access Web Server and certain IP cannot access?

Dear all experts here, :) I would like to install a proxy server on Linux server to perform solely to control the access of Web server. In this case, some of my vendor asked me to try Squid and I have installed it onto my Linux server. I would like know how can I set the configuration to... (1 Reply)
Discussion started by: kwliew999
1 Replies

3. Solaris

samba read write access to owner and no access to other users

Hi All, I want to configure samba share permission so that only directory creator/owner has a read and write permission and other users should not have any read/write access to that folder.Will that be possible and how can this be achieved within samba configuration. Regards, Sahil (1 Reply)
Discussion started by: sahil_shine
1 Replies

4. UNIX for Dummies Questions & Answers

Access to a file

Hey friends, If a file has permissions 000, then who can access the file? (1 Reply)
Discussion started by: paras.oriental
1 Replies

5. IP Networking

Does my provider limit my internet access or somesites access?

Hi Good Day, i would like to ask for further info about my problems experiencing this evening. Im a PPP0 connection in the internet using 3G located in asia pacific region.i had this problem this evening in my INTERNET connections that there are some sites i can't open example ( Gizmodo.com,... (2 Replies)
Discussion started by: jao_madn
2 Replies

6. UNIX for Dummies Questions & Answers

kernel giving access for multiple users to access files

hi all, i want to know y kernel is giving access for multiple users to access a file when one user may be the owner is executing that file. Because other user can manipulate that file when the other user is executing that file, it will give the unexpected result to owner . plz help me... (1 Reply)
Discussion started by: jimmyuk
1 Replies

7. Programming

how to write Microsoft Access MDB file to a text file, using C ?

I'm in the UNIX environment. I'd like to read a Microsoft Access MDB file, and write the contents of that file into an ASCII text file. I want to write a C program to do this. Does anyone know if there's already source code out there that does this? Please advise. Thanks. (3 Replies)
Discussion started by: serendipity1276
3 Replies

8. Cybersecurity

file permission/acl: 2 users with write access on 1 file...

Hello, i need some help/advice on how to solve a particular problem. these are the users: |name | group | ---------- --------------- |boss | department1 | |assistant | department1 | |employee | department1 | |spy | department2 | this is the... (0 Replies)
Discussion started by: elzalem
0 Replies

9. Programming

[C++] File I/O (Reading from a Random-Access File)

INFO: The program should enter a circle radius and Id for that circle to a file, then it should search for that id and print the radius for that circle. PROBLEM: This program compiles but it's not searching properly. Circle.h #ifndef CIRCLE_H #define CIRCLE_H #include <iostream>... (0 Replies)
Discussion started by: VersEtreOuNe
0 Replies

10. UNIX for Dummies Questions & Answers

Need help to access/mount so to access folder/files on a Remote System using Linux OS

Hi I need to access files from a specific folder of a Linux system from an another Linux System Remotely. I know how to, Export a folder on One SCO System & can access the same by using Import via., NFS in the Sco Unix SVR4 System using the scoadmin utility. Also, I know to use mount -t ... (2 Replies)
Discussion started by: S.Vishwanath
2 Replies
Login or Register to Ask a Question