Optimizing frequent file transfer?


 
Thread Tools Search this Thread
Top Forums Programming Optimizing frequent file transfer?
# 1  
Old 07-18-2009
Optimizing frequent file transfer?

Hi

I have written a simple client/server(socket programming) application using TCP/IP. My server code runs on Linux and client is on windows. The concept is that the client request for files(on demand basis) to the server and the server sends it back to the client. As the client is attached to a graphics application, it demands the files as much frequent as possible (the frequency at which the files are requested is so high).

Actually, at server side, I am reading the requested file into a buffer and the buffer is sent through the socket using read() and write calls. My network bandwidth is 10Mbps.

I am not getting sufficient speed to my frequency of file reading which in turn causes my graphics application less interactive. Could u suggest something to increase the speed my transaction??

Thanks
# 2  
Old 07-18-2009
Is there a time gap between requesting for the file and rendering as a graphical application? In that case, you could try asynchronous calls there by caching the data or prefetching the data before being actually used or requested.
# 3  
Old 07-19-2009
There is no fixed gap between the file requests. It depends on how fast the user interacts with the graphical scene. And, as it is upto the user(at client side) where he would like to view the area/scene on overall graphics, it s not predictable to prefetch the file appropriate for scene.

One more thing is that I will get the file detail the moment he focus the area he likes. Then only I am making request to the server for the file.

Could sendfile() be good solution for this???
# 4  
Old 07-19-2009
Depending on the distance between server and client location, you might have to try local caching, storing the fetched data in a local cache, ( shared cache is needed? ) if there is a miss and use the cache data to display in graphics if that is a hit ( where data needed can be fetched from the local cache instead of server ) and data access can be greatly reduced! Just a thought.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

File transfer

When using FTP to transfer a file from IBM iSeries family of servers client to a non IBM Iseries family server, files might have characters appear in the wrong format Eg | in Iseries and while transferring fro Iseries system to Linux , but instead of | it is showing as ?. Please advise (3 Replies)
Discussion started by: sudhainit
3 Replies

2. Shell Programming and Scripting

Printing most frequent string in column

I am trying to put together an script that will output the most frequent string in a column. This is what I have: awk '{count++} END {for ( i in count ) print i, count }' Of course, my script is outputting all different strings and counts. However, I just need the most frequent one (there... (7 Replies)
Discussion started by: Xterra
7 Replies

3. Shell Programming and Scripting

Frequent words and trigraphs in text

Hello all, how to get the most 30 frequent words in text and the most frequent trigraphs (three character in same order in text )? note that : the text is none English text (Arabic text) so I will get the result as top 30 words abdbdns asddd wqwfqw top 30 trigraphs abc... (3 Replies)
Discussion started by: khaled79
3 Replies

4. Shell Programming and Scripting

Avoiding file overwrite during file transfer using scp

Hi, I have written a small script to transfer a file from one unix server to other using scp command which is working fine. As I know with scp, if any file with the same name is already present on destination server, it would get overwritten without any notification to user. Could anyone help me... (14 Replies)
Discussion started by: dsa
14 Replies

5. Solaris

Frequent crashes in ESXi virtual Solaris machine

Anybody have any ideas on what could be causing this crash? This an x86 virtual machine I have running in ESXi at my house, so obviously no way to send the data to Oracle for analysis. Just curious if anyone has any ideas. I suspect motherboard problems with the x86 hardware, as I already... (4 Replies)
Discussion started by: christr
4 Replies

6. Programming

File transfer in C

HI Can anyone provide me with codes for file transfer server to client or vice versa? Also please explain how to compile those programs in ubuntu terminal as i am totally new to socket programming. Thanks (0 Replies)
Discussion started by: mayhemtrigger
0 Replies

7. Shell Programming and Scripting

How to find frequent occurance of a word in a line?

File_source.DAT 1|abc|abc|abc|abc|abc 2|abc|abc|efg|efg|def 3|abc|bcd|cde|def|efg 4|abc|abc|abc|def|efg ========================= Please help me to solve this as below using UNIX. ========================= File_output.DAT "1"|"abc" - as... (3 Replies)
Discussion started by: scpyraj
3 Replies

8. Shell Programming and Scripting

How to select only the most frequent instances of a variable string in a file?

I've got a web access file that I want to grep (or awk or perl or whatever will work!) out the most frequent instances of unique IP entries. Meaning the file looks something like this: I'd like to run a sort or grep (or whatever) that will only select out the lines from IP's that had the... (7 Replies)
Discussion started by: kevinmccallum
7 Replies

9. Shell Programming and Scripting

File transfer

Hi All, it might not be an sound question, i have two server like A and B.. i want to transfer file from B to A ..here i have some questions.. 1) do we need to create private and public key to connect..and transferring files...from B to A..? 2) i tried with scp options like... (2 Replies)
Discussion started by: Shahul
2 Replies

10. UNIX for Dummies Questions & Answers

Transfer the file

Dear all, Can anybody let me know how to automate a file transfer process to a remote m/c thru SFTP , automate means it will not prmpt for password. how i am going to achive this....and what all methods are available or tools are available ???? (2 Replies)
Discussion started by: manas_ranjan
2 Replies
Login or Register to Ask a Question