Async webpage read

Tags

programming

Top Forums Programming Async webpage read

06-03-2013

Registered User

1, 0

Join Date: Apr 2009

Last Activity: 3 June 2013, 12:37 AM EDT

Posts: 1

Thanks Given: 0

Thanked 0 Times in 0 Posts

Async webpage read

hi

i need to asynchronous connect to webpage which has only text file. need to read its content, line by line using linux socket. any samples?

leo2008

View Public Profile for leo2008

Find all posts by leo2008

06-03-2013

Registered User

23,310, 4,623

Join Date: Aug 2005

Last Activity: 7 July 2020, 11:47 AM EDT

Location: Saskatchewan

Posts: 23,310

Thanks Given: 1,331

Thanked 4,623 Times in 4,217 Posts

Code:

wget -q -O - http://website/stuff.txt | while read LINE
do
        echo "got $LINE"
done

Corona688

View Public Profile for Corona688

Visit Corona688's homepage!

Find all posts by Corona688

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. AIX

Disable async IO at OS level

Hi , User claims that report refresh is taking longer time than usual time and asking us to disable async IO at OS level. 1 DB is running in this server This is prod server OS -- AIX My question is would there be an impact to database and server if we disable async IO in OS? is this...

2. UNIX for Dummies Questions & Answers

Read version from a webpage and Upgrading the file.

Hi, I am trying to read version from a web url like <url/daily-builds/sdk-3.2.v20140312170355-osx.zip> and download and store in my filesystem if its the latest. Kindly help me how to read version 3.2.v20140312170355 and compare same with a folder named similar in my directory and...

3. Shell Programming and Scripting

Read webpage from shell script

Hey experts, I am trying to read a webpage and want to search for a text patter (case insensitive). Please help me acquire this. If the text is found i will receive a mail which can be hardcoded in the script. I am not a big fan of using PERL script. Please help. Machine: AIX...

4. Solaris

see if async i/o is enabled in Solaris 9

Hi guys. This may be a stupid question but I am trying to see if my Solaris 9 server has async i/o enabled... Is there a quick way to determine this? Thanks in advance.

5. Programming

socket function to read a webpage (socket.h)

Why does this socket function only read the first 1440 chars of the stream. Why not the whole stream ? I checked it with gdm and valgrind and everything seems correct... #include <stdio.h> #include <stdlib.h> #include <sys/types.h> #include <sys/stat.h> #include <string.h> #include...

6. Red Hat

Difference between sync & async in nfs

Hi All.... This is related to exporting a file system through nfs. Just wanted to understand the significance of sync/async in nfs. We give this entry in /etc/export file. What is the difference between these two. Any hep is appreciated. Regards, Amol.

7. Programming

How to Write Linux Friendly Async Socket I/O

I am presently refactoring a windows deamon with an eye towards porting it to linux someday. Presently the application uses a single background thread and asynchronous socket I/O to implement FTP and HTTP clients in a single switch statement (2000 lines and 100 cases just for the switch...

8. Solaris

Async DNS request

Yes, really can't find anything about this. Can anyone suggest a way, how to do it? This is really what I need for. I need for may be list of system calls to read about or probably some C\C++ sources... Please, help...

9. UNIX for Dummies Questions & Answers

Async or Sync I/O on NFS ?

Solaris 2.8 I know regular filesystems use Async I/O on Solaris 2.8. Does anybody know if NFS uses Sync I/O or Async I/O ?

10. Shell Programming and Scripting

async vs sync shells

I am calling a shell script using PL/SQL stored procedures. This works great but I need the calls to be run synchronously and not asynchronously. I need the shell script to finish before returning control back to the procedure. Any ideas?

Programming