Retreiving live data


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Retreiving live data
# 1  
Old 08-08-2007
Question Retreiving live data

I have a stream of data come to a server and store in a file (datafile). This stream of data contain a lot of information. Data could come in every second or different frequency of times.

I like to retrieve a certain text string as the data come in. All data information will come with the time stamp (year-month-date-hour-minute-second). Let's say that I want to retreive the text string "yes, this is yet!" What would be the best way to do this? I have some like this in mind and I am looking for more input.

#!/bin/ksh
DAY=`date +%y%m%d`
H=`date +%H`
M=`date +%M`
S=`date +%S`
while read datafile
do
grep "$DAY-$H-$M-$S" | cgrep "yes, this is yet" > filewithdata-$H-$M-$S
done

I am looking for an un-ending-whileloop that will give me the text string I want and write it to a file with Hour-Minute-Second time stamp for that file.

Please advise
# 2  
Old 08-09-2007
I think that this script will do the trick, just start the script like
Code:
for ((;;)); do your-script.sh; sleep 5; done &

- this will call the script every five seconds. There may be other approaches too, but that's what I have in mind now. HTH.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. What is on Your Mind?

Update: UserCP Screeching Frog 0.7641 - Changed Live Chat to Live Updates

Update: UserCP Screeching Frog 0.7641 - Changed Live Chat to Live Updates In this version of the UserCP, I have changed "Live Chat" to "Live Updates" by disabling the ability to post in the "live chat" area and changed the name to "Live Updates" The reason for this change is that experienced... (6 Replies)
Discussion started by: Neo
6 Replies

2. Shell Programming and Scripting

Matching and retreiving numbers

Hi, I have one file 1.txt with one field consist of following Ids (shortlisted 10 but showing 3 here): 00052 00184 00607 and then second file 2.txt with three fields (very big file): 00052 00184 12.73062 00052 00598 13.51205 00052 00599 13.92554 00052 00600 13.73358... (2 Replies)
Discussion started by: bioinfo
2 Replies

3. Shell Programming and Scripting

Retreiving part of a mail ID

Hi all, I want to retrieve a part of the mail ID. Im using Ksh. The mail ID's i handle are of the type: abc.def@ghi.com I want the abc part alone. Here is the code i used: a=`echo $mailid |sed 's/\(.*\)..../\1/'` echo $a but the output i get is abc.def@ghi I dont know... (2 Replies)
Discussion started by: Jayaraman
2 Replies

4. Shell Programming and Scripting

Help needed in retreiving records from Oracle

Hello, I am new to UNIX. My Requirement: Need to connect to Oracle database from UNIX and execute an SELECT statement and store the records in a flatfile of Comma delimiter. What I have Succeeded: I was able to connect to Oracle from UNIX. Problem: I cannot fetch multiple... (3 Replies)
Discussion started by: arunvasu2
3 Replies

5. UNIX for Dummies Questions & Answers

Help with retreiving files' information stored in different directories.

Dear All, I have a question. I have similarly named files stored in different directories and I'd like to retreive information from them remotely to perform other tasks. For example given: Folder 5 has files S5_SK1.chr01 S5_SK1.chr02 ....... Folder 6 has files S6_SK1.chr01 ... (3 Replies)
Discussion started by: pawannoel
3 Replies

6. UNIX for Dummies Questions & Answers

retreiving file name in a variable on ftp

Hi , I need to retreive the file name in an variable on the ftp server.Can you guy please let me know how can i do that.I need some thing like connect to ftp <<eof new_variable=`ls *_1_AUDIT.txt *_2_AUDIT.txt` (but on a ftp server) mget $new_variable >>eof (1 Reply)
Discussion started by: Param0073
1 Replies

7. Shell Programming and Scripting

Retreiving information from a text file

Hey guys, i just started shell programming and i have a question. I am working on a simple inventory project and one of the problems which i am unable to solve would be how i am going to extract the data i need from a text file(which will be my database) and then put it inside the executable to be... (5 Replies)
Discussion started by: gregarion
5 Replies

8. UNIX for Dummies Questions & Answers

Retreiving and storing date...

First of all want to apologize for such a simple question. Very "new" to UNIX and have just taken a small intro class. I need to pull back YYYYMMDD and store it in a field to be used later. I figured out date "+%Y%m%d" returns the date in that format, just not sure how to store it. I am... (7 Replies)
Discussion started by: cards0622
7 Replies

9. Shell Programming and Scripting

Piped open not real-time - How would one handle live data?

When I run "/etc/myApp" I am presented with continuous output, just about once per second. However when I try to get the information in Perl via a piped open, it waits till the end to give me anything... my code: open (OUTPUT,"/etc/myApp |"); while (<OUTPUT>){ print $_; }... (2 Replies)
Discussion started by: jjinno
2 Replies

10. UNIX for Dummies Questions & Answers

Retreiving environment variable from remote system

I am trying to write a short block of code that takes a partial filename as input from the command line, then searches multiple remote servers for any file that matches the pattern. If the pattern is found, I would like to return the value of an environment variable from the *remote* server. ... (0 Replies)
Discussion started by: bschnair
0 Replies
Login or Register to Ask a Question