Need help for a newbie to stream tweets with the Terminal


 
Thread Tools Search this Thread
Special Forums UNIX and Linux Applications Need help for a newbie to stream tweets with the Terminal
# 1  
Old 03-31-2014
Question Need help for a newbie to stream tweets with the Terminal

Hey everyone,


First, I'm not sure whether I should have posted this thread under the basic Unix commands forum or not, so I apologize if this was not the best place to do so...


Then, as the title of this discussion suggests, I would like to stream specific tweets for research purposes (I am a PhD student (interested in linguistics, not computing... -.-')), and I first started learning a few basic things with Python, but I realized that it could (apparently) be possible with just the Terminal (I'm on Mac OS) and a program like Twurl (if I'm not mistaken), so I gave up Python, but thus far I have just been able to connect to Twitter via the command line, by using my API key and secret, but now I'm stuck and I can't figure out how to make requests to stream specific tweets according to key words, or geo-localization.
I have been spending the last three weeks learning the basics of the command line so that I can better understand how it works, but I still can't find a relatively recent tutorial which would be clear enough and basic enough for a complete newbie in computing to understand how to do that, so I desperately need help now, since I am working on streaming tweets for a research project, and the deadlines are now becoming more and more pressing... So my questions are:


1) I can connect to Twitter with the Terminal and Twurl by using my API key and secret, what is the next step?
2) How to make requests to extract tweets from specific cities and with specific key words?
3) How to start streaming?


Please try to be clear (at least in newbies' terms...) since all the topics I found on the Internet apparently assume a certain knowledge of programming basics, which I don't have and it is quite frustrating not to be able to understand why the commands don't work, or what to do to make it work, hence my need for clear explanations...


I thank you in advance for any help you may bring! Any advice would be invaluable at this point. Don't hesitate to tell me if you need any more info.


Best

Last edited by MichaelGauthier; 03-31-2014 at 09:37 AM..
# 2  
Old 04-01-2014
2) is a twitter question, but you could reverse engineer how by examining twitter pages that submit tweets. Generally it turns into an HTTP POST of some sort (GET is used for inquiry, POST for data entry). POSTing form data usually means encoding it into the data stream.
3) When your browser receives a twitter stream, it is driven by a script within the page, which can make new inquiries periodically to update the presentation. Reverse engineer those scripts.

Maybe there are friendlier Twitter APIs or tools you could use. twitter APIs OR tools - Google Search
# 3  
Old 04-01-2014
Thanks for the reply DGPickett, I was about to answer it myself actually, because I just found out how to do that myself, yay!!! ; )

So, for people who may be as incompetent in programming as me and to save them some time, the command you have to enter in the Terminal in order to start streaming tweets with specific key words is:

$ twurl -t -d track=keyword -H stream.twitter.com /1.1/statuses/filter.json

Of course you have to replace "keyword" by the word you wish to extract!

Now I'm working on adding a "locations" request to a "track" (which you use to extract certain keywords from tweets) request, so that I could extract tweets with specific key words from specific locations, but I can't figure out how for the moment, so anyone with a tip would be welcome!!!

Thanks again DGPickett, I appreciate the help!

Last edited by MichaelGauthier; 04-01-2014 at 04:50 PM.. Reason: just forgot to add some info
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Print Terminal Output Exactly how it Appears in the Terminal to a New Text File

Hello All, I have a text file containing output from a command that contains lots of escape/control characters that when viewed using vi or view, looks like jibberish. But when viewed using the cat command the output is formatted properly. Is there any way to take the output from the cat... (7 Replies)
Discussion started by: mrm5102
7 Replies

2. Shell Programming and Scripting

Cannot get terminal application to launch with a graphical launcher when successful in terminal

I have been having an extremely annoying problem. For the record, I am relatively new at this. I've only been working with unix-based OS's for roughly two years, mostly Xubuntu and some Kali. I am pretty familiar with the BASH language, as that's the default shell for debian. Now, I've made this... (16 Replies)
Discussion started by: Huitzilopochtli
16 Replies

3. Shell Programming and Scripting

[Video stream] network stream recording with mplayer

Hi I used this command: mplayer http://host/axis-cgi/mjpg/video.cgi -user root -passwd root \ -cache 1024 -fps 25.0 -nosound -vc ffh264 \ -demuxer 3 -dumpstream -dumpfile output.avi It's ok but... Video Playing is very fast! Why? Is it a synch problem? What parameter I have to use for... (1 Reply)
Discussion started by: takeo.kikuta
1 Replies

4. Linux

Terminal logging character problem -Newbie-

Im a complete newbie tryin to work with linux centos; in terminal wanted to log with script command; but output file has some strange characters when I try to open with gedit or bluefish terminal , gedit, bluefish encoding is utf-8 ; Script started on Mon 08 Mar 2010 03:32:39 PM EET... (2 Replies)
Discussion started by: anacondauser
2 Replies

5. OS X (Apple)

newbie looking for Terminal tutorials

I've just started learning about Unix and the Terminal in Mac OSX. I've found a few good starting resources, such as OSXFAQ - Technical News and Support for Mac OS X, but most of them are based on OSX 10.2 or thereabouts. Does anyone know of any good tutorials that specifically address Leopard? ... (1 Reply)
Discussion started by: mightypants
1 Replies

6. UNIX for Dummies Questions & Answers

UNIX newbie NEWBIE question!

Hello everyone, Just started UNIX today! In our school we use solaris. I just want to know how do I setup Solaris 10 not the GUI one, the one where you have to type the commands like ECHO, ls, pwd, etc... I have windows xp and I also have vmware. I hope I am not missing anything! :p (4 Replies)
Discussion started by: Hanamachi
4 Replies

7. UNIX for Dummies Questions & Answers

Run the start script from the terminal? Newbie Time!

Hi, How do I "run a script"? I'm trying to start up some software called ElectroServer 3, and was told I just needed to "run the start script from the terminal to get things going". From the terminal, i use cd command to change to the software's directory, and I guess the script in question is... (4 Replies)
Discussion started by: waking_bear
4 Replies

8. UNIX for Advanced & Expert Users

connecting to unix through hyper terminal - as a dumb terminal

I just changed from windows NT to XP and I am no longer able to connect to my unix system. I used to use hyper terminal -- which acts as dumb terminal to my main frame unix system. I think one of the options used to be "direct to comX". This option isn't listed now. I use a serial port and the... (2 Replies)
Discussion started by: michelle
2 Replies
Login or Register to Ask a Question