Login or Register to Ask a Question and Join Our Community


Web Development

Search Engine

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Web Development Search Engine
# 1  
Old 01-05-2011
Java Search Engine
Hey guys. I have a quick question. My friends and I are working on a search engine project that will hopefully be up and running by December of 2011. Here's my concern. What programs should I use to create the search engine. [Note: I have already been recommended to use PHP.] Thanks guys! Smilie
# 2  
Old 01-05-2011
PHP is just part of the web front end. What sort of data do you have to search? I made a front end for CScope so I could search files and source code, for instance. You could grep -E / fgrep in files, display hits, display clicked hit files. Is there an open source Google out there? Probably not, or just a primitive early version !
# 3  
Old 01-05-2011
Thanks for replying. I actually don't want to search "files". However, I want to search the internet. [Nothing complex. Just being able to find links works for me!] Any ideas?
# 4  
Old 01-07-2011
I'd say you need (at least) 3 components:
  1. A crawler that downloads pages, and follows links on those pages.
  2. An indexer that builds a list of words used on each page (maybe in relation to other words nearby), and saves that to a database.
  3. A front-end to query the database.
For the crawler you can use just about any language since the main limitation is the network speed. For the indexer I'd recommend either C/C++ (for speed) or a language geared towards natural language processing (like Perl). For the front-end you can again choose whatever language you're comfortable with.
# 5  
Old 01-07-2011
Why write when you can download (and if necessary modify and contribute)?

List of search engines - Wikipedia, the free encyclopedia

Search Tools with Open Source Code

A Comparison of Free Search Engine Software by Yiling Chen on SearchTools.com
# 6  
Old 01-08-2011
Thank you to Pludi and DG Pickett. I want to write. though.

---------- Post updated at 01:15 AM ---------- Previous update was at 01:13 AM ----------

Can anyone link the software I need?
# 7  
Old 01-08-2011
What do you mean by "I want to write though"? And you have to decide what software you'll need. If you want to use a scripting language you'll need the interpreter for that. If you want to use C/C++ you'll need a compiler for that.

Let me ask you a question: have you, as of now, written a program more complex than a Fibonacci number calculator before?
Login or Register to Ask a Question

Previous Thread | Next Thread

5 More Discussions You Might Find Interesting

1. What is on Your Mind?

YouTube: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search

Getting a bit more comfortable making quick YT videos in 4K, here is: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search Console https://youtu.be/I6b9T2qcqFo (0 Replies)
Discussion started by: Neo
0 Replies

2. Homework & Coursework Questions

About search engine in unix

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: How to create a search engine in unix using commands?...Atleast guidelines to craete this search engine...Thank... (1 Reply)
Discussion started by: Sindhu R
1 Replies

3. Shell Programming and Scripting

About search engine in unix

Hello, How to create a search engine in unix using commands?...Atleast guidelines to craete this search engine...Thank you in advance. (10 Replies)
Discussion started by: Sindhu R
10 Replies

4. Programming

Search Engine in C

Hello everybody, I need help with this, I need to design a CGI search engine in C but i have no idea on what or how to do it. Do i have to open all the html files one by one and search for the given strings? i think this process will be slow, and will take too much of the server processing... (11 Replies)
Discussion started by: semash!
11 Replies

5. Shell Programming and Scripting

Search Engine

How do you write a search engline to search offline scripts? (3 Replies)
Discussion started by: hawaiifiver
3 Replies
Login or Register to Ask a Question