Hey guys. I have a quick question. My friends and I are working on a search engine project that will hopefully be up and running by December of 2011. Here's my concern. What programs should I use to create the search engine. [Note: I have already been recommended to use PHP.] Thanks guys!
PHP is just part of the web front end. What sort of data do you have to search? I made a front end for CScope so I could search files and source code, for instance. You could grep -E / fgrep in files, display hits, display clicked hit files. Is there an open source Google out there? Probably not, or just a primitive early version !
A crawler that downloads pages, and follows links on those pages.
An indexer that builds a list of words used on each page (maybe in relation to other words nearby), and saves that to a database.
A front-end to query the database.
For the crawler you can use just about any language since the main limitation is the network speed. For the indexer I'd recommend either C/C++ (for speed) or a language geared towards natural language processing (like Perl). For the front-end you can again choose whatever language you're comfortable with.
What do you mean by "I want to write though"? And you have to decide what software you'll need. If you want to use a scripting language you'll need the interpreter for that. If you want to use C/C++ you'll need a compiler for that.
Let me ask you a question: have you, as of now, written a program more complex than a Fibonacci number calculator before?
Getting a bit more comfortable making quick YT videos in 4K, here is:
Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search Console
https://youtu.be/I6b9T2qcqFo (0 Replies)
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
How to create a search engine in unix using commands?...Atleast guidelines to craete this search engine...Thank... (1 Reply)
I need help with this,
I need to design a CGI search engine in C but i have no idea on what or how to do it.
Do i have to open all the html files one by one and search for the given strings? i think this process will be slow, and will take too much of the server processing... (11 Replies)