Sponsored Content
Full Discussion: Search Engine
Top Forums Web Development Search Engine Post 302519977 by DGPickett on Thursday 5th of May 2011 01:52:12 PM
Old 05-05-2011
You want a data structure that expands, updates, deletes in a other-user-invisible way, like leaf-to-root modification. Users coming down the old tree are not bothered by new trees you build to replace, or new subtrees.

A lot of code and though goes into dealing with kill-words, words and phrases that happen so often you never want to index them. You can discover them as they hit a threshold, or just trim them as needed for space.

JAVA using persistent objects may work well for this. You might want to make your own persistent objects out of map'd flat files.
 

5 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Search Engine

How do you write a search engline to search offline scripts? (3 Replies)
Discussion started by: hawaiifiver
3 Replies

2. Programming

Search Engine in C

Hello everybody, I need help with this, I need to design a CGI search engine in C but i have no idea on what or how to do it. Do i have to open all the html files one by one and search for the given strings? i think this process will be slow, and will take too much of the server processing... (11 Replies)
Discussion started by: semash!
11 Replies

3. Shell Programming and Scripting

About search engine in unix

Hello, How to create a search engine in unix using commands?...Atleast guidelines to craete this search engine...Thank you in advance. (10 Replies)
Discussion started by: Sindhu R
10 Replies

4. Homework & Coursework Questions

About search engine in unix

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: How to create a search engine in unix using commands?...Atleast guidelines to craete this search engine...Thank... (1 Reply)
Discussion started by: Sindhu R
1 Replies

5. What is on Your Mind?

YouTube: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search

Getting a bit more comfortable making quick YT videos in 4K, here is: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search Console https://youtu.be/I6b9T2qcqFo (0 Replies)
Discussion started by: Neo
0 Replies
WEBSEARCH(1p)						User Contributed Perl Documentation					     WEBSEARCH(1p)

NAME
WebSearch - a web-searching application demonstrating WWW::Search SYNOPSIS
WebSearch [-m MaxCount] [-e SearchEngine] [-o option] [-o option...] [-ardvV] query DESCRIPTION
This program is provides a command-line interface to web search engines, listing all URLs found for a given query. This program also provides a simple demonstration of the WWW::Search Perl library for web searches. The program supports a number of search engines; use WebSearch --list to see which backends are installed. A more sophisticated client is AutoSearch which maintains a change list of found objects. For examples and hints about searches, see AutoSearch. OPTIONS
WebSearch uses Getopt::Long, so you can use double-minus with long option names, or single-minus with one-letter abbreviations. --engine e_name, -e e_name The string e_name is the name of (the module for) the desired search engine. Capitalization matters. See `perldoc WWW::Search` to find out what the default is (probably Null). Use --list to get a list of installed backends. --gui, -g Perform the search to mimic the default browser-based search. Not implemented for all backends, see the documentation for each backend. --list Prints to STDERR a -separated list of installed backends. --max max_count, -m max_count Specify the maximum number of hits to retrieve. --option o_string, -o o_string Specify a search-engine option in the form 'key=value' (or just 'key'). Can be repeated for as many options are needed. Keys can be repeated. --count, -c As the first line of output, print the approximate hit count. As the last line of output, print the actual hit count. --terse, -t Do not print any URLs. Only useful if you also specify --count. If you specify --terse but not --count, there will be no output no matter how many hits are found! --all, -a For each hit result, print all the URLs that the search engine indicated were equivalent to it. (Some URLs may refer to the same object.) Can be combined with --verbose; can not be combined with --raw. --raw, -r For each hit result, print the raw HTML. Not implemented for all backends. --verbose, -v Verbose mode. Enumerate the returned URLs and show the description, score, date, etc. for each. --VERSION, -V Print version information and exit immediately. --debug <i>, -d <i> Display back-end debugging information (with debug level <i>) --host <hostname.sub.domain> Set the _host option for the WWW::Search object (backend-dependent). --port <i> Set the _port option for the WWW::Search object (backend-dependent). --username <bbunny> Set the username with which to login to the backend. --password <c4rr0t5> Set the password with which to login to the backend. --lwpdebug, -l Display low-level libwww-perl debugging information ENVIRONMENT VARIABLES
The environment variable http_proxy (or HTTP_PROXY) specifies a proxy, if any. SEE ALSO
For the library, see WWW::Search. For a more sophisticated client, see AutoSearch. AUTHOR
"WebSearch" was written by John Heidemann, <johnh@isi.edu>. "WebSearch" is maintained by Martin Thurn, <mthurn@cpan.org>. COPYRIGHT
Copyright (c) 1996-1997 University of Southern California. All rights reserved. Redistribution and use in source and binary forms are permitted provided that the above copyright notice and this paragraph are duplicated in all such forms and that any documentation, advertising materials, and other materials related to such distribution and use acknowledge that the software was developed by the University of Southern California, Information Sciences Institute. The name of the University may not be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED "AS IS" AND WITHOUT ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. perl v5.12.4 2011-10-25 WEBSEARCH(1p)
All times are GMT -4. The time now is 04:10 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy