|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectjava.lang.Thread
Spider
Object used to search the web (or a subset of given domains) for a list of keywords
Nested Class Summary | |
class |
Spider.SpiderParserCallback
Inner class used to html handle parser callbacks |
Field Summary |
Fields inherited from class java.lang.Thread |
MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY |
Constructor Summary | |
Spider(javax.swing.JTree atree,
javax.swing.JTextArea amessagearea,
javax.swing.JLabel astatlabel,
java.lang.String astartsite,
java.lang.String[] akeywordlist,
java.lang.String[] aipdomainlist,
int asitelimit,
int adepthlimit)
Creates a new instance of Spider |
Method Summary | |
boolean |
depthLimitExceeded(javax.swing.tree.DefaultMutableTreeNode node)
Check depth of search |
static java.lang.String |
fixHref(java.lang.String href)
repairs a sloppy href, flips backwards /, adds missing / |
void |
run()
start running the search in a new thread |
void |
searchWeb(javax.swing.tree.DefaultMutableTreeNode parentnode,
java.lang.String urlstr)
recursive routine to search the web |
void |
stopSearch()
Stops the search. |
boolean |
urlHasBeenVisited(java.lang.String urlstring)
search the url search tree to see if we've already visited the specified url |
Methods inherited from class java.lang.Thread |
activeCount, checkAccess, countStackFrames, currentThread, destroy, dumpStack, enumerate, getContextClassLoader, getName, getPriority, getThreadGroup, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setName, setPriority, sleep, sleep, start, stop, stop, suspend, toString, yield |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Constructor Detail |
public Spider(javax.swing.JTree atree, javax.swing.JTextArea amessagearea, javax.swing.JLabel astatlabel, java.lang.String astartsite, java.lang.String[] akeywordlist, java.lang.String[] aipdomainlist, int asitelimit, int adepthlimit)
atree
- JTree used to display the search spaceamessagearea
- JTextArea used to display error/warning messagesastatlabel
- JLabel to display number of searched sites and hitsakeywordlist
- list of keywords to search foraipdomainlist
- list of top level domainsasitelimit
- maximum number of web pages to look atadepthlimit
- maximum number of levels down to search (controls recursion)astartsite
- web site to use to start the searchMethod Detail |
public void run()
public boolean urlHasBeenVisited(java.lang.String urlstring)
urlstring
- url to search for
public boolean depthLimitExceeded(javax.swing.tree.DefaultMutableTreeNode node)
node
- search tree node to test the depth limit of
public static java.lang.String fixHref(java.lang.String href)
href
- web site reference
public void searchWeb(javax.swing.tree.DefaultMutableTreeNode parentnode, java.lang.String urlstr)
parentnode
- parentnode in the search treeurlstr
- web page address to searchpublic void stopSearch()
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |