Trees | Index | Help |
---|
Module orchid :: Class OrchidFetcher |
|
object
--+ |_Verbose
--+ |Thread
--+ | OrchidFetcher
Method Summary | |
---|---|
Creates a new fetcher thread (not started) with the following | |
Returns the number of URLs this fetcher has handled. | |
Returns True if the fetcher hasn't been assigned a URL yet. | |
Performs the main function of the fetcher which is to fetch the contents of the url specified by setCurrentStringUrl. | |
Can receive either True or False. | |
Sets the url that the fetcher should work on. | |
Stores the given site and links in the databases | |
Fetches the url contents and creates a parsed structure | |
Inherited from Thread | |
| |
| |
| |
| |
| |
| |
| |
| |
| |
Inherited from _Verbose | |
| |
Inherited from object | |
x.__delattr__('name') <==> del x.name | |
x.__getattribute__('name') <==> x.name | |
x.__hash__() <==> hash(x) | |
T.__new__(S, ...) -> a new object with type S, a subtype of T | |
helper for pickle | |
helper for pickle | |
x.__setattr__('name', value) <==> x.name = value | |
x.__str__() <==> str(x) |
Class Variable Summary | |
---|---|
Inherited from Thread | |
bool |
_Thread__initialized = False
|
Method Details |
---|
__init__(self,
siteQueue,
siteQueueCond,
fetcherCondition,
stopConditionLock)
Creates a new fetcher thread (not started) with the following
|
getUrlsCounter(self)Returns the number of URLs this fetcher has handled. Should be called only AFTER the thread is dead. |
isFree(self)Returns True if the fetcher hasn't been assigned a URL yet. |
run(self)Performs the main function of the fetcher which is to fetch the contents of the url specified by setCurrentStringUrl. This method loops until the stop condition is set.
|
setStopCondition(self, val)Can receive either True or False. Set to Ture when the fetcher should stop working. WARNING: It's *necessary* to acquire the lock which was passed to the constructor as stopConditionLock before calling this method. |
setUrl(self, stringUrl)Sets the url that the fetcher should work on. It's *necessary* to acquire the condition instance which was passed to the constructor as fetcherCondition before calling this method and call notify afterwards |
__fileData(self, s, links)Stores the given site and links in the databases |
__processSite(self)Fetches the url contents and creates a parsed structure |
Trees | Index | Help |
---|
Generated by Epydoc 2.1 on Mon Dec 12 14:30:34 2005 | http://epydoc.sf.net |