Uses of Interface
us.codecraft.webmagic.Task

Packages that use Task

Package	Description
us.codecraft.webmagic	Main class "Spider" and models.
us.codecraft.webmagic.downloader	Downloader is the part that downloads web pages and store in Page object.
us.codecraft.webmagic.pipeline	Pipeline is the persistent and offline process part of crawler.
us.codecraft.webmagic.proxy
us.codecraft.webmagic.scheduler	Scheduler is the part of url management.
us.codecraft.webmagic.scheduler.component	Component of scheduler.

Uses of Task in us.codecraft.webmagic

Classes in us.codecraft.webmagic that implement Task

Modifier and Type	Class and Description
class	Spider Entrance of a crawler. A spider contains four modules: Downloader, Scheduler, PageProcessor and Pipeline. Every module is a field of Spider.

Methods in us.codecraft.webmagic that return Task

Modifier and Type	Method and Description
Task	Site.toTask()

Uses of Task in us.codecraft.webmagic.downloader

Methods in us.codecraft.webmagic.downloader with parameters of type Task

Modifier and Type	Method and Description
Page	HttpClientDownloader.download(Request request, Task task)
Page	Downloader.download(Request request, Task task) Downloads web pages and store in Page object.
protected Page	HttpClientDownloader.handleResponse(Request request, java.lang.String charset, org.apache.http.HttpResponse httpResponse, Task task)

Uses of Task in us.codecraft.webmagic.pipeline

Methods in us.codecraft.webmagic.pipeline with parameters of type Task

Modifier and Type	Method and Description
void	Pipeline.process(ResultItems resultItems, Task task) Process extracted results.
void	ConsolePipeline.process(ResultItems resultItems, Task task)
void	ResultItemsCollectorPipeline.process(ResultItems resultItems, Task task)
void	FilePipeline.process(ResultItems resultItems, Task task)

Uses of Task in us.codecraft.webmagic.proxy

Methods in us.codecraft.webmagic.proxy with parameters of type Task

Modifier and Type	Method and Description
Proxy	ProxyProvider.getProxy(Task task) Get a proxy for task by some strategy.
Proxy	SimpleProxyProvider.getProxy(Task task)
void	ProxyProvider.returnProxy(Proxy proxy, Page page, Task task) Return proxy to Provider when complete a download.
void	SimpleProxyProvider.returnProxy(Proxy proxy, Page page, Task task)

Uses of Task in us.codecraft.webmagic.scheduler

Methods in us.codecraft.webmagic.scheduler with parameters of type Task

Modifier and Type	Method and Description
int	QueueScheduler.getLeftRequestsCount(Task task)
int	MonitorableScheduler.getLeftRequestsCount(Task task)
int	PriorityScheduler.getLeftRequestsCount(Task task)
int	QueueScheduler.getTotalRequestsCount(Task task)
int	MonitorableScheduler.getTotalRequestsCount(Task task)
int	PriorityScheduler.getTotalRequestsCount(Task task)
Request	QueueScheduler.poll(Task task)
Request	Scheduler.poll(Task task) get an url to crawl
Request	PriorityScheduler.poll(Task task)
void	DuplicateRemovedScheduler.push(Request request, Task task)
void	Scheduler.push(Request request, Task task) add a url to fetch
void	QueueScheduler.pushWhenNoDuplicate(Request request, Task task)
protected void	DuplicateRemovedScheduler.pushWhenNoDuplicate(Request request, Task task)
void	PriorityScheduler.pushWhenNoDuplicate(Request request, Task task)

Uses of Task in us.codecraft.webmagic.scheduler.component

Methods in us.codecraft.webmagic.scheduler.component with parameters of type Task

Modifier and Type	Method and Description
int	DuplicateRemover.getTotalRequestsCount(Task task) Get TotalRequestsCount for monitor.
int	HashSetDuplicateRemover.getTotalRequestsCount(Task task)
boolean	DuplicateRemover.isDuplicate(Request request, Task task) Check whether the request is duplicate.
boolean	HashSetDuplicateRemover.isDuplicate(Request request, Task task)
void	DuplicateRemover.resetDuplicateCheck(Task task) Reset duplicate check.
void	HashSetDuplicateRemover.resetDuplicateCheck(Task task)