public interface Fetcher<StartContextT extends FetcherContext.StartContext,PreFetchContextT extends FetcherContext.PreFetchContext,FetchContextT extends FetcherContext.FetchContext,PostContextT extends FetcherContext.PostFetchContext,StopContextT extends FetcherContext.StopContext> extends Component
start() for-each-phase: startFetcher() for-each-fetch-input: fetch() end-for-each-fetch-input postFetch() end-for-each-phase stop()
Phases allow a Connector to define processing steps. For example, PhaseA might be responsible for fetching content IDs from a large content repository. PhaseB might then handle fetching the actual binary content for the items emitted from PhaseA. By breaking up the overall fetch into multiple Phases, more flexible crawling strategies are possible.
| Modifier and Type | Method and Description |
|---|---|
default FetchResult |
fetch(FetchContextT context) |
default PostFetchResult |
postFetch(PostContextT context) |
default PreFetchResult |
preFetch(PreFetchContextT context) |
default StartResult |
start(StartContextT context) |
default StopResult |
stop(StopContextT context) |
default StartResult start(StartContextT context)
default PreFetchResult preFetch(PreFetchContextT context)
default FetchResult fetch(FetchContextT context)
default PostFetchResult postFetch(PostContextT context)
default StopResult stop(StopContextT context)