com.lucidworks.fusion.connector.plugin.api.fetcher

Interface Fetcher<StartContextT extends FetcherContext.StartContext,PreFetchContextT extends FetcherContext.PreFetchContext,FetchContextT extends FetcherContext.FetchContext,PostContextT extends FetcherContext.PostFetchContext,StopContextT extends FetcherContext.StopContext>

All Superinterfaces:

Component

All Known Subinterfaces:

AccessControlFetcher, ContentFetcher

public interface Fetcher<StartContextT extends FetcherContext.StartContext,PreFetchContextT extends FetcherContext.PreFetchContext,FetchContextT extends FetcherContext.FetchContext,PostContextT extends FetcherContext.PostFetchContext,StopContextT extends FetcherContext.StopContext>
extends Component

The Fetcher is one of the primary interfaces within the Lucidworks Connector SDK. As its name implies, it is responsible for fetching data. Within this interface, there are a variety of methods that can emit data, and all of this is done asynchronously. The Fetcher also follows an explicit lifecycle, which is executed by a FetcherController. The lifecycle is as follows:

start() for-each-phase: startFetcher() for-each-fetch-input: fetch() end-for-each-fetch-input postFetch() end-for-each-phase stop()

Phases allow a Connector to define processing steps. For example, PhaseA might be responsible for fetching content IDs from a large content repository. PhaseB might then handle fetching the actual binary content for the items emitted from PhaseA. By breaking up the overall fetch into multiple Phases, more flexible crawling strategies are possible.

Method Summary

Modifier and Type	Method and Description
default FetchResult	fetch(FetchContextT context)
default PostFetchResult	postFetch(PostContextT context)
default PreFetchResult	preFetch(PreFetchContextT context)
default StartResult	start(StartContextT context)
default StopResult	stop(StopContextT context)

Method Detail

start

default StartResult start(StartContextT context)

preFetch

default PreFetchResult preFetch(PreFetchContextT context)

fetch

default FetchResult fetch(FetchContextT context)

postFetch

default PostFetchResult postFetch(PostContextT context)

stop

default StopResult stop(StopContextT context)