Aspire for Hadoop Components (Aspire 2)

From wiki.searchtechnologies.com
Jump to: navigation, search

For Information on Aspire 3.1 Click Here

Aspire provides a list of components to interact with or work inside of Hadoop.

Publish to HDFS Aspire Components

Aspire for Hadoop Components

  • Feature only available with Aspire Enterprise  Emit
    • Use this stage to write a key and the AspireObject of the incoming job to the Hadoop context
  • Feature only available with Aspire Enterprise  Reducer Subjob Extractor
    • From a Reduce job, for every AspireObjectWritable entry associated with the key, creates a subjob with the embedded AspireObject

Hadoop Map Reduce Job

  • Feature only available with Aspire Enterprise  Aspire Hadoop Map Reduce Job
    • A generic Hadoop Job Driver that can be configured to execute map, reduce or/and combine tasks using Aspire pipelines.

HDFS Utilities

Hadoop Solutions

  • Feature only available with Aspire Enterprise  Semantic Co-occurrence Solution
    • The co-occurrence or collocation of words to form short phrases (2-4 words) can be useful in tagging content and performing query enhancement by adding a level of meaning to these phrases and therefore improved relevancy for result sets.