LinkedIn Open-Sources IndexTank Search Technology

LinkedIn has just open-sourced the technology behind IndexTank under the Apache 2.0 License.

The IndexTank technology has three separate toolsets:
  • IndexEngine - A real-time fulltext search-and-indexing system designed to separate relevance signals from document text
  • API - A RESTful interface that handles authentication, validation, and communication with the IndexEngine(s)
  • Nebulizer - Multitenant framework to host and manage an unlimited number of indexes running over a layer of Infrastructure-as-a-Service
kinlane-productions2kinlane-productions2 An example of IndexTank in action is, Reddit, which runs on IndexEngine and the API.

They have the IndexTank Engine and IndexTank Service code published at Github, and created a LinkedIn Group to support it.