Ning-tr13

Library for building simple compact read-only Tries, for space-efficient access to large in-memory datasets.

Лицензия

Лицензия

Группа

Группа

com.ning
Идентификатор

Идентификатор

tr13
Последняя версия

Последняя версия

0.3.0
Дата

Дата

Тип

Тип

bundle
Описание

Описание

Ning-tr13
Library for building simple compact read-only Tries, for space-efficient access to large in-memory datasets.
Ссылка на сайт

Ссылка на сайт

http://github.com/ning/tr13
Организация-разработчик

Организация-разработчик

Ning.com
Система контроля версий

Система контроля версий

http://github.com/ning/tr13

Скачать tr13

Зависимости

test (1)

Идентификатор библиотеки Тип Версия
junit : junit jar 4.8.1

Модули Проекта

Данный проект не имеет модулей.

Purpose

Tr13 is a library for constructing and using read-only compact (memory-efficient) in-memory trie data structures, using raw (byte-sequences, byte[]) keys and values. Raw values can be automatically converted to/from basic JDK types such as java.lang.String. Resulting tries are "raw", in that they are stored as raw byte sequences (ByteBuffer, off-heap or in-heap, or byte[]), meaning that garbage-collection overhead should be minimal as the main data area is either off-heap (for native or mmap'ed ByteBuffers), or a single byte[].

Main benefits for using such tries is both relatively low memory usage (typically 20 - 35% less than raw input size) and low GC impact.

Development

Mailing list: http://groups.google.com/group/ning-tr13-users

Usage

Tries need to be built in lexicographic order, so pre-sorting may be needed. For that, you may want to check out Java Merge-sort project. Key and value types

Building is done in two steps:

  1. Construct raw trie structure in streaming fashion, either into a memory buffer (like ByteArrayOutputStream), or a File.
  2. Construct actual trie from serialized raw sequence (File, byte[]).

Two-phase processing is needed since the actual result size is not known in advance.

Sample

This tr13 from LevelDB gist shows simple usage.

Documentation

Check out [https://github.com/ning/tr13/wiki]

com.ning

Ning

Версии библиотеки

Версия
0.3.0
0.2.5