com.booking.validator:connectors

Dynamic correctness checks

Лицензия

Лицензия

Группа

Группа

com.booking.validator
Идентификатор

Идентификатор

connectors
Последняя версия

Последняя версия

0.0.3
Дата

Дата

Тип

Тип

jar
Описание

Описание

Dynamic correctness checks
Организация-разработчик

Организация-разработчик

Booking.com

Скачать connectors

Как подключить последнюю версию

<!-- https://jarcasting.com/artifacts/com.booking.validator/connectors/ -->
<dependency>
    <groupId>com.booking.validator</groupId>
    <artifactId>connectors</artifactId>
    <version>0.0.3</version>
</dependency>
// https://jarcasting.com/artifacts/com.booking.validator/connectors/
implementation 'com.booking.validator:connectors:0.0.3'
// https://jarcasting.com/artifacts/com.booking.validator/connectors/
implementation ("com.booking.validator:connectors:0.0.3")
'com.booking.validator:connectors:jar:0.0.3'
<dependency org="com.booking.validator" name="connectors" rev="0.0.3">
  <artifact name="connectors" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.booking.validator', module='connectors', version='0.0.3')
)
libraryDependencies += "com.booking.validator" % "connectors" % "0.0.3"
[com.booking.validator/connectors "0.0.3"]

Зависимости

compile (10)

Идентификатор библиотеки Тип Версия
com.booking.validator : data jar 0.0.3
mysql : mysql-connector-java jar 6.0.5
org.apache.commons : commons-dbcp2 jar 2.1.1
org.apache.zookeeper : zookeeper jar 3.4.9
org.slf4j : slf4j-api jar 1.7.21
org.slf4j : slf4j-log4j12 jar 1.7.21
org.apache.maven.plugins : maven-gpg-plugin maven-plugin 1.5
org.apache.maven.plugins : maven-javadoc-plugin maven-plugin 2.9.1
org.apache.maven.plugins : maven-source-plugin maven-plugin 2.2.1
org.codehaus.mojo : versions-maven-plugin maven-plugin 2.5

Модули Проекта

Данный проект не имеет модулей.

Validator

A service for ensuring Data Correctness

Java 8 ☕️


Overview

  • Validator was initially built to ensure Data Correctness in Replicator.
  • Can be used for validating data between any two data sources.

Configuration

  • Sample validator configuration is in config.yaml
  • Config options:
    • data_sources: Currently supports mysql/hbase/bigtable
    • task_supplier: Currently supports kafka
    • reporter: Currently supports graphite
    • discrepancy_sink: Currently supports kafka
    • retry_policy: Specifies delay for retry in case of mismatch. (in milliseconds)
  • Detailed configuration instructions can be found here.

Setup/Run instructions

LOCAL

  • Clone this repository and $ cd validator/
  • $ mvn clean package Builds a JAR from the source
  • $ ./run.sh Runs the validator using validator-conf.yaml

DOCKER

  • TODO

ACKNOWLEDGEMENT

This software was originally developed at Booking.com. With approval from Booking.com, this software was released as open source, for which the authors would like to express their gratitude.

com.booking.validator

MySQL Time Machine

Collection of services and tools for capturing, processing and historizing streams of MySQL data changes.

Версии библиотеки

Версия
0.0.3
0.0.1