JarCasting
JarCasting JarCasting

coral-presto

A library for analyzing, processing, and rewriting views defined in the Hive Metastore, and sharing them across multiple execution engines

Лицензия

Лицензия
Группа

Группа

com.linkedin.coral
Идентификатор

Идентификатор

coral-presto
Последняя версия

Последняя версия

1.0.40
Дата

Дата
Тип

Тип

jar
Описание

Описание

coral-presto
A library for analyzing, processing, and rewriting views defined in the Hive Metastore, and sharing them across multiple execution engines
Ссылка на сайт

Ссылка на сайт

https://github.com/linkedin/coral
Система контроля версий

Система контроля версий

https://github.com/linkedin/coral.git

Скачать coral-presto

Имя Файла Размер
coral-presto-1.0.40.pom
coral-presto-1.0.40.jar 42 KB
coral-presto-1.0.40-sources.jar 29 KB
coral-presto-1.0.40-javadoc.jar 63 KB
Обзор

Как подключить последнюю версию

<!-- https://jarcasting.com/artifacts/com.linkedin.coral/coral-presto/ -->
<dependency>
    <groupId>com.linkedin.coral</groupId>
    <artifactId>coral-presto</artifactId>
    <version>1.0.40</version>
</dependency>
// https://jarcasting.com/artifacts/com.linkedin.coral/coral-presto/
implementation 'com.linkedin.coral:coral-presto:1.0.40'
// https://jarcasting.com/artifacts/com.linkedin.coral/coral-presto/
implementation ("com.linkedin.coral:coral-presto:1.0.40")
'com.linkedin.coral:coral-presto:jar:1.0.40'
<dependency org="com.linkedin.coral" name="coral-presto" rev="1.0.40">
  <artifact name="coral-presto" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.linkedin.coral', module='coral-presto', version='1.0.40')
)
libraryDependencies += "com.linkedin.coral" % "coral-presto" % "1.0.40"
[com.linkedin.coral/coral-presto "1.0.40"]

Зависимости

compile (3)

Идентификатор библиотеки Тип Версия
com.google.code.gson : gson jar 2.8.1
com.google.code.findbugs : jsr305 jar 3.0.2
com.linkedin.coral : coral-hive jar 1.0.40

Модули Проекта

Данный проект не имеет модулей.

Coral

Coral is a library for analyzing, processing, and rewriting views defined in the Hive Metastore, and sharing them across multiple execution engines. It performs SQL translations to enable views expressed in HiveQL (and potentially other languages) to be accessible in engines such as Trino (formerly PrestoSQL), Apache Spark, and Apache Pig. Coral not only translates view definitions between different SQL/non-SQL dialects, but also rewrites expressions to produce semantically equivalent ones, taking into account the semantics of the target language or engine. For example, it automatically composes new built-in expressions that are equivalent to each built-in expression in the source view definition. Additionally, it integrates with Transport UDFs to enable translating and executing user-defined functions (UDFs) across Hive, Trino, Spark, and Pig. Coral is under active development. Currently, we are looking into expanding the set of input view language APIs beyond HiveQL, and implementing query rewrite algorithms for data governance and query optimization.

Modules

Coral consists of following modules:

  • Coral-Hive: Converts definitions of Hive views with UDFs to equivalent view logical plan.
  • Coral-Trino: Converts view logical plan to Trino (formerly PrestoSQL) SQL.
  • Coral-Spark: Converts view logical plan to Spark SQL.
  • Coral-Pig: Converts view logical plan to Pig-latin.
  • Coral-Schema: Derives Avro schema of view using view logical plan and input Avro schemas of base tables.
  • Coral-Spark-Plan: Converts Spark plan strings to equivalent logical plan (in progress).

How to Build

Clone the repository:

git clone https://github.com/linkedin/coral.git

Build:

./gradlew build

Contributing

The project is under active development and we welcome contributions of different forms. Please see the Contribution Agreement.

Community

  • Join the chat on Slack!

Resources

com.linkedin.coral

LinkedIn

Версии библиотеки

Версия
1.0.40
1.0.39
1.0.38
1.0.37
1.0.36
1.0.35
1.0.34
1.0.33
1.0.25
1.0.18
1.0.17
1.0.16
1.0.15
1.0.14
1.0.13
1.0.12
1.0.11
1.0.10
1.0.9
1.0.8
1.0.7
1.0.6
1.0.5