JarCasting
JarCasting JarCasting

AWS Kinesis Analytics Java Flink Connectors

This library contains various Apache Flink connectors to connect to AWS data sources and sinks.

License

License
Categories

Categories

AWS Container PaaS Providers
GroupId

GroupId

com.amazonaws
ArtifactId

ArtifactId

aws-kinesisanalytics-flink
Last Version

Last Version

2.0.0
Release Date

Release Date
Type

Type

jar
Description

Description

AWS Kinesis Analytics Java Flink Connectors
This library contains various Apache Flink connectors to connect to AWS data sources and sinks.
Project URL

Project URL

https://aws.amazon.com/kinesis/data-analytics/
Source Code Management

Source Code Management

https://github.com/aws/aws-kinesisanalytics-flink-connectors/tree/master

Download aws-kinesisanalytics-flink

Filename Size
aws-kinesisanalytics-flink-2.0.0.pom
aws-kinesisanalytics-flink-2.0.0.jar 9 MB
aws-kinesisanalytics-flink-2.0.0-sources.jar 35 KB
aws-kinesisanalytics-flink-2.0.0-javadoc.jar 181 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.amazonaws/aws-kinesisanalytics-flink/ -->
<dependency>
    <groupId>com.amazonaws</groupId>
    <artifactId>aws-kinesisanalytics-flink</artifactId>
    <version>2.0.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.amazonaws/aws-kinesisanalytics-flink/
implementation 'com.amazonaws:aws-kinesisanalytics-flink:2.0.0'
// https://jarcasting.com/artifacts/com.amazonaws/aws-kinesisanalytics-flink/
implementation ("com.amazonaws:aws-kinesisanalytics-flink:2.0.0")
'com.amazonaws:aws-kinesisanalytics-flink:jar:2.0.0'
<dependency org="com.amazonaws" name="aws-kinesisanalytics-flink" rev="2.0.0">
  <artifact name="aws-kinesisanalytics-flink" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.amazonaws', module='aws-kinesisanalytics-flink', version='2.0.0')
)
libraryDependencies += "com.amazonaws" % "aws-kinesisanalytics-flink" % "2.0.0"
[com.amazonaws/aws-kinesisanalytics-flink "2.0.0"]

Dependencies

compile (3)

Group / Artifact Type Version
com.amazonaws : aws-java-sdk-iam jar 1.11.803
com.amazonaws : aws-java-sdk-kinesis jar 1.11.803
com.amazonaws : aws-java-sdk-sts jar 1.11.803

provided (1)

Group / Artifact Type Version
org.apache.flink : flink-streaming-java_2.11 jar 1.8.3

test (4)

Group / Artifact Type Version
org.testng : testng jar 6.14.3
org.mockito : mockito-core jar 3.3.3
org.assertj : assertj-core jar 3.16.1
ch.qos.logback : logback-classic jar 1.2.3

Project Modules

There are no modules declared in this project.

Amazon Kinesis Flink Connectors

This repository contains various Apache Flink connectors to connect to AWS Kinesis data sources and sinks.

Amazon Kinesis Data Firehose Producer for Apache Flink

This Producer allows Flink applications to push directly to Kinesis Firehose.

Quickstart

Configure and instantiate a FlinkKinesisFirehoseProducer:

Properties config = new Properties();
outputProperties.setProperty(ConsumerConfigConstants.AWS_REGION, region);

FlinkKinesisFirehoseProducer<String> sink = new FlinkKinesisFirehoseProducer<>(streamName, new SimpleStringSchema(), config);

Getting Started

Follow the example instructions to create an end to end application:

Building from Source

  1. You will need to install Java 1.8+ and Maven
  2. Clone the repository from Github
  3. Build using Maven from the project root directory:
    1. $ mvn clean install

Flink Version Matrix

Flink maintain backwards compatibility for the Sink interface used by the Firehose Producer. This project is compatible with Flink 1.x, there is no guarantee it will support Flink 2.x should it release in the future.

Connector Version Flink Version Release Date
2.0.0 1.x Jul, 2020
1.1.0 1.x Dec, 2019
1.0.1 1.x Dec, 2018
1.0.0 1.x Dec, 2018

License

This library is licensed under the Apache 2.0 License.

com.amazonaws

Amazon Web Services

Versions

Version
2.0.0
1.1.0
1.0.1
1.0.0