The dA Platform Blog

Apache Flink, stream processing, event-driven applications, and more.

Friday-Flink-Tip-Olivia-dA

How to manage your RocksDB memory size in Apache Flink

January 11, 2019

This blog post describes some configuration options that will help you to efficiently manage the memory size of the RocksDB state backend in Apache Flink. In an earlier post, we described the alternative state backend options supported in Flink...

Read More
Flink-Friday-Tip-Thumbnail

5 “baby” steps to develop a Flink application

December 17, 2018

Getting up and running with Flink is easy as ABC. In this post, we go over 5 “baby” steps to guide you through setting up your first running Flink application locally. We discuss the software requirements to get started and point out some...

Read More
Flink-user-QA-thumbnail

How can companies benefit from data-driven applications and open-source software?

December 17, 2018

This blog post is a Q&A session with Jakub Piasecki, Director of Technology at Freeport Metrics, about the benefits of real-time, data-driven applications and open-source software.

Read More

Broadcast State Pattern in Apache Flink: 4 important considerations

November 09, 2018

This episode of  Flink Friday Tip explores the Broadcast State pattern that was introduced in Apache Flink 1.5.0. In the following sections, we describe what is a Broadcast State Pattern, how Broadcast State differs from other types of operator...

Read More

Flink SQL for powerful querying of data streams and data at rest

November 06, 2018

While Flink SQL was initially released with Flink 1.1.0 back in August 2016 recent Flink releases have added quite a bit of functionality that makes Flink SQL easier to use by eliminating the need to write Java/Scala code. In this post, we want...

Read More

3 differences between Savepoints and Checkpoints in Apache Flink

November 02, 2018

This episode of our Flink Friday Tip explains what Savepoints and Checkpoints are and examines the main differences between them in Apache Flink. In the following paragraphs, we explain what Savepoints are, when they should be used and give a...

Read More

State TTL for Apache Flink: How to Limit the Lifetime of State

September 25, 2018

A common requirement for many stateful streaming applications is the ability to control how long application state can be accessed (e.g., due to legal regulations like GDPR) and when to discard it. This blog post introduces the state time-to-live...

Read More

Latest improvements for Apache Flink with the release of Flink 1.5.4 and 1.6.1

September 21, 2018

The Apache Flink® community just released two bugfix versions, Apache Flink 1.5.4 and Apache Flink 1.6.1 including many resolved issues and improvements.

Read More

Apache Flink 1.6.0: What’s new in the latest Apache Flink release

August 09, 2018

The Apache Flink® community has just release v. 1.6.0 with major improvements and additions to the technology. The community worked hard in the last 2+ months to resolve more than 360 issues and is proud to introduce the latest Flink version to...

Read More

A Practical Guide to Broadcast State in Apache Flink

August 02, 2018

Since version 1.5.0, Apache Flink features a new type of state which is called Broadcast State. In this post, we explain what Broadcast State is, and show an example of how it can be applied to an application that evaluates dynamic patterns on...

Read More
Page 1 of 5