As folks first begin to work with Flink, watermarks can be a source of confusion. But this topic doesn't have to be complicated. Let's work through a simple example that will show why we need watermarks, and how they work.
How Apache Flink manages Kafka consumer offsets
In this episode of our Flink Friday Tip, we explain with a step-by-step example how Apache Flink works with Apache Kafka to ensure that records from Kafka topics are processed with exactly-once guarantees.
An introduction to ACID guarantees and transaction processing
Last month we introduced data Artisans Streaming Ledger, our new technology that brings serializable, distributed ACID transactions directly on data streams. In this blog post, we take a step back to introduce ACID semantics and transaction...
6 things to consider when defining your Apache Flink cluster size
This is the first episode of our new blog series called Flink Friday Tip. Flink Friday Tips provide some easy-to-digest best practices and advice on how to leverage the power of Apache Flink and make the best use of the different Flink features....
Meet the Engineer: Ufuk Celebi
In this section of our “Meet the Engineer” series, I’d like to introduce my data Artisans colleague Ufuk Celebi. Ufuk is one of the co-founders of the team and one of the very few Berliners in the company (yes, born and raised in Berlin :-)). He...
State TTL for Apache Flink: How to Limit the Lifetime of State
A common requirement for many stateful streaming applications is the ability to control how long application state can be accessed (e.g., due to legal regulations like GDPR) and when to discard it. This blog post introduces the state time-to-live...
Latest improvements for Apache Flink with the release of Flink 1.5.4 and 1.6.1
The Apache Flink® community just released two bugfix versions, Apache Flink 1.5.4 and Apache Flink 1.6.1 including many resolved issues and improvements.
data Artisans Announces Flink Forward Conference Expansion to China
Flink Forward comes to Beijing in December 2018 and returns to San Francisco in April 2019 as enterprise adoption of stateful stream processing grows and uses cases expand to include ACID transactions
Apache Flink Receives Honors in Third Annual Datanami Readers’ and Editors’ Choice Awards
Third Annual Datanami Awards Given to Leaders in the Global Big Data Community
Announcing Data Artisans Platform 1.2 with major new Enterprise Security features
Today, data Artisans is announcing the availability of data Artisans Platform 1.2, with major new Enterprise Security features.Alongside this new release, data Artisans is also announcing the availability of a new edition of data Artisans...