The dA Platform Blog

Apache Flink, stream processing, event-driven applications, and more.

markus-spiske-771011-unsplash

The transformation of (open source) data processing

January 15, 2019

This blog post is based on a talk I gave at the Big Data Spain Conference 2018 in Madrid. The post goes through how [open source] data processing has evolved and covers the different technologies and how they progressed over time as different...

Read More
Friday-Flink-Tip-Olivia-dA

How to manage your RocksDB memory size in Apache Flink

January 11, 2019

This blog post describes some configuration options that will help you to efficiently manage the memory size of the RocksDB state backend in Apache Flink. In an earlier post, we described the alternative state backend options supported in Flink...

Read More
Flink-Friday-Tip-Thumbnail

5 “baby” steps to develop a Flink application

December 17, 2018

Getting up and running with Flink is easy as ABC. In this post, we go over 5 “baby” steps to guide you through setting up your first running Flink application locally. We discuss the software requirements to get started and point out some...

Read More
Flink-user-QA-thumbnail

How can companies benefit from data-driven applications and open-source software?

December 17, 2018

This blog post is a Q&A session with Jakub Piasecki, Director of Technology at Freeport Metrics, about the benefits of real-time, data-driven applications and open-source software.

Read More
Flink-1.7-release-announcement-blog

What’s new in the latest Apache Flink 1.7.0 release

December 17, 2018

The Apache Flink community is pleased to announce Apache Flink 1.7.0. The latest release includes more than 420 resolved issues and some exciting additions to Flink that we describe in the following sections of this post. Please check the ...

Read More
dA Platform icon

Getting Started with data Artisans Platform on Azure Kubernetes Service

November 26, 2018

In previous posts, we walked you through how to get data Artisans Platform up and running in Google Cloud Platform and Amazon Web Services. This time, we are focusing on Microsoft Azure and its hosted Kubernetes solution: Azure Kubernetes Service...

Read More

4 steps to get your Flink application ready for production

November 23, 2018

This post explains the necessary configuration steps that will get your Flink application ready for production. In the following sections, we give an overview of important configuration parameters that Engineering Leads, DevOps and Data Engineers...

Read More

Singles Day 2018: data in a Flink of an eye

November 22, 2018

Sunday 11 November 2018 marked Alibaba’s 10th annual shopping festival Singles Day, which saw a record Gross Merchandise Value (GMV) of $30.8 billion in sales and set a new record for the Chinese e-commerce platform. This is a 27 percent...

Read More

7 reasons to use stream processing & Apache Flink in the IoT industry

November 20, 2018

This is a guest post by Jakub Piasecki, Director of Technology at Freeport Metrics about using stream processing and Apache Flink in the IoT industry. The content is based on the post that originally appeared on the Freeport Metrics Blog.

Read More

Stream processing: An Introduction to Event Time in Apache Flink

November 16, 2018

Apache Flink supports multiple notions of time for stateful stream processing. This post focuses on event time support in Apache Flink. In the following sections we define what event time is with Apache Flink, we examine the different notions of...

Read More
Page 1 of 7