Apache Kafka

The Best Decisions Come From Real-Time Data

In order to compete and be successful, a business needs to make good decisions fast. And we all know that the best decisions are informed by good …

Big Data

10 hot startups targeting today’s key IT initiatives

Enterprise startups have always played a crucial role in IT portfolios. As much as CIOs would love to centralize technology purchasing decisions with …

Big Data

Deep Learning in Real-Time With TensorFlow, H2O.ai, and Kafka Streams

Intelligent real-time applications are a game-changer in any industry. Deep learning is one of the hottest buzzwords in this area. New technologies …

Deep Learning

Mesosphere DC/OS Container Platform Now Available through Azure Marketplace

Enterprise DC/OS, the enterprise-ready version of Mesosphere's platform for building and running data-intensive containerized applications, is now …

Hadoop

Apache Kafka + Kafka Streams + Mesos / DCOS = Scalable Microservices

I had a talk at MesosCon 2017 Europe in Prague about building highly scalable, mission-critical microservices with Apache Kafka, Kafka Streams and …

Big Data

Apache Kafka 1.0 Released Exactly Once

With the release of Apache Kafka 1.0 this week, an eight-year journey is finally coming to a temporary end. Temporary because the project will …

Big Data

Introduction to Apache Kafka

What is Apache Kafka?<p>Apache Kafka is a distributed streaming system with publish and subscribe the stream of records. In another aspect it is an …

Big Data

Event Bus as Backbone for Decoupled Microservice Choreography (JFall 2017)

Microservices are independent, encapsulated entities that produce meaningful results and business functionality in tentative collaboration. Events and pub/sub are great for allowing such decoupled interaction. Using Apache Kafka as robust, distributed, real-time, high volume event bus, this session …

Software Development

Apache Kafka data streaming engine hits milestone as version 1.0 goes live

The Apache Kafka distributed data streaming engine has finally hit version 1.0, a milestone that indicates the platform is finally ready for …

Big Data

Apache Kafka Reaches 1.0

The Apache Software Foundation have announced Apache Kafka v.1.0.0, adding an improved Streams API, enhanced metrics, improved tolerance for disk …

Big Data

Apache Kafka reaches milestone with version 1.0.0

Open-source software foundation Apache released version 1.0.0 of its Kafka distributed data streaming platform today, with the first full version …

Big Data

The Apache Software Foundation Announces Apache® Kafka® v1.0.0

<b>Popular Open Source enterprise-grade scalable streaming platform in use at Capital One, Goldman Sachs, ING, LinkedIn, Netflix, Pinterest, Rabobank,</b> …

Big Data

Using Kylo for Self-Service Data Ingestion, Cleansing, and Validation

Kylo is a feature-rich data lake platform built on Apache Hadoop and Apache Spark. Kylo provides a business-friendly data lake solution and enables …

Big Data

IAG saves millions with OpenStack

Open source software and open source inspired approaches to development and innovation are set to play an increasingly large role in the future of …

Dell EMC

Container technologies for cloud-native apps

A deep dive exploring the layers that go into a container-based platform for enterprise applications

DevOps

Application container-friendly Pentaho 8 gets native Kafka support

The Hitachi Vantara subsidiary of Hitachi Ltd. has added support for Apache Kafka streaming data in version 8 of its Pentaho data integration and …

Big Data

What's New in Apache Spark 2.2?

Apache recently released a new version of Spark: 2.2. The newest version comes with improvements as well as the addition of new functionalities.The …

Big Data

How to use Apache Kafka to transform a batch pipeline into a real-time one

<i>In this blog, I will thoroughly explain how to build an end-to-end real-time data pipeline by building four micro-services on top of Apache Kafka. It</i> …

Big Data

Journaling Kafka messages with S3 connector and Minio

As modern applications move from monoliths to microservices, a single transaction in an application may hit several microservices. So you need to …

Big Data

Technista Talk: Neha Narkhede - LinkedIn Employee To Confluent Boss

From the time Neha Narkhede was a young girl in India, she believed that she could create things and control her own destiny. To support her interests, her parents ensured that she did three things: learned how to use computers, attended the best schools and modeled women leaders. Unbeknownst to …

Careers

Eclipse Deeplearning4j

Background:<p>Deep learning is a fast-growing field within artificial intelligence, and deep neural networks have seen rapid adoption in recent years. …

Machine Learning

Apache Kafka and the four challenges of production machine learning systems

<i>Untangling data pipelines with a streaming platform.</i>Machine learning has become mainstream, and suddenly businesses everywhere are looking to build …

Big Data

ZooKeeper in 15 Minutes

ZooKeeper is a coordination service for distributed applications with the motto "ZooKeeper: Because Coordinating Distributed Systems is a Zoo." The …

DevOps

Reactive Data Platforms, Real-Time Analytics, and Scale

Thanks to Alex Silva, Principal Data Architect at Pluralsight, for sharing his insights on the current and future state of the company’s data …

Big Data

Building Distributed Systems and Microservices in Go with NATS Streaming

A while ago, I have written a blog post Introducing NATS to Go Developers for using Apcera NATS as the messaging system for building distributed …

Software Development

Kafka Racing: Know the Circuit

This is the first post in a blog series dedicated to Apache Kafka and its usage for solving problems in the big data domain. Using a hands-on …

Big Data

Real-Time Activity Tracking With Kafka

When LinkedIn started growing its member base, the site’s functionalities got more complex day by day. In 2010, they decided to invest in redesigning …

Big Data

12 Inspiring Female Architects in Software and Data! 👩🏽 👧🏻 💻 🎉

Hollywood’s <i>Silicon Valley</i> TV show continues the long-established narrative that here in the Silicon Valley, technology / startups equals guys in …

Big Data

This Week in Spring: Spring 5.0 Edition!

Welcome to another installment of <i>This Week in Spring</i>! This last week’s been <i>nuts</i>! So much good stuff on offer. Spring Framework 5.0 is now available! …

Java

What It Was Like to Scale LinkedIn's Data Pipeline

It was pretty kafkaesque at times, but overall, very fun and satisfying.<p><i>What was it like to build and scale LinkedIn's data pipeline? originally appeared on Quora: the place to gain and share knowledge, empowering people to learn from others and better understand the world.</i><p><b>Answer by Neha Narkhede,</b> …

Big Data