Apache Kafka News

• 

  How Fully Managed Connectors Make Apache Kafka Easier
  • sorangutan  

  1
  1
  Posts
  19
  Views

  

  Building, testing, and deploying Kafka connectors require time and resources. Confluent’s fully managed connectors ensure instant, real-time data quality, consistency, and reliability.
  
  https://www.confluent.io/blog/fully-managed-connectors-make-apache-kafka-easier/
• 

  Modernize Your Mainframe With Confluent on IBM zSystems
  • sorangutan  

  1
  1
  Posts
  18
  Views

  

  Modernize mainframes with Confluent’s IBM MQ Sink and Source Connectors
  
  https://www.confluent.io/blog/modernize-mainframe-with-confluent-on-IBM-zSystems/
• 

  Fault Tolerance in Distributed Systems: Tracing with Apache Kafka and Jaeger
  • sorangutan  

  1
  1
  Posts
  22
  Views

  

  How is data flowing through my distributed system? What if Jaeger goes down? Jaeger does a fantastic job of tracing data as it flows through a distributed system, but adding a layer of Apache Kafka in front of it also gives you fault tolerance, storage, …
  
  https://www.confluent.io/blog/fault-tolerance-distributed-systems-tracing-with-apache-kafka-jaeger/
• 

  Getting Started with the MongoDB Connector for Apache Kafka and MongoDB
  • sorangutan  

  1
  1
  Posts
  14
  Views

  

  The official MongoDB Connector for Apache Kafka is developed and supported by MongoDB engineers. It is also verified by Confluent and now released in beta, enabling MongoDB to be configured as both a sink and a source for Apache Kafka.
  
  https://www.confluent.io/blog/getting-started-mongodb-connector-for-apache-kafka-and-mongodb/
• 

  KSQL Training for Hands-On Learning
  • sorangutan  

  1
  1
  Posts
  17
  Views

  

  Through Stéphane Maarek and Simon Aubury's KSQL course, you will build an entire taxi-booking application using KSQL and Apache Kafka. You'll first start with the building blocks of streams and tables, then proceed onto advanced KSQL areas. For our blog …
  
  https://www.confluent.io/blog/ksql-training-for-hands-on-learning/
• 

  Bust the Burglars – Machine Learning with TensorFlow and Apache Kafka
  • sorangutan  

  1
  1
  Posts
  14
  Views

  

  Build your own burglar alert system to alert you before the actual event takes place by using network-connected cameras and analyzing the camera images with Apache Kafka, Kafka Streams, and TensorFlow. You can use Kafka Connect to load and transform your…
  
  https://www.confluent.io/blog/bust-the-burglars-machine-learning-with-tensorflow-and-apache-kafka/
• 

  Deploying Kafka Streams and KSQL with Gradle – Part 3: KSQL User-Defined Functions and Kafka Streams
  • sorangutan  

  1
  1
  Posts
  12
  Views

  

  Here in part 3, we'll explore using Gradle to build and deploy KSQL user-defined functions (UDFs) and Kafka Streams microservices.
  
  https://www.confluent.io/blog/deploying-kafka-streams-and-ksql-with-gradle-part-3-ksql-user-defined-functions-and-kafka-streams/
• 

  KSQL in Football: FIFA Women’s World Cup Data Analysis
  • sorangutan  

  1
  1
  Posts
  22
  Views

  

  From a data perspective, the World Cup represents an interesting source of information. The idea in this blog post is to mix information coming from two distinct channels: the RSS feeds of sport-related newspapers and Twitter feeds of the FIFA Women’s Wo…
  
  https://www.confluent.io/blog/ksql-in-football-fifa-womens-world-cup-data-analysis/
• 

  Kafka Listeners – Explained
  • sorangutan  

  1
  1
  Posts
  25
  Views

  

  You need to set advertised.listeners (or KAFKA_ADVERTISED_LISTENERS if you’re using Docker images) to the external address (host/IP) so that clients can correctly connect to it. Otherwise, they’ll try to connect to the internal host address—and if that’s…
  
  https://www.confluent.io/blog/kafka-listeners-explained/
• 

  Designing the .NET API for Apache Kafka
  • sorangutan  

  1
  1
  Posts
  20
  Views

  

  The Confluent clients for Apache Kafka have passed a major milestone—the release of version 1.0. Leading up to the 1.0 release, we've put a lot of effort into the .NET client in particular. The API we've arrived at contains a bunch of new features and ma…
  
  https://www.confluent.io/blog/designing-the-net-api-for-apache-kafka/
• 

  Microservices, Apache Kafka, and Domain-Driven Design
  • sorangutan  

  1
  1
  Posts
  26
  Views

  

  Kai Waehner discusses why Apache Kafka became the de facto standard and backbone for microservice architectures—not just replacing other traditional middleware but also building the microservices themselves using domain-driven design and Kafka-native API…
  
  https://www.confluent.io/blog/microservices-apache-kafka-domain-driven-design/
• 

  Building a Scalable Search Architecture
  • sorangutan  

  1
  1
  Posts
  12
  Views

  

  It’s easy to use Apache Kafka and Kafka Connect to scale your search infrastructure by connecting different source applications, databases, and your search engine. This solution uses a single technology stack to create one uniform approach that helps you…
  
  https://www.confluent.io/blog/building-a-scalable-search-architecture/
• 

  Unifying Stream Processing and Interactive Queries in Apache Kafka
  • sorangutan  

  1
  1
  Posts
  12
  Views

  

  Get an understanding of the applicability of Interactive Queries in Apache Kafka, how it works under the hood, and related resources.
  
  https://www.confluent.io/blog/unifying-stream-processing-and-interactive-queries-in-apache-kafka/
• 

  Confluent Event Streaming Platform and Syncsort Data Management: Bringing Big Data to Life
  • sorangutan  

  1
  1
  Posts
  20
  Views

  

  Confluent & Syncsort provide an architecture that enables streaming and batch data processing to work together to solve various business problems.
  
  https://www.confluent.io/blog/confluent-and-syncsort-forge-central-nervous-system-for-streaming-and-at-rest-data/
• 

  Log Compaction | Highlights in the Apache Kafka and Stream Processing Community | October 2016
  • sorangutan  

  1
  1
  Posts
  8
  Views

  

  The monthly roundup of updates from the Apache Kafka and Stream Processing community.
  
  https://www.confluent.io/blog/log-compaction-highlights-in-the-apache-kafka-and-stream-processing-community-october-2016/
• 

  Introducing Apache Kafka™ for the Enterprise
  • sorangutan  

  1
  1
  Posts
  12
  Views

  

  Get details of new features included in Confluent Enterprise to help organizations simplify running Apache Kafka in production at scale.
  
  https://www.confluent.io/blog/introducing-apache-kafka-for-the-enterprise/
• 

  Want to migrate to AWS Cloud? Use Apache Kafka.
  • sorangutan  

  1
  1
  Posts
  17
  Views

  

  Use Apache Kafka for migrating to AWS Cloud to reduce costs, accelerates migration times and make the migration process more manageable and safer.
  
  https://www.confluent.io/blog/want-migrate-aws-cloud-use-apache-kafka/
• 

  Data pipelines: The what, why, and how
  • sorangutan  

  1
  1
  Posts
  17
  Views

  

  A data pipeline is the process of data movement and transformation from its source to destination. Learn types of data pipelines and how they’re used.
  
  https://www.confluent.io/blog/data-pipelines-the-what-why-and-how/
• 

  Building a Telegram Bot Powered by Apache Kafka and ksqlDB
  • sorangutan  

  1
  1
  Posts
  13
  Views

  

  ksqlDB use case: see how apps can use ksqlDB to ingest, filter, enrich, aggregate, and query data directly with Kafka—no complex architectures or data stores needed.
  
  https://www.confluent.io/blog/building-a-telegram-bot-powered-by-kafka-and-ksqldb/
• 

  From Eager to Smarter in Apache Kafka Consumer Rebalances
  • sorangutan  

  1
  1
  Posts
  36
  Views

  

  Major improvements to the Kafka consumer, Streams, and ksqlDB for incremental cooperative rebalancing while maintaining at-least-once and exactly-once guarantees.
  
  https://www.confluent.io/blog/cooperative-rebalancing-in-kafka-streams-consumer-ksqldb/