Apache Kafka 0.6

Operating systemsOS : Windows / Linux / Mac OS / BSD / Solaris
Program licensingScript Licensing : Apache License
CreatedCreated : Sep 22, 2011
Size downloadDownloads : 4
Program licensing
Thank you for voting...

Just like Facebook's Scribe tool, Kafka can be used ...

Just like Facebook's Scribe tool, kafka can be used for processing large amounts of streaming data.
It can basically handle all kind of activity stream data and processing on a consumer-scale website.
This activity includes page views, searches, and other user actions, all important ingredients for a social website.
Most important functions of Apache Kafka by Apache Software Foundation:

• Persistent messaging with O(1) disk structures that provide constant time performance even with many TB of stored messages.

• High-throughput: even with very modest hardware Kafka can support hundreds of thousands of messages per second.

• Explicit support for partitioning messages over Kafka servers and distributing consumption over a cluster of consumer machines while maintaining per-partition ordering semantics.

• Support for parallel data load into Hadoop.
News in the current Apache Kafka 0.6 version:

Fixed Bugs:

• SimpleProducer lose messages when socket gets an io exception

• If the producer sends an invalid messageset the broker will append it, corrupting the log

• ByteBufferMessageSet logs error about fetch size

• Shutdown Kafka when there is any disk IO error

• Propagate server all exceptions to consumer

• close() in SimpleConsumer should be synchronized

• Consumer Code documentation

• Improve EventHandler in AsyncProducer

• The zookeeper based Producer doesn't remove a dead broker from its list while serving a produce request

• Consumer logs ERROR during close

Improvements:

• Clean-up jUnit test

• MessageSet does not implement Java iterable

• Default Encoder for Kafka log4 appender

• Explicitly name all threads

• Refactor public api into java and Scala api

• Improve API docs for all public APIs

• Remove the java FileMessageSet API

• Unit test fail on some Linux machines

• Create SBT sub projects for perf, examples, contrib that are currently using Ant

• Add JMX for changing log4j level dynamically at Kafka server

• Upgrade to Zookeeper 3. 3. 3

• javaapi MessageSet doesn't need to implement writeTo socket

New Features:

• New producer API

Apache Kafka 0.6 scripting tags: data, kafka, stream, api, publish, apache kafka, messaging system, streaming data, messageset, data processing, subscribe. What is new in Apache Kafka 0.6 software script? - Unable to find Apache Kafka 0.6 news. What is improvements are expecting? Newly-made Apache Kafka 0.7 will be downloaded from here. You may download directly. Please write the reviews of the Apache Kafka. License limitations are unspecified.