Back to home page

OSCL-LXR

 
 

    


0001 ---
0002 layout: global
0003 title: Spark Streaming + Kafka Integration Guide
0004 license: |
0005   Licensed to the Apache Software Foundation (ASF) under one or more
0006   contributor license agreements.  See the NOTICE file distributed with
0007   this work for additional information regarding copyright ownership.
0008   The ASF licenses this file to You under the Apache License, Version 2.0
0009   (the "License"); you may not use this file except in compliance with
0010   the License.  You may obtain a copy of the License at
0011  
0012      http://www.apache.org/licenses/LICENSE-2.0
0013  
0014   Unless required by applicable law or agreed to in writing, software
0015   distributed under the License is distributed on an "AS IS" BASIS,
0016   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
0017   See the License for the specific language governing permissions and
0018   limitations under the License.
0019 ---
0020 
0021 [Apache Kafka](https://kafka.apache.org/) is publish-subscribe messaging rethought as a distributed, partitioned, 
0022 replicated commit log service.  Please read the [Kafka documentation](https://kafka.apache.org/documentation.html) 
0023 thoroughly before starting an integration using Spark.
0024 
0025 At the moment, Spark requires Kafka 0.10 and higher. See 
0026 <a href="streaming-kafka-0-10-integration.html">Kafka 0.10 integration documentation</a> for details.