Skip to content
This repository was archived by the owner on Feb 15, 2024. It is now read-only.

Azure-Samples/hdinsight-spark-kafka-structured-streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

page_type sample
languages
java
products
azure
azure-hdinsight
name Use Spark Structured Streaming with Apache Spark and Kafka on HDInsight
urlFragment hdinsight-spark-kafka-structured-streaming
description This example contains a Jupyter notebook that demonstrates how to use Apache Spark structured streaming with Apache Kafka on Azure HDInsight.

Use Spark Structured Streaming with Apache Spark and Kafka on HDInsight

This example contains a Jupyter notebook that demonstrates how to use Apache Spark structured streaming with Apache Kafka on HDInsight.

Note: This example requires Spark 2.2.0, which is available in HDInsight 3.6. The Spark and Kafka clusters must also be in the same Azure Virtual Network. To create a resource group containing all the services needed for this example, use the resource manager template in the Use Spark Structured Streaming with Kafka document.

Contributing

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

About

How to read data from Apache Kafka on HDInsight using Spark Structured Streaming.

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

 
 
 

Contributors