Sharing RDD's states across Spark applications with Apache Ignite
Sharing RDD’s states across Spark applications with Apache Ignite
Apache Ignite offers an abstraction over native Spark RDDs such that the state of RDDs can be shared across spark jobs, workers and applications which is not possible with native Spark RDDS. In this blog, we will walk through the steps on how to share RDDs between two spark Application.
Preparing Ingredients
To test the Apache Ignite with Apache Spark application we need at least one master…
View On WordPress












