Database Reference
In-Depth Information
Functions
Generally, serialization of functions will “just work”: in Scala, functions are serializable
using the standard Java serialization mechanism, which is what Spark uses to send func-
tions to remote executor nodes. Spark will serialize functions even when running in local
mode, so if you inadvertently introduce a function that is not serializable (such as one
converted from a method on a nonserializable class), you will catch it early on in the de-
velopment process.
