Scala return value calculated in foreach

Question

I am new new to scala and spark and trying to understand few basic stuff out here.

Spark version used 1.5.

why does value of sum does not ge

Answer 1

Read the Programming Guide, it has a section devoted to this: Understanding Closures. If you actually need to collect some state, you can use Accumulators (but note that you can't access the value from the executor nodes, only amend it). But try doing without them first: think in terms of available transformations instead of mutating state.