Ignore Nulls with Data frame using spark datastax connector
问题 We have a Cassandra schema with more than 50 columns and we are inserting data into it from multiple data sources by transforming the data using Spark (Data frames not rdd). We are running into the issue of many tombstones as our data is sparse. Already tried the spark.cassandra.output.ignoreNulls=true but its not working. What would be right config to not write null values in cassandra? I am using zeppelin to run my spark code and push data to C* 回答1: Figured out the solution to this: A hint