spark-cassandra-connector

问题 In Spark-2.0 what is the best way to create a Spark session. Because in both Spark-2.0 and Cassandra- the APIs have been reworked, essentially deprecating the SqlContext (and also CassandraSqlContext). So for executing SQL- either I create a Cassandra Session (com.datastax.driver.core.Session) and use execute( " ") . Or I have to create a SparkSession (org.apache.spark.sql.SparkSession) and execute sql(String sqlText) method. I don't know the SQL limitations of either - can someone explain.

问题 In Spark-2.0 what is the best way to create a Spark session. Because in both Spark-2.0 and Cassandra- the APIs have been reworked, essentially deprecating the SqlContext (and also CassandraSqlContext). So for executing SQL- either I create a Cassandra Session (com.datastax.driver.core.Session) and use execute( " ") . Or I have to create a SparkSession (org.apache.spark.sql.SparkSession) and execute sql(String sqlText) method. I don't know the SQL limitations of either - can someone explain.

问题 I want to write Structure Streaming Data into Cassandra using PySpark Structured Streaming API. My data flow is like below: REST API -> Kafka -> Spark Structured Streaming (PySpark) -> Cassandra Source and Version in below: Spark version: 2.4.3 DataStax DSE: 6.7.6-1 initialize spark: spark = SparkSession.builder\ .master("local[*]")\ .appName("Analytics")\ .config("kafka.bootstrap.servers", "localhost:9092")\ .config("spark.cassandra.connection.host","localhost:9042")\ .getOrCreate()

来源： https://stackoverflow.com/questions/64539652/appending-streaming-pyspark-dataframe-to-cassandra-doesnt-write-anything

来源： https://stackoverflow.com/questions/42607183/spark-with-cassandra-python-setup

来源： https://stackoverflow.com/questions/61946840/insert-spark-datasetstring-mapstring-string-to-cassandra-table

来源： https://stackoverflow.com/questions/61946840/insert-spark-datasetstring-mapstring-string-to-cassandra-table

来源： https://stackoverflow.com/questions/48572521/java-lang-noclassdeffounderror-could-not-initialize-class-org-xerial-snappy-sna

来源： https://stackoverflow.com/questions/48572521/java-lang-noclassdeffounderror-could-not-initialize-class-org-xerial-snappy-sna

来源： https://stackoverflow.com/questions/48572521/java-lang-noclassdeffounderror-could-not-initialize-class-org-xerial-snappy-sna