Category: Spark

Business Intelligence
Datastax
Spark
October 23, 2017

Spark and Qlik Integration

Steps: Start Spark Thrift Server on Datastax Cluster Enable Qlik Server’s Security Group on AWS to access port 10000 (basically from qlik, need to connect to thrift server port 10000) Install Simba ODBC Driver for Spark on the Qilk Windows EC2 InstanceCreate System DSN as follows: Spark Server Type: SparkThriftServer Host: internal-spark-thriftserver-prod-lb-861234576.ap-southeast-1.elb.amazonaws.com (DNS name of […]

Read More
NoSQL
Spark
October 20, 2017

Spark SQL Query Explain Plan

DSE 5.0.6, Spark 1.6.2 Example 1 From cqlsh, below query works Below query does a Full Table Scan(FTS) Below query does not do FTS, because leading partition key column is txn_status Below query does not return result at all if txn_date is not cast Example 2 Example 3 Example 4 Example 5 CATEGORIES

Read More
Datastax
Spark
October 16, 2017

Accessing Datastax Spark – Basic Examples

DSE 5.0.7, Spark 1.6.3 Accessing Spark Accessing spark from outside the spark cluster Spark SQL Pyspark Scala Spark Job Spark Thrift / Beeline note Difference between thrift query and spark-sql query, is that thrift server uses a shared SparkSQL context whereas Spark SQL does not. Accessing Cassandra Materialized Views from Spark users_by_email_mview is a materialized […]

Read More

Search Box

Recent Posts

Categories