how to implement spark sql pagination query

Question

Does anyone how to do pagination in spark sql query?

I need to use spark sql but don\'t know how to do pagination.

Tried:

select * from pers         


        

Answer 1

karthik's answer will fail if there are duplicate rows in the dataframe. 'except' will remove all rows in df1 which are in df2 .

val filteredRdd = df.rdd.zipWithIndex().collect { case (r, i) if 10 >= start && i <=20 => r }
val newDf = sqlContext.createDataFrame(filteredRdd, df.schema)