We are working on a Spark V2 datasource implementing an S3 API, which is fully AWS SDK compliant, and includes push down of S3 select.
Our goal is to share this datasourc