Using regex pattern to read files from directories

Question

I have directories with the following names:

s3://bucket/elig_date=2020-06-01/
s3://bucket/elig_date=2020-06-02/
....
s3://bucket/elig_date=2020-09-30/
s3://b