I asked how to filter the last date and got excellent answers (BigQuery, how to use alias in where clause?), they all work, but, they scan the whole table, the field SETTLEMENT
Assuming SETTLEMENTDATE is of DATE data type, you can use below to get today's partition
SELECT *
FROM `biengine-252003.aemo2.daily`
WHERE SETTLEMENTDATE = CURRENT_DATE()
or, for example for yesterday's partition
SELECT *
FROM `biengine-252003.aemo2.daily`
WHERE SETTLEMENTDATE = DATE_SUB(CURRENT_DATE(), INTERVAL 1 DAY)
See more at https://cloud.google.com/bigquery/docs/querying-partitioned-tables#querying_partitioned_tables_2