I just downloaded the GlassFish 5.0 archive - Full Platform, unzipped it, I run it through the command line.
asadmin start-domain
pr
This looks to be this issue - https://github.com/eclipse-ee4j/glassfish/issues/22130.
GlassFish 5 does not work on JDK9, it may be fixed for 5.1.