I have created a small application to recursively load assemblies in a provided directory and read their custom attributes collection. Mainly just to read the DebuggableAttr
I believe Assembly.ReflectionOnlyLoad is what you are looking for.