You can try to use pandoc as your converter. Here's a jekyll plugin to implement this. Pandoc will be able to add a figure caption the same as your alt attribute automatically.
But you have to push the compiled site because github doesn't allow plugins in Github pages for security.