You need to use the {% trans %}
or {% blocktrans %}
template tags in your html files before you run
python manage.py makemessages -l <locale>
If you have done that, and your HTML templates are inside your source tree, then makemessages should pick them up. If you haven't used those template tags, then you won't see any output from them in your .po file.