Potentially dumb question: Is there a way to update all headers and footers from a template?

Question

I have a static HTML site hosted on github pages and I was wondering if there is any code that could use a template to fill in the header and footer of every page? I thought I r