Leave it to the largest Git forge site in the world to track generated artifacts in Git instead of sources. Let me guess, you asked Google what a font repository layout should look like.

Sarcasm aside: The way this should work is a VCS repo should have the font source files and commands used by build tooling used to generate the artifacts. Attach the artifacts to releases, but don't track them in Git.