This reverts commit b493729eff954909672694b67a453964f33ac893.
Going to revert. No speedup since glyphs are loaded lazy anyway. And one test fails I have no idea why: Tests/ttLib/woff2_test.py::WOFF2GlyfTableTest::test_reconstruct_glyf_padded_4