I reinstalled Buster with no GUI. It does run slightly better. Running just the Flask and Website and running htop, CPU: 42.2%, Mem: 391M/432M, and Swp: 100M/100M.
Increased swap: /etc/dphys-swapfile CONF_SWAPFILE=256
htop: CPU: 22%-58%, Mem: 304M/432M, Swp: 21.5M/256M
Much better. However, the the heart (css animation) no longer shows up on the display.