I seem to recall some talk of a graphics accelerated backend.
Perhaps targeting Vispy is a good option?