It could actually be that emacs' current draw code is just not fast at drawing something something as fast-changing as cmatrix, and might not be ansi-term's fault at all.