Have you tried running the profiler to see what's slowing your framerate down? I'd start there if you haven't tried it yet.