Could you check your /logs to see if they provide any more information? You could also use the browser tools to see if anything flashes up in the console when you try and access that page.
I have topic-voting enabled on my test site, but I’m not seeing any issues when I navigate to /my/activity/votes. Is this the page you’re referring to?