Are you able to try deleting a tag and and then looking at your site’s error logs? You can find your error logs by going to your Admin / Logs page and then clicking the “Error Logs” link from the navigation menu. It is possible there will be some useful information in the log files. Be careful to not post any sensitive information here though.
You might also be able to see the error by opening your browser’s web inspector to its console tab and then trying to delete a tag.
Can you let us know what version of Discourse your site is on? The version number is displayed near the top of the Admin Dashboard page.