Good news, we were able to find the root cause of this issue.
Actually @pfaffman was reviewing our site settings and found out that we had changed a few default settings that had caused the issue.
For other users who might have this issue we had added several words to the Flag admin setting admin/logs/watched_words/action/flag including our own brandname pricemate along a few others.
We also changed settings like min post length among a few others to a very low value which could have also caused some issues. After removing those words and reverting the Posting settings to their default values the issue disappeared.
Kudos again to @pfaffman and thanks for helping us with this!
