Currently the plugin does not report correct results in case the basedir property (used to shorten checkstyle reported file names) is set in the checkstyle configuration. A more sophisticated checkstyle -> eclipse workspace file resolution implementation should fix that.
Fixed for 5.0.2