The IRS division responsible for flagging Tea Party groups has long been an agency afterthought, beset by mismanagement, financial constraints and an unwillingness to spell out just what it expects from social welfare nonprofits, former officials and experts say.