Agreed--also report what you decide! I'm wondering what most people do because the expectation of having a kappa of about .80 is harder if easy-to-code items (e.g. questions coded as "question") are not included. The standard of .80 should consider whether easy-to-code stuff is coded or not.