Intercoder reliability test results for air pollution content analyses

The document provides reliability test results for two content analysis categories: perceived health problems and perceived vulnerable populations resulting from air pollution. It utilizes percent agreement and Krippendorff's alpha, noting that low alpha values in some categories are due to low incidence of those categories in the data.

• The intercoder reliability for perceived health problems from air pollution shows high percent agreement across most categories, with Krippendorff's alpha reaching 1.00 for categories such as 'Black lung', 'Eye irritation', and 'Immune deficiencies'. However, some categories like 'Birth defects/premature birth' and 'No response' have a Krippendorff's alpha of 0.00 despite high percent agreement.
• Reliability statistics for perceived vulnerable populations from air pollution indicate high agreement, with Krippendorff's alpha of 1.00 for 'Smokers', 'Uninsured/limited healthcare', 'Women', and 'Don't know'. Categories such as 'Other' and 'Unintelligible' show lower alpha values of 0.40 and 0.27 respectively.
• The document notes that certain categories exhibit high percent agreement but low Krippendorff's alpha (below .667), which is attributed to the low incidence of those specific categories within the data.

APA

Yale Program on Climate Change Communication (n.d.). Intercoder reliability test results for air pollution content analyses. http://climatecommunication.yale.edu/wp-content/uploads/2019/05/Intercoder-reliability-test-results-for-air-pollution-content-analyses.pdf

Chicago

Yale Program on Climate Change Communication. Intercoder reliability test results for air pollution content analyses. n.d. http://climatecommunication.yale.edu/wp-content/uploads/2019/05/Intercoder-reliability-test-results-for-air-pollution-content-analyses.pdf.

Wikipedia

{{cite report |author=Yale Program on Climate Change Communication |title=Intercoder reliability test results for air pollution content analyses |url=http://climatecommunication.yale.edu/wp-content/uploads/2019/05/Intercoder-reliability-test-results-for-air-pollution-content-analyses.pdf |access-date=23 October 2026 |via=Climate Insights Directory}}

BibTeX

@techreport{yaleprogramonclimatechangecommunicationndintercoder, author = {{Yale Program on Climate Change Communication}}, title = {{Intercoder reliability test results for air pollution content analyses}}, institution = {Yale Program on Climate Change Communication}, url = {http://climatecommunication.yale.edu/wp-content/uploads/2019/05/Intercoder-reliability-test-results-for-air-pollution-content-analyses.pdf}, urldate = {2026-10-23}, note = {Indexed by Climate Insights Directory} }