{"query_echo":{"q":"","filters":{"analysis_type":["reliability test"]},"warnings":[{"code":"facet_value_not_in_vocabulary","message":"Value 'reliability test' for facet 'analysis_type' is not in the controlled vocabulary."}]},"total":{"value":1,"relation":"eq"},"page":1,"page_size":20,"self":"https://climateinsightsdirectory.org/api/v1/search?analysis_type=reliability+test","stability":"beta","ai_marking":{"digital_source_type":{"uri":"http://cv.iptc.org/newscodes/digitalsourcetype/trainedAlgorithmicMedia","name":"Created using Generative AI"},"notice":"Summary and key insights are generated using artificial intelligence."},"results":[{"id":"commyale-000259","url":"https://climateinsightsdirectory.org/document/commyale-000259","title":"Intercoder reliability test results for air pollution content analyses","publisher":{"name":"Yale Program on Climate Change Communication","organization":"yale-program-on-climate-change-communication"},"document_type":"research paper","language":"en","date_published":null,"source_url":"http://climatecommunication.yale.edu/wp-content/uploads/2019/05/Intercoder-reliability-test-results-for-air-pollution-content-analyses.pdf","generator":"Climate Insights Directory","generated_fields":["summary","key_insights","climate_tags","analysis_type"],"summary":{"text":"The document provides reliability test results for two content analysis categories: perceived health problems and perceived vulnerable populations resulting from air pollution. It utilizes percent agreement and Krippendorff's alpha, noting that low alpha values in some categories are due to low incidence of those categories in the data.","ai_generated":true,"unit":"commyale-000259#summary","date_modified":"2026-10-23"},"key_insights":[{"text":"The intercoder reliability for perceived health problems from air pollution shows high percent agreement across most categories, with Krippendorff's alpha reaching 1.00 for categories such as 'Black lung', 'Eye irritation', and 'Immune deficiencies'. However, some categories like 'Birth defects/premature birth' and 'No response' have a Krippendorff's alpha of 0.00 despite high percent agreement.","ai_generated":true,"unit":"commyale-000259#insight-1","date_modified":"2026-10-23"},{"text":"Reliability statistics for perceived vulnerable populations from air pollution indicate high agreement, with Krippendorff's alpha of 1.00 for 'Smokers', 'Uninsured/limited healthcare', 'Women', and 'Don't know'. Categories such as 'Other' and 'Unintelligible' show lower alpha values of 0.40 and 0.27 respectively.","ai_generated":true,"unit":"commyale-000259#insight-2","date_modified":"2026-10-23"},{"text":"The document notes that certain categories exhibit high percent agreement but low Krippendorff's alpha (below .667), which is attributed to the low incidence of those specific categories within the data.","ai_generated":true,"unit":"commyale-000259#insight-3","date_modified":"2026-10-23"}],"climate_tags":["air pollution","public health"],"geography_discussed":[],"frame_perspective":[],"analysis_type":["reliability test"]}]}