3 years ago

Inter-observer agreement among uveitis experts on uveitic diagnoses: the Standardization of Uveitis Nomenclature (SUN) experience

To evaluate the interobserver agreement among uveitis experts on the diagnosis of the specific uveitic disease. Design Inter-observer agreement analysis Methods Five committees, each of 9 individuals, working in parallel, reviewed cases from a preliminary database of 25 uveitic diseases, collected by disease, and voted independently online whether the case was the disease in question or not. The agreement statistic, κ, was calculated for the 36 pairwise comparisons for each disease, and a mean κ was calculated for each disease. Following the independent online voting, committee consensus conference calls, using nominal group techniques, reviewed all cases not achieving supermajority agreement (>75%) on the diagnosis in the online voting to attempt to arrive at a supermajority agreement. Results A total of 5766 cases for the 25 diseases were evaluated. The overall mean κ for the entire project was 0.39 with disease-specific variation from 0.23 to 0.79. After the formalized consensus conference calls to address cases which did not achieve supermajority agreement in the online voting, supermajority agreement overall was reached on ∼99% of cases with disease-specific variation from 96 to 100%. Conclusions Agreement among uveitis experts on diagnosis is moderate at best but can be improved by discussion among them. These data suggest the need for validated and widely-used classification criteria in the field of uveitis.


Agreement among uveitis experts on the diagnosis of 5766 cases for 25 diseases was moderate (overall mean κ=0.39), suggesting that groups of patients reported in the literature may not always be comparable. After formalized consensus conference calls, agreement was reached on 99% of cases, implying that validated and widely-used classification criteria for the uveitides may improve this situation.

Publisher URL: www.sciencedirect.com/science

DOI: S0002939417304592

You might also like
Discover & Discuss Important Research

Keeping up-to-date with research can feel impossible, with papers being published faster than you'll ever be able to read them. That's where Researcher comes in: we're simplifying discovery and making important discussions happen. With over 19,000 sources, including peer-reviewed journals, preprints, blogs, universities, podcasts and Live events across 10 research areas, you'll never miss what's important to you. It's like social media, but better. Oh, and we should mention - it's free.

  • Download from Google Play
  • Download from App Store
  • Download from AppInChina

Researcher displays publicly available abstracts and doesn’t host any full article content. If the content is open access, we will direct clicks from the abstracts to the publisher website and display the PDF copy on our platform. Clicks to view the full text will be directed to the publisher website, where only users with subscriptions or access through their institution are able to view the full article.