PURPOSE
This app can be used to assess if appraisers are consistent with themselves, with each other, and with the known standards.
INSTALLATION
Download the file Attribute Agreement Analysis.opx, and then drag-and-drop onto the Origin workspace. An icon will appear in the Apps Gallery window.
OPERATION
1. Make a worksheet active.
2. Click Attribute Agreement Analysis app icon in Apps Gallery window to open the setting dialog.
3. According to the arrangement of your data, select the column as the corresponding data input.
4. You can keep the default settings, or change it accordingly, and then click OK button to generate the report.
DIALOG SETTINGS
Attribute/Rating Arranged As: According to the arrangement of your data, select one type for input data, Single Column or Multiple Columns.
Attribute/Rating Data: The response data, available when data is in Single Column.
Samples: The sample names or identifiers, available when data is in Single Column.
Appraisers: The appraisers column, available when data is in Single Column.
Number of Appraisers: Specify the number of appraisers, available when data is in Multiple Columns.
Number of Trials: Specify the number of trials, available when data is in Multiple Columns.
Appraiser Names: Specify the name of appraisers, available when data is in Multiple Columns.
Known Standard/Attribute: The known standard for each sample.
Categories of Ordinal Data: If consider the rating as categories of ordinal data. To get Kendall's coefficients, check it.
Calculate Cohen's Kappa if Appropriate: To calculate Cohen's kappa statistics, it needs to meet some conditions. Check this to calculate Cohen's kappa statistics if the conditions are met.
Confidence Level (%): Specify the confidence level.
Output Report: Specify where to output the report.