The Multi-Sample Summary Report allows you to longitudinally assess concordance, accuracy, or field-level agreement across multiple versions for multiple samples. It is exportable or can be used interactively to explore the root of differences between versions.

To use this report, open the Multi-sample Summary from the Reporting Dashboard. Note the report "against" type at the top right -- Against Baseline or Against Previous. Clicking this will allow you to toggle between the two comparison methods:

To change the order of versions in your report (especially useful for Against Previous comparisons), simply click the version name and drag it to your desired position. Click Submit to refresh the results.

Note: the drag controls will not allow you to drag a version to the end of the list. To accomplish this, you can drag the last version to the left to swap with the second-to-last.

The buttons above the table allow you to toggle the report to show different summary metrics for each comparison version against the baseline (either the baseline version or the previous version).

Performance Metrics

The Concordance, Precision, Recall, and F1 buttons compare performance statistics between versions for each sample. Note: the accuracy metrics here are comparison-based, treating the baseline version as "truth". For ground-truth-based accuracy reporting, see Comparing Results.

Field-Level Differences

The buttons to the top right of the report table list all numeric fields detected from your result outputs. Click on any field name to show a summary of differences in that field between matched items. The checkboxes toggle whether the differences are displayed as absolute value or directional, and as raw values or proportional.

For example, if genomic variant chr1:123 A>T was called in versions v4.0 and v5.0, but had a depth of 50 in v4.0 and 40 in v5.0, the difference for that result would be:

The table displays the mean value for these differences across all matched results between each baseline-test version pair in a given sample.

Click the Export button at the top of the report table to export it at any time. The export will reflect the metrics currently displayed in the table.

Each cell in the table is a hyperlink to the Query View for the statistic being displayed. Click on the cell to open up a new tab where you can view the supporting charts (for diffs) or continue to interactively query on the paired result-sets.

From the Query View, you can also jump to Result-Level Compare (to explore individual differing results against their evidence visualizations) or Explore/Report view to compare the paired result-sets in an interactive or pre-configured benchmarking report.