sbi.diagnostics.check_sbc

Navigation

sbi.diagnostics.check_sbc#

check_sbc(ranks, prior_samples, dap_samples, num_posterior_samples=1000, num_c2st_repetitions=1)[source]#

Return uniformity checks and data-averaged posterior checks for SBC.

Parameters:
  • ranks (Tensor) – Ranks for each SBC run and for each model parameter, shape (N, dim_parameters)

  • prior_samples (Tensor) – N samples from the prior

  • dap_samples (Tensor) – N samples from the data-averaged posterior

  • num_posterior_samples (int) – Number of posterior samples used for SBC ranking.

  • num_c2st_repetitions (int) – Number of times C2ST is repeated to estimate robustness.

Returns:

  • ks_pvals: p-values of the Kolmogorov-Smirnov test of uniformity, one for each dim_parameters.

  • c2st_ranks: C2ST accuracy between ranks and uniform baseline, one for each dim_parameters.

  • c2st_dap: C2ST accuracy between prior and DAP samples, single value.

Return type:

Dictionary containing