In parameter estimation, it is often desirable to supplement the estimates with an assessment of their quality. A new family of methods proposed by Campi et al. for this purpose is particularly attractive, as it makes it possible to obtain exact, non-asymptotic confidence regions under mild assumptions on the noise distribution. A bottleneck of this approach, however, is the numerical characterization of these confidence regions. So far, it has been carried out by gridding, which provides no guarantee as to its results and is only applicable to low dimensional spaces. This paper shows how interval analysis can contribute to removing this bottleneck.