---
_id: '6482'
abstract:
- lang: eng
  text: 'Computer vision systems for automatic image categorization have become accurate
    and reliable enough that they can run continuously for days or even years as components
    of real-world commercial applications. A major open problem in this context, however,
    is quality control. Good classification performance can only be expected if systems
    run under the specific conditions, in particular data distributions, that they
    were trained for. Surprisingly, none of the currently used deep network architectures
    have a built-in functionality that could detect if a network operates on data
    from a distribution it was not trained for, such that potentially a warning to
    the human users could be triggered. In this work, we describe KS(conf), a procedure
    for detecting such outside of specifications (out-of-specs) operation, based on
    statistical testing of the network outputs. We show by extensive experiments using
    the ImageNet, AwA2 and DAVIS datasets on a variety of ConvNets architectures that
    KS(conf) reliably detects out-of-specs situations. It furthermore has a number
    of properties that make it a promising candidate for practical deployment: it
    is easy to implement, adds almost no overhead to the system, works with all networks,
    including pretrained ones, and requires no a priori knowledge of how the data
    distribution could change. '
alternative_title:
- LNCS
article_processing_charge: No
arxiv: 1
author:
- first_name: Rémy
  full_name: Sun, Rémy
  last_name: Sun
- first_name: Christoph
  full_name: Lampert, Christoph
  id: 40C20FD2-F248-11E8-B48F-1D18A9856A87
  last_name: Lampert
  orcid: 0000-0001-8622-7887
citation:
  ama: 'Sun R, Lampert C. KS(conf): A light-weight test if a ConvNet operates outside
    of Its specifications. In: Vol 11269. Springer Nature; 2019:244-259. doi:<a href="https://doi.org/10.1007/978-3-030-12939-2_18">10.1007/978-3-030-12939-2_18</a>'
  apa: 'Sun, R., &#38; Lampert, C. (2019). KS(conf): A light-weight test if a ConvNet
    operates outside of Its specifications (Vol. 11269, pp. 244–259). Presented at
    the GCPR: Conference on Pattern Recognition, Stuttgart, Germany: Springer Nature.
    <a href="https://doi.org/10.1007/978-3-030-12939-2_18">https://doi.org/10.1007/978-3-030-12939-2_18</a>'
  chicago: 'Sun, Rémy, and Christoph Lampert. “KS(Conf): A Light-Weight Test If a
    ConvNet Operates Outside of Its Specifications,” 11269:244–59. Springer Nature,
    2019. <a href="https://doi.org/10.1007/978-3-030-12939-2_18">https://doi.org/10.1007/978-3-030-12939-2_18</a>.'
  ieee: 'R. Sun and C. Lampert, “KS(conf): A light-weight test if a ConvNet operates
    outside of Its specifications,” presented at the GCPR: Conference on Pattern Recognition,
    Stuttgart, Germany, 2019, vol. 11269, pp. 244–259.'
  ista: 'Sun R, Lampert C. 2019. KS(conf): A light-weight test if a ConvNet operates
    outside of Its specifications. GCPR: Conference on Pattern Recognition, LNCS,
    vol. 11269, 244–259.'
  mla: 'Sun, Rémy, and Christoph Lampert. <i>KS(Conf): A Light-Weight Test If a ConvNet
    Operates Outside of Its Specifications</i>. Vol. 11269, Springer Nature, 2019,
    pp. 244–59, doi:<a href="https://doi.org/10.1007/978-3-030-12939-2_18">10.1007/978-3-030-12939-2_18</a>.'
  short: R. Sun, C. Lampert, in:, Springer Nature, 2019, pp. 244–259.
conference:
  end_date: 2018-10-12
  location: Stuttgart, Germany
  name: 'GCPR: Conference on Pattern Recognition'
  start_date: 2018-10-09
date_created: 2019-05-24T09:48:36Z
date_published: 2019-02-14T00:00:00Z
date_updated: 2024-02-22T14:57:29Z
day: '14'
department:
- _id: ChLa
doi: 10.1007/978-3-030-12939-2_18
ec_funded: 1
external_id:
  arxiv:
  - '1804.04171'
intvolume: '     11269'
language:
- iso: eng
main_file_link:
- open_access: '1'
  url: https://arxiv.org/abs/1804.04171
month: '02'
oa: 1
oa_version: Preprint
page: 244-259
project:
- _id: 2532554C-B435-11E9-9278-68D0E5697425
  call_identifier: FP7
  grant_number: '308036'
  name: Lifelong Learning of Visual Scene Understanding
publication_identifier:
  eissn:
  - 1611-3349
  isbn:
  - '9783030129385'
  - '9783030129392'
  issn:
  - 0302-9743
publication_status: published
publisher: Springer Nature
quality_controlled: '1'
related_material:
  record:
  - id: '6944'
    relation: later_version
    status: public
scopus_import: '1'
status: public
title: 'KS(conf): A light-weight test if a ConvNet operates outside of Its specifications'
type: conference
user_id: c635000d-4b10-11ee-a964-aac5a93f6ac1
volume: 11269
year: '2019'
...