Statistical databases: the reference environment and three layers proposed by Eurostat

Abstract

The functions of the Eurostat information system are divided into four sectors which correspond to the various stages in the processing of data from their collection to their difussion: - Production: collection, validation and storage of the data and meta-data; - Storage of the reference data (acceptance of the information); - Use of the reference data (visibility/security and find/deliver); - Diffusion. The system of acquisition and validation represents for Eurostat a major workload given the diversity of the partners and of the different data processing situations encountered. The upshot of the diversity and change in both the production and dissemination environments is the need to de-couple them. If there are n production systems and m dissemination systems, then there will be a need for n*m interfaces between them. This will lead to an explosion of work to long term to have the data available to end-users. If a reference layer is inserted to de-couple the production and dissemination environments, the interface problem reduces to n+m and therefore becomes much more manageable. Once the interfaces to and from the reference layer are defined, new tools, products or domains in either environment are easily added. By de-coupling production from dissemination, a reference layer enables producers the freedom that they require to choose the most appropriate tools an techniques to do their job. Producers also gain a common interface into the reference area, rather than the many different interfaces that they have to cope with at present. By providing well documented data in a standard form, the reference layer provides disseminators with better raw materials for their products. This enables them to provide better and more diverse products in a more timely and customer-driven fashion, as desired in Eurostat's mission statement.