Fourth Framework Programme of European Community Activities in the Field of Research and Technological Development

Fourth Framework Programme of European Community activities in the field of Research and Technological Development

"Telematics Applications Programme"

Sector: Libraries

FINAL REPORT FROM: APRIL 1, 1998 TO: SEPTEMBER 31, 2000

Project Number: LB-5609 Project Acronym: EULER Project title: European Libraries and Electronic Resources in Mathematical Sciences

Project coordinator Michael Jost Dept. Math. & Comput. Sci. Fachinformationszentrum Karlsruhe Franklinstr. 11 D-10587 Berlin Germany Tel. +49 30 3999340 Fax +49 30 3927009 E-mail [email protected]

List of Partners Organisation Role Country FIZ - Fachinformationszentrum Karlsruhe C DE TUB - Technische Universität Berlin A DE MDC - Université J. Fourier, MathDoc Cell C FR NetLab - Lunds Universitet, Library C SE SUB - Universität Göttingen, Staats- u. Univ.Bibliothek C DE CWI - Centrum voor Wiskunde en Informatica A NL UNIFI - Università degli Studi di Firenze A IT EMS - European Mathematical Society X FI FHK - Fachhochschule Köln X DE FHHH - Fachhochschule Hamburg X DE

DRAFT, July 30, 2001 EULER Final Project Report Table of Contents

Executive Summary ______3 Starting Point ______3 Goals ______3 Integration Approach ______3 Consortium______3 Work Done______4 Main Achievements ______5 Major Problems ______5 Outlook ______6 Project Workplan and Work Actually Carried Out______7 WP-0 Project Management ______7 WP-1 Requirements Analysis ______7 WP-2 Resource Adaptation ______9 WP-3 EULER Engine And User Interface______12 WP-4 Evaluation And Demonstration ______14 WP-5 Information Dissemination And Exploitation Preparations ______15 Assessment of achievements ______16 Overall Performance ______16 Main Achievements ______16 Workpackage Performance ______17 Validation activities ______18 Major Problems ______18 Deliverables Completed______19 Impact of results and Exploitation plan ______20 Results of the Final Project Review______23 Outlook ______24 APPENDIX______25 Background Information______25 Compliance of the Project with Objectives of the Libraries Workprogramme ______25 Consortium______26 Involvement in and Relationship to National, EU or Other Relevant Programmes ______27 Modifications of Workplan______28 Modifications and developments following the interim reviews ______28 Further Problems and Decisions, Changes to the Workplan ______28 Concertation activities in the Telematics for Libraries sector ______29 Dissemination Activities ______30

p. 2 EULER Final Project Report Executive Summary From April 1998 to September 2000 the European Commission has been funding the EULER project in the framework of the `Telematics for Libraries' sector from the Telematics Applications programme. The main goal of EULER was to integrate different, electronically available information resources in the field of mathematics. EULER has constructed a digital library in mathematics from existing heterogeneous sources. This Final Report from the project summarizes the activities and achievements at the end of the project.

Starting Point There was, and still is, a rapid increase in the number of networked resources with information on scientific results and ongoing developments in the field of mathematics. Today, the user has to switch between a growing number of systems with heterogeneous user interfaces: • Scientific literature databases • Library OPACs and document delivery services • Electronic journals from academic publishers • Archives of preprints and grey literature • Quality controlled subject information gateways on the Internet • Robot-generated indexes of other relevant Internet resources These resource types are considered to be the most frequently used when conducting searches for scientific results. They are rarely interconnected and users have to search them one by one.

Goals The aim of the EULER project was to offer a one-stop-shopping site for users interested in mathematics. One single integrated networked based access point has been developed, covering a representative collection of the mentioned publications-related information resources in mathematics. A common user interface, available on the World Wide Web, allows homogeneous access to all integrated information types. The interface was developed in close cooperation with the mathematical user community. Only one search is necessary to generate a broad range of (mixed) hits, irrespective of resource type and information provider. The EULER services were developed starting with selected important information sources from the consortium partners. The goal was to design an open architecture. New sources of data from other information providers and libraries can be added easily.

Integration Approach The integration approach makes use of common resource descriptions based on the Dublin Core (DC) element set and access to those descriptions via the Z39.50 protocol. Technically, all information providers have produced DC metadata for their resources and offer them as distributed databases, which are located at the providers' sites. The central EULER Engine queries these databases in parallel via a common Z39.50 profile and performs result set merging, de-duplication, and presentation formatting. The integration approach takes into consideration the requirements of the user community and the different information providers. Participating institutions are still autonomous in deciding on their scientific and organisational policies, while at the same time providing a common access strategy to their information services. The foremost requirement to achieve such an aim was to choose and apply suitable standards, formats and protocols.

Consortium The consortium includes four libraries from different European countries, which also represent different types of libraries: A library with national responsibility in the field of pure mathematics (SUB Göttingen, Germany) A research library of a national research center (CWI Amsterdam, The Netherlands) A university library with its distributed department libraries (UNIFI, University of Florence, Italy) A library specialised in digital libraries and netbased information (NetLab, University of Lund, Sweden with subcontractor DTV - Technical Knowledge Center & Library of Denmark) In addition, a national center for coordination and resource-sharing of mathematics research libraries and mathematics departments (MDC, Cellule de Coordination Documentaire Nationale pour les Mathématiques, Grenoble, France ) has represented libraries (subcontractors: Bibliothèque Mathématique de Strasbourg, Bibliothèque Mathématique d'Orsay ) and library users in EULER.

p. 3 EULER Final Project Report The most comprehensive international abstracting and reviewing service for mathematics participated (FIZ Karlsruhe / Zentralblatt MATH). FIZ was coordinating partner of the project. The project was an initiative of the European Mathematical Society (EMS), which represents the mathematical community from the whole of Europe. EMS was represented in EULER through Prof. Dr. Bernd Wegner (Technische Universität Berlin, TUB), member of the EMS Committee on Electronic Publishing, member of the Committee on a European Database and Scientific Coordinator of the European Mathematical Information Service (EMIS) and its Electronic Library (ELibM).

Work Done The main objectives of the project were dealt within a set of five workpackages: An initial Requirements Analysis workpackage has worked on • User Requirements: discussion, definition, questionnaire, review and recommendations • Revision of methodologies: test and evaluate alternative concepts for the EULER system; integrate new relevant developments in the EULER system. • Standard developments monitoring: observing the developments of new important relevant standards, participation in relevant standard definition discussions. The Resource Adaptation workpackage has built the basic set of EULER Metadata Databases that are accessible from the EULER Engine. • Scientific Bibliographic Databases • Library OPACs • Preprint Servers • Refereed Electronic Journals • Mathematical Internet Resources Bibliographic Databases and OPACs have covered the broader scenario of automatic metadata to metadata conversion. Refereed Electronic Journals, Preprint Servers, and Mathematical Internet Resources have covered the broader scenario of resources harvesting, metadata creation (automatically or manually), and access to networked resources. The EULER Engine Implementation workpackage - carried out in parallel to the Resource Adaptation workpackage - has designed and implemented the EULER Engine. The EULER Engine acts as an "intelligent" gateway between users and the metadata databases produced in WP-2 by providing: • user oriented interfaces and help tools • the capability to re-map searches and browsing to the metadata DBs • the capability to collect answers (i.e. hits) and to present them by ranking, filtering, ordering etc. This includes both the user interfaces and the interfaces to the partners metadata databases and other selected Internet resources. During the Evaluation and Demonstration workpackage - carried out after the release of the EULER Engine (beta version) - selected groups of users have started system evaluation. The WP has measured the system’s suitability and scalability and the satisfaction level of users with the service. Information Dissemination and Exploitation Preparations: Information dissemination has taken place via professional journal articles, presentations at conferences, TAP concertation meetings, and similar events. Relevant reports of the project were made publicly available on the World Wide Web. The final exploitation plan for EULER services and other project results was prepared. Commercial exploitation for future operation of EULER services and transfer of EULER results to other subject domains was considered.

p. 4 EULER Final Project Report Main Achievements

· Open, high quality portal · The main objective of EULER has been met. The concept of a one-stop-shop site (portal to heterogeneous resources) has been proven technically feasible, with enabling key features such as cross collection browsing and searching, consolidated hitlist through de-duplication, etc. · The combination of mathematical bibliographic resources offered is unique. All types of resources have been integrated with a reasonable amount of data from important providers. · For the first time a homogeneous access to heterogeneous resources was implemented (e.g. access to the preprint, the published article, and the review of the article being available through one single access point). · Document delivery services have been successfully integrated. · Record extraction strategies have been implemented by data providers, leading to a high precision of results. · Incorporation of "alien" data from non consortium partners is possible (tested with MPRESS, LANL). · European dimension, exploitation and impact of results · The project was one of the earliest actions in this area. No comparable services/systems are available. · A cooperation basis among important content suppliers across Europe has been established. New workflow models between partners were explored and implemented. This may lead to a fruitful cooperation in extending the EULER service to a (commercially) exploitable sustainable service. · Comparisons with and evaluations of related projects/other activities and their results have been done. · Related projects and other ongoing developments (e.g. DESIRE, DECOMATE, RENARDUS) might benefit from the solutions developed in EULER. · An exploitation plan has been developed, taking into account also commercial considerations, aiming at establishing a sustainable and extended EULER service. · There's a high recognition of the brand name "EULER" in the mathematical community, also outside of Europe. · User needs and satisfaction: · Extensive user needs evaluations and result validation activities have been done, with results fed into the development cycle · Standardization and technological achievements · Interoperability (e.g. cross searching) and standardization issues have been solved: The common EULER metadata profile is an optimal solution, requiring minimal efforts. It is compatible with international standards. · Other standards (Z39.50, Dublin Core, http) have been proved valuable. · Difficult technical problems such as sorting and de-duplication of distributed result sets have been solved. · Several tools - available for use - were implemented, which enable new data providers to join EULER with low technical efforts. · The EULER de-duplication identifier (as a byproduct) enables new exploitable technologies for filling gaps in data providers information resources.

Major Problems

· Unexpected problems which have appeared during the project: · Performance (responsiveness) of the system/engine partly due to its distributed architecture. May be crucial in the case of upscaling (more partners). · The necessary adaptation of resources to the common EULER format might be a barrier for extending the service to new partners. Candidate content suppliers with large amounts of data (covering broader or several scientific disciplines) may not be very enthusiastic at the prospect of data conversion at regular intervals. · Integrating the service components (from each contributing partner) into a service with a uniform look-and-feel to the end-user has not been achieved: the true transparent digital library. · The integration of the EULER metadata creator into the system seems not fully satisfactory. · Related issues: · Many European library resources are yet not electronically available. · Integration of non-internet (books, etc.) and non-quality-controlled internet resources (robot-gathered web pages) is an intrinsically difficult problem, with aspects such as scientific quality, user expectations, standardization issues. · Design of a satisfactory Human-Computer Interface in relation to search functionality remains a task with high priority. · Political and economic impediments are not to be underestimated.

p. 5 EULER Final Project Report Outlook

· A sustainable future EULER service seems feasible, if a funding scheme (concerned also with commercial considerations) can be found. · The economic viability may be shown in a follow-up project to EULER. It may help if for this purpose important publishers in the field of mathematics and other commercial partners such as software producers may be interested in supporting or associating with a consortium of such a follow-up project. Exploitation might aim at adopting typical commercial strategies based on Web economy. · Application to other sciences (also cross searches), e.g. mathematics - physics - computer science. · Direct "linking" of the EULER gateway to other Z39.50 servers (non-Zebra) without the need of conversion of data should be seriously considered. · Scalability and performance issues should be explored against the trade-off between decentralized and centralized architectures. Organizational aspects in this context should also be taken into consideration. · Issues of access control versus free access should be dealt with in future plans. · The Human-Computer Interface design (search functionality) might benefit from an innovative approach. · A sustainable service needs to co-exist with all kinds of other initiatives in the information landscape. Therefore, interfacing with these other services seems important. Ways should be found to interact with these other services (also outside the EU) in a beneficial way for the end-user.

p. 6 EULER Final Project Report Project Workplan and Work Actually Carried Out The project workplan was structured using the convention of Workpackages and Tasks. The following section gives for each Workpackage/Task the responsible Task Leader and the other participating partners; the duration of the Workpackage/Task; a descriptive text of the aims of the Workpackage/Task; and the outcome (deliverable) of the Task.

WP-0 Project Management Task leader: FIZ (18 MM) Participants: All Duration: 30 months

Aims: General project management and coordination. Knowledge and skills transfer between consortium members. Managing copyright, licensing, and legal issues. Relation to the Commission. Progress reporting. Outcome: All relevant reports appear on the web site of the project.

WP-1 Requirements Analysis T1.1 User Requirements

Task leader: SUB Participants: TUB, NetLab, UNIFI, CWI Duration: 2 months

Aims: Broad information and active integration of the mathematical community about the content and the aims of the project (publications, lectures at internal and national meetings and workshops in Mathematics), leading to more feedback of the user community, and thus to a better streamlining of the general EULER aims. Discussion in the mathematical community on different levels (international, Europe, in several countries) Build up a open electronic discussion forum (Mailing list and server) for EULER. Form a discussion group from European mathematicians for gathering more user-stimulation for the project (mailing list and meetings); the permanent dialogue with special user groups The user needs will be collected in a report. Outcome: Deliverable D1.1 “Report on User Needs”: The main aim of the EULER user questionnaire was to obtain the prospective users' suggestions and expectations for the EULER system. The questionnaire was completed by 132 persons from 16 countries. The electronic version of the questionnaire was much better accepted than the print version which was mainly disseminated at ICM 98. Most respondents worked with the Internet on a regular basis and were sufficiently equipped to make use of advanced technological solutions. The answers to the questionnaire have confirmed that the basic design decisions for the EULER system were well accepted and have also implied suggestions for the design of specific details of the services to be offered. The questionnaire was discussed in the EULER Work Package task 1.1 of the EULER project by SUB, EMS, NetLab, UNIFI and CWI. Responsible for the design was the task leader SUB Göttingen. All EULER partners have distributed and introduced the questionnaire to the mathematical community and the associated library scene. Furthermore, all visitors to the EULER sites were invited to fill out the questionnaire. The results have shown how the respondents to the EULER questionnaire expect the design and the functionality of the EULER system. The questionnaires give indications about the users' approach to the Internet.

p. 7 EULER Final Project Report T1.2 Revision of methodologies, Standard developments monitoring

Task leader: NetLab Participants: All Duration: periodically (see bar chart)

Aims: Revising parts of the projects methodologies during the project to ensure flexibility with respect to technological changes.

• test and evaluate alternative concepts for the EULER system

• integrate new relevant developments in the EULER system Observing the developments of the important standards such as Dublin Core metadata or Z39.50 protocol, and the development of new relevant standards. Actively participate at the relevant conferences in the fields of information science and computer science (especially the fields of metadata, search and retrieval, and Internet) Outcome: Three internal reports (Deliverable D1.2 “Periodical revision and internal standard development reports”) were written: The first report is a bundle of methodology reports. Chapter 1 of the report evaluates different mathematical information services (MPRESS incl. parts of LANL, D-MPRESS, SIGMA and Dissertationen online) for a possible integration into the EULER service. Beside the characteristics of the special service this crucially depends on the offered metadata quantity and quality, which were assessed by the analysis of result sets to special search queries. (In the case of a positive evaluation, mappings for the data conversion of that service are given.) Technical problems of the examined mathematical Internet services were named. Chapters 2, 3 and annex 2 describe how the Decentralized Metadata Processor (ISO-tool) is used in EULER to do diacritics normalization and generation of a key to support elimination of duplicates. Chapter 4 is a methodological study/proposal about possible technical interpretations of ``using Z39.50 as a protocol and DC for resource description''. Investigations of a possible adaptation of ZSTARTS approaches were done The second report looks at two initiatives using Z39.50 (The virtual Canadian union catalogue and The Z-starts initiative) that are of interest to EULER. It also contains a comment to the 15 element collapse proposal (from the first periodical report) from a Z39.50 perspective. The third report deals with Document Delivery models and their possible inclusion in EULER, a discussion on Z39.50, reports on trials with other Z39.50 servers than Zebra, and an experiment to exploit the EULER de-duplication identifier.

p. 8 EULER Final Project Report WP-2 Resource Adaptation This Work Package has built the basic set of EULER Metadata Databases that were finally accessible from the EULER Engine. The Work Package was subdivided into five Tasks covering the five initial resource types that are part of EULER:

• T2.1 Scientific Bibliographic Databases

• T2.2 Library OPACs

• T2.3 Preprint Servers

• T2.4 Refereed Electronic Journals

• T2.5 Mathematical Internet Resources Bibliographic Databases and OPACs have covered the broader scenario of automatic metadata to metadata conversion. Refereed Electronic Journals, Preprint Servers, and Mathematical Internet Resources have covered the broader scenario of resources harvesting, metadata creation (automatically or manually), and access to networked resources. From the technical point, T2.3, T2.4 and T2.5 on one side, and T2.1 and T2.2 on the other side, have shared similar approaches and tools. Outcome: All resources have been made accessible as standardised EULER metadata database. Action plans for WP 2 tasks were defined during the 1st project management meeting. All partners in WP 2 have selected and extracted test data from their services and resources. Some first versions of converters to a (not yet fully stable) common format were done. Preliminary local Z39.50 database installations and indexing tests were done by some partners.

Several further versions of converters to the common format were done. This common Dublin Core based metadata format (formats and rules for single DC database fields) was extensively discussed during the meetings and via the project's mailing list, in close connection with WP 3 tasks, and is now stable. A common post processing tool creates uniform index entries and constructs common de-duplication identifier for all documents. Extraction routines, converters, and the post-processing tool were continuously refined and updated, following the formats/rules discussions. Local Z39.50 database installations were done by all partners. The Z39.50 servers share common configurations and were accessible from the alpha version of the WWW gateway (EULER Engine).

After an intermediate evaluation of the alpha version of the service, final versions of the local Z39.50 database installations were done by all partners. The Z39.50 servers share common configurations and are accessible from the beta version of the WWW gateway. External information providers have been contacted and asked to participate in the EULER framework. As a result, MDC was able to set up an EULER server for preprint data from MPRESS. All resource adaptation tasks have produced documentation (public reports) with descriptions of the data used, the methods applied for conversion, and an analysis of their findings. An extra "general introduction" to the task Deliverables gives an overview for the whole resource adaptation work package and states those facts that are of importance for all single tasks: Overview of EULER aims in general and of the resource adaptation work package in particular, including an overview of information providers in the project and their respective data(bases) they have provided; a high-level description of the methods used, including relevant specifications that are of relevance to all tasks (such as the specification of Dublin Core Element Set usage, indexing strategy, and provisions for de-duplication); Ongoing and further work after the completion of the resource adaptation.

T2.1 Bibliographic Databases

Task leader: FIZ Participants: - Duration: 20 months

Aims: Implement automatic format conversion of a selected set of the data of MATH Database (Zentralblatt für Mathematik, more than 1.500.000 entries covering the world-wide mathematical literature from 1931 to present) from the proprietary MATH format to the common EULER Dublin Core based format. Enrich the original data with necessary means of identification (e.g. internationally accepted standard document identifiers for single articles) to enable the effective exchange of data between different systems. Outcome: Deliverable D 2.1 “A frontend DC metadata database for the data of MATH Database incl. Documentation” documents the work done in this task.

p. 9 EULER Final Project Report T2.2 OPACs

Task leader: SUB Participants: UNIFI, CWI, MathDoc Duration: 16 months

Aims: Produce routines for the (semi-)automatic extraction of (subsets of) relevant OPAC entries and conversion routines for the format conversion to the EULER Dublin Core based format, including automatic update procedures. Make a standardised EULER metadata database with these data accessible to be queried by the central EULER Engine. Include connections to existing online document delivery services, based on forwarding relevant data directly to the ordering systems. Outcome: Deliverable D2.2 “A frontend DC metadata database for the data of every participant OPAC (incl. documentation)” documents the work done in this task. T2.3 Preprint Servers

Task leader: CWI Participants: SUB, MathDoc Duration: 16 months

Aims: Produce frontend DC metadata database for preprint series and other grey literature of scientific institutions that are electronically available through the Internet, by means of automatic gathering/harvesting the original sources, and automatic conversion to Dublin Core. Integrate preprint referencing, metadata search and full-text retrieval. Implement and test the automatic supply of institutes preprints to specialised libraries, and the subsequent use at the library (including long-term availability). It was expected to be sufficient to include only preprints of relatively few institutes in this task. Other (national) initiatives such as the German DFN project MathNet, and the collections of French preprints have been informed of EULER results and requirements, and were asked to contribute to a common development. Likewise, EULER has monitored activities in this sector in WP-1, and has refined its specifications to enable concerted international actions. Outcome: Deliverable D2.3 “A frontend DC metadata database for preprints and other grey literature published by research institutions, incl. Documentation” documents the work done in this task. T2.4 E-journals

Task leader: FIZ Participants: TUB Duration: 16 months

Aims: Systematically add metadata descriptions to a carefully selected set of high-quality peer reviewed electronic mathematical journals and other publications. Metadata descriptions for these electronic publications

• were used to generate a EULER DC metadata database, thus enabling users to effectively search for electronic publications in the same way as in all other EULER metadata databases.

• were used in the production process of the electronic journal issues themselves, by the use of fully automated procedures that generate all the necessary index- and table-of-contents pages as well as individual journal articles homepages out of the metadata descriptions. Costly and time-consuming manual preparation (as it is done today) will be eliminated. Metadata will substantially facilitate and speed up the preparation of the final electronic product, and enhance its quality and usability.

• provide the basic means of enabling Online Delivery of the publications irrespective of protocols and formats. This is an important point when it comes to technology changes. The collection of electronic publications to be covered in this task of the EULER project was taken from the Electronic Library of Mathematics, that is distributed through the European Mathematical Society’s system of Internet servers, EMIS, http://www.emis.de/.

p. 10 EULER Final Project Report Outcome: Deliverables D 2.4 “A frontend DC metadata database for EMIS electronic journals, incl. Documentation.” documents the work done in this task. T2.5 Internet Mathematical Resources

Task leader: NetLab Participants: SUB, CWI Duration: 20 months

Aims: Comprehensively collect publications, information, resources and services in Mathematics published on the Internet, offer them as a searchable and browseable service and prepare the integration with the other "more traditional" bibliographic databases and fulltext publications in project EULER by creating DC metadata records for them. Sub-task a: Developing a quality controlled information gateway Mathematics, carefully selecting, describing and organising Internet resources in this subject area. The participants cooperate in the selection of relevant mathematical resources from the Internet into an quality controlled service. The approaches and solutions of the EU project DESIRE were partially built upon. The Subject Gateway MathGuide (SUB) has been the starting point, SUB and CWI have added new resources Sub-task b: Using a harvesting robot to systematically and automatically gather "all" mathematical resources on the Internet into a "Mathematical Web Index". Build a robot generated "Mathematical Web Index" consisting of "all" mathematical Web pages and resources on the Internet with focus on HTML pages. This builds upon the robot software developed for the project DESIRE and methodologies first tested in the "Engineering Electronic Library, Sweden (EELS)" (http://www.ub2.lu.se/eel/eelhome.html) project. To increase the quality of this database, NetLab offered a Dublin Core Metadata creation and support site for publishers of European mathematical Web pages, connected to the database. A general outcome of the work of task T2.5 comprises the identification of possible limitations and necessary improvements of the Dublin Core. A list of recommendations for modification or adaptation of the Dublin Core scheme will be published as a project report. Outcome: The Deliverables: D2.5.1 “A quality controlled information gateway Mathematics, incl. a frontend DC metadata with documentation database” D2.5.2 “A robot-generated "Mathematical Web Index", incl. metadata and documentation” D2.5.3 “A public Dublin Core Metadata creation and support site for Mathematicians” document the work done in this task.

p. 11 EULER Final Project Report WP-3 EULER Engine And User Interface This WP has carried out the design and the implementation of the EULER engine. The EULER engine acts as an "intelligent" gateway between users and the metadata databases produced in WP-2 by providing: a) user oriented interfaces and help tools b) the capability to re-map searches and browsing to the metadata databases c) the capability to collect answers (i.e. hits) and to present them offering different filtering and sorting options The software development was based on prototyping. The solution was based on the Z39.50 standard, the Zebra server from Index Data in Copenhagen, an enhancement of the EUROPAGATE (EU project) gateway and improvements and developments from other related projects carried out by NetLab. The software solution was adapted to the EULER profile and metadata format and to the user requirements. Metadata databases for the single services were built up by the partners in WP-2 using metadata creation and/or conversion to the agreed EULER format, a variant of the Dublin Core Element Set. The metadata for all databases are interoperable and allow congruent and parallel searching in all databases. In WP 3, the technical user interface and EULER Engine design started in June 1998. The corresponding deliverable is due in October 1998. The common Dublin Core based metadata format was extensively discussed during the meetings and via the project's mailing list, in close connection with WP 2 tasks.

The technical user interface and EULER Engine design was completed in October 1998 (Deliverable D3.1, part of Milestone 1). Implementation of the EULER Engine and user interface started immediately thereafter. A first internal test-gateway with rudimentary parallel search over distributed databases was internally tested in January 1999. A first prototype of the user interface was presented during the Grenoble management meeting and discussed. In June 1999, the completed alpha version of the EULER Engine was presented to the public, and evaluation started. This evaluation was accomplished by conducting interviews with interested persons and by distributing questionnaires via the Internet. At the 4th management meeting in Grenoble it was decided to delay the end of Task 3.2 and the start of Task 3.3 for one month, due to restricted availability of potential evaluators during the summer months. Evaluation of users feedback has started in October 1999. Relevant findings resulted in a prioritized to-do-list, which was subsequently refined during project meetings and used as a basis for implementation work on the beta version of the EULER Engine. The system (beta version) was made publicly accessible in August 2000. Some last minute fine tuning and revision of the user interface were done afterwards. An installation package was produced and successfully tested by SUB, where an EULER gateway was implemented.

T3.1 Functional specification and design of the EULER engine and user interface

Task leader: NetLab Participants: FIZ, SUB, UNIFI, MDC, CWI Duration: 5 months

Aims: Perform the EULER engine functional analysis and design its architecture. User requirements derived from WP-1, and characteristics of the software and standards used were the reference for the functional design. Since the solution builds upon the Z39.50 Zebra server, the following was agreed upon and defined in order to allow the interchange between the existing databases and the Z39.50 servers: a) EULER's metadata format (Dublin Core variant), the fields and qualifiers used b) Metadata encoding c) The semantic interoperability, cataloguing rules d) EULER Z39.50 profile: attribute set (subset of Bib1, now extended with GILS, or a coming DC attribute set for Z39.50); list of search features supported in all databases (extended from ONE project), functionality. GRS1 record format delivered from the servers e) Transfer syntax to clients (GRS1). The establishment of the different separated frontend databases carrying the metadata was part of WP-2. The interface to metadata databases depends on choices and implementations made in WP-1 and WP-2. Deliverable D3.1 “Internal report: specification and design considerations” contains the relevant findings.

p. 12 EULER Final Project Report T3.2 Prototyping of EULER engine and user interface

Task leader: NetLab Participants: DTV (subcontractor Duration: Months

Aims: Adaptation and improvement of the ZEBRA server software and the EUROPAGATE gateway for simultaneous searching in Z39.50 databases. a) Develop a EULER implementation of Zebra b) Install the ZEBRA software for frontend metadata databases at all sites contributing with a database and wishing to use this standard solution c) Do a EULER adaptation of the EUROPAGATE gateway, incl. user interface d) Improve the performance of the EUROPAGATE gateway (options investigated: improved speed when several databases are used, start display before all results are received, duplicate removal; test Javascript options for user interface) Deliverable D3.2 was the prototype of the engine and user interface T3.3 Validation of the prototype

Task leader: SUB Participants: FIZ, NetLab, UNIFI, MDC, CWI Duration: 4 months

Aims: A selected group of mathematicians and librarians performs user interface validation to match user requirements defined in WP-1 immediately after finishing the prototype release. This was an iterative process, the results being fed back into the implementation tasks. Testing to debug and assess EULER engine components and metadata databases integration. A team of experts start the development of a tutorial to be included in the final version. Outcome: Deliverable D3.3 “Internal report: Evaluation of the prototype” contains the results of the evaluation T3.4 Development and implementation of the demonstrator

Task leader: NetLab Participants: FIZ, SUB, UNIFI, MDC, CWI Duration: 18 months

Aims: Correct, complete and improve the prototype according to the results of the validation stage. The final demonstrator includes: a) access to all resources; b) a tutorial; and c) support for multilinguality. Outcome: Deliverable 3.4 “EULER information system demonstrator” is the main deliverable from the project.

p. 13 EULER Final Project Report WP-4 Evaluation And Demonstration Task leader: SUB Participants: TUB, sponsoring partners Duration: 3 months

Aims: After the release of EULER Engine beta version: Selected groups of users start system exploitation and evaluation. The WP measures the system suitability and scalability and the satisfaction level of users with the service. Mainly, University and Scientific partners are involved in this stage. This was done in part in parallel with WP-3 to enable feed-back of first evaluation results into the development process. Users groups creation involving students, teachers, researchers and librarians. Tools to be used to capture their feedback and observation included: on-line forms (WWW), questionnaires-based interviews to specialised end-users, librarians assisted usage sessions. System test have evaluate the following parameters:

• the quality of data retrieved

• the user capability to discover, navigate and get resources

• the mismatch level between initial user requirements and system functionalities

• the overall performances (e.g. bottlenecks, if any)

• the integration level of EULER system with pre-existing services at partners sites, including both data servers and user clients. The task has analyzed and described system flaws and possible improvements concerning:

• Search Engine effectiveness in delivering information to mathematicians

• Results quality

• Performances and scalability of the overall system

• Integration with further services (e.g. ILL, document delivery)

• Technical and methodological changes due to standards or software evolutions occurred during the project life cycle. Major input to this task was provided by the EMS and the two library schools (FHK and FHHH) who have all agreed to sponsor this project. Contacts at the library schools were: Prof. Ursula Schulz Fachhochschule Hamburg (FHHH) Fachbereich Bibliothek und Information Grindelhof 30 D-20146 Hamburg Tel.: +49 40 44 195 447, Fax: +49 40 44 195 392 Prof. Winfried Gödert Fachhochschule Köln (FHK) Fachbereich Bibliotheks- und Informationswesen Claudiusstr. 1 D-50678 Köln Tel.: +49 221 8275 336, Fax: +49 221 331 8583 Coordinated by SUB, the sponsoring partners FHHH and FHK have engaged themselves in the following areas: FHHH: Ursula Schulz has applied different methods of usability evaluations, concerning e.g. understandability, learnability, user satisfaction. Measuring systems performance was excluded. Usability inspection was done (after defining a list of appropriate criteria) by information specialists; usability tests was done by potential users, which were hard to find. A list of EULER features to evaluate in particular was suggested by other partners. FHK: Winfried Gödert has done retrieval test (retrieval functionality measures) and comparative studies 1) with the supporting EULER services with their own search/retrieve features, 2) Internet search engines. A number of sample queries (10-20 per partner) was submitted to him. Other participants suggested special aspects to evaluate in particular (such as performance of deduplication process).

p. 14 EULER Final Project Report WP-5 Information Dissemination And Exploitation Preparations T5.1 Information Dissemination

Task leader: FIZ Participants: All Duration: periodically (see bar chart)

Aims: Information dissemination via professional journal articles, presentations at conferences, TAP concertation meetings, and similar events. Relevant reports of the project publicly available on the World Wide Web. Outcome: Deliverable D5.1.1 “List of publications, presentations at events and workshops” lists information dissemination activities; Deliverable D5.1.2 “WWW document server with public EULER reports” contains all relevant report and other information from the project. T5.2 Exploitation Preparations

Task leader: FIZ Participants: TUB Duration: 1 months

Aims: Prepare the final exploitation plan for EULER services and other project results, based on the results of WP-4. Consider commercial exploitation for future operation of EULER services and transfer of EULER results other subject domains. Prepare contracts within the consortium (and beyond) to ensure the continuation of EULER services after the project comes to an end. Outcome: Deliverable D5.2 “Recommendations for the continuation of EULER services (report)” lays the foundations for a continued EULER service.

p. 15 EULER Final Project Report Assessment of achievements

Overall Performance The overall aim of the EULER project was to offer a one-stop-shopping site for users interested in mathematics. One single integrated networked based access point was developed, covering samples of the most frequently used publications-related information resources on mathematics:

Ø Scientific literature databases Ø Library OPACs and document delivery services Ø Electronic journals from academic publishers Ø Archives of preprints and grey literature Ø Quality controlled subject information gateways on the Internet Ø Robot-generated indexes of other relevant Internet resources

A common user interface, available on the World Wide Web, allows a homogeneous access to all integrated information types. The interface was developed in close cooperation with the mathematical user community. Only one search is necessary to generate a broad range of (mixed) hits, irrespective of resource type and information provider. The EULER services were developed starting with selected important information sources from the consortium partners. The goal was to design an open architecture. New sources of data also from other information providers and libraries can be added easily.

Main Achievements

· Open, high quality portal · The main objective of EULER has been met. The concept of a one-stop-shop site (portal to heterogeneous resources) has been proven technically feasible, with enabling key features such as cross collection browsing and searching, consolidated hitlist through de-duplication, etc. · The combination of mathematical bibliographic resources offered is unique. All types of resources have been integrated with a reasonable amount of data from important providers. · For the first time a homogeneous access to heterogeneous resources was implemented (e.g. access to the preprint, the published article, and the review of the article being available through one single access point). · Record extraction strategies have been implemented by data providers, leading to a high precision of results. · Incorporation of "alien" data from non consortium partners is possible (tested with MPRESS, LANL). · European dimension, exploitation and impact of results · The project was one of the earliest actions in this area. No comparable services/systems are available. · A cooperation basis among important content suppliers across Europe has been established. New workflow models between partners were explored and implemented. This may lead to a fruitful cooperation in extending the EULER service to a (commercially) exploitable sustainable service. · Comparisons with and evaluations of related projects/other activities and their results have been done. · Related projects and other ongoing developments (e.g. DESIRE, DECOMATE, RENARDUS) might benefit from the solutions developed in EULER. · An exploitation plan has been developed, taking into account also commercial considerations, aiming at establishing a sustainable and extended EULER service. · There's a high recognition of the brand name "EULER" in the mathematical community, also outside of Europe. · User needs and satisfaction: · Extensive user needs evaluations and result validation activities have been done. · Standardization and technological achievements · Interoperability (e.g. cross searching) and standardization issues have been solved: The common EULER metadata profile is an optimal solution, requiring minimal efforts. It is compatible with international standards. · Other standards (Z39.50, Dublin Core, http) have been proved valuable. · Difficult technical problems such as sorting and de-duplication of distributed result sets have been solved. · Several tools - available for use - were implemented, which enable new data providers to join EULER with low technical efforts. · The EULER de-duplication identifier (as a byproduct) enables new exploitable technologies for filling gaps in data providers information resources.

p. 16 EULER Final Project Report Workpackage Performance Progress in WP 1 was initially delayed, due to difficulties in recruiting additional personnel capacities, but without negative impact The final evaluation of the user questionnaire action that was conducted was completed (Deliverable D1.1) in November 1998. An edited version of this internal report was produced and uploaded to the public EULER WWW server in February 1999.

Three periodical reports on different methodology matters were written. The resulting Deliverables are a bundles of methodology reports. They contain evaluations of different mathematical information services (MPRESS incl. parts of LANL, D-MPRESS, SIGMA and Dissertationen online) for a possible integration into the EULER service. Beside the characteristics of the special service this crucially depends on the offered metadata quantity and quality, which were assessed by the analysis of result sets to special search queries. (In the case of a positive evaluation, mappings for the data conversion of that service are given.) Technical problems of the examined mathematical Internet services were named. Descriptions were given on how the Decentralized Metadata Processor (ISO-tool) is used in EULER to do diacritics normalization and generation of a key to support elimination of duplicates. A methodological study/proposal about possible technical interpretations of ``using Z39.50 as a protocol and DC for resource description'', and investigations of a possible adaptation of ZSTARTS approaches were done. The second report looks at two initiatives using Z39.50 (The virtual Canadian union catalogue and The Z-starts initiative) that are of interest to EULER. It also contains a comment to the 15 element collapse proposal (from the first periodical report) from a Z39.50 perspective. A third report deals with Document Delivery models and their possible inclusion in EULER, a discussion on Z39.50, reports on trials with other Z39.50 servers than Zebra, and an experiment to exploit the EULER de- duplication identifier.

Action plans for WP 2 tasks were defined during the 1st project management meeting. All partners in WP 2 have selected and extracted test data from their services and resources. Some first versions of converters to a (not yet fully stable) common format were done. Preliminary local Z39.50 database installations and indexing tests were done by some partners.

In WP 3, the technical user interface and EULER Engine design started in June 1998. The corresponding deliverable was due in October 1998. The common Dublin Core based metadata format was extensively discussed during the meetings and via the project's mailing list, in close connection with WP 2 tasks.

p. 17 EULER Final Project Report The project has chosen a list of existing or emerging standards, formats and protocols, that are now widely used or are expected to become important in the near future: • Dublin Core metadata element set (with some extensions where necessary) as basis for a common resource description format • XML based syntax for entries and records. • Public domain Z39.50 database server (Zebra) at information providers' sites • EUROPAGATE's HTTP - Z39.50 gateway software as basis for the EULER Engine. • World Wide Web HTTP protocol and HTML forms and pages as user interface to the EULER services • ISO-LATIN-1 character set for diacritics (where applicable) • Mathematics Subject Classification (MSC) for contents descriptions In WP-4, an evaluation was performed by the external sponsors from the departments of library and information science in Hamburg and in Köln and by the EULER partner SUB Göttingen. The evaluation has assessed the EULER system and given recommendations for the transition from the EULER prototype to a real service for the future EULER consortium. Information dissemination (WP 5) activities are listed in detail below.

Validation activities Task 3.3 started in June 1999 with the aim of evaluating the alpha version of the EULER Engine. Partners have conducted interviews with potential users; a public questionnaire was put on the web. The evaluation questionnaire action has ended in September 1999, first results will be discussed during the October 1999 management meeting.

Coordinated by SUB, the sponsoring partners FHHH and FHK have engaged themselves in the following areas (WP 4): FHHH: Ursula Schulz has applied different methods of usability evaluations, concerning e.g. understandability, learnability, user satisfaction. Measuring systems performance was excluded. Usability inspection was done (after defining a list of appropriate criteria) by information specialists; usability tests was done by potential users, which were hard to find. A list of EULER features to evaluate in particular was suggested by other partners. FHK: Winfried Gödert has done retrieval test (retrieval functionality measures) and comparative studies 1) with the supporting EULER services with their own search/retrieve features, 2) Internet search engines. A number of sample queries (10-20 per partner) was submitted to him. Other participants suggested special aspects to evaluate in particular (such as performance of deduplication process).

Major Problems

p. 18 EULER Final Project Report Deliverables Completed The following list of technical deliverables excludes Management reports and other deliverables from the Management Work Package (WP-0).

Type of Description of the deliverable Avail- Work- Responsible Review Due Deliverable (ID, Title) ability package / involved procedure Date (1) (2) reference partner type (project (short (3) month) names)

R D1.1 Report on User Needs R 1 SUB I 2 R D1.2 Periodical revision and internal R 1 NetLab I 7,13, standard development reports 19 P D 2.1 Frontend DC metadata database for P 2 FIZ I 22 MATH Database incl. Documentation P D2.2 Frontend DC metadata database for P 2 SUB UNIFI I 18 the data of every participant OPAC CWI MDC (incl. documentation). P D2.3 Frontend DC metadata database for P 2 CWI I 18 preprints, incl. docoumentation. P D 2.4 Frontend DC metadata database P 2 FIZ I 18 For electronic journals, incl. Documentation. P D2.5.1 Quality controlled information P 2 SUB I 22 gateway Mathematics, incl. Frontend DC metadata with documentation database P D2.5.2 Robot-generated "Mathematical Web P 2 NetLab I 22 Index", incl. metadata and documentation P D2.5.3 A public Dublin Core Metadata P 2 NetLab I 8 creation and support site for Mathematicians R D3.1 Internal report: specification and R 3 NetLab I 7 design considerations P D3.2 Development and implementation of a P 3 NetLab I 14 prototype of the engine and user interface R D3.3 Internal report: Evaluation of prototype R 3 SUB I 17 D D3.4 EULER information system P 3 NetLab C 28 demonstrator R D4 "Internal EULER Evaluation report" R 4 SUB C 30 R D5.1.1 List of publications, presentations at P 5 FIZ I 30 events and workshops I D5.1.2 WWW document server with public P 5 FIZ I 1- EULER reports 30 R D5.2 Recommendations for the continuation R 5 FIZ C 30 of EULER services (report)

(1) R = Report, P = Prototype, D = Demonstrator, I = Information server (2) P = Public, R = Restricted (available to project partners, the Commission, and other parties at the discretion of the project consortium) (3) I = Internal project review, C = Commission Review

p. 19 EULER Final Project Report Impact of results and Exploitation plan Dissemination activities were quite successful, several external parties have strong interest in EULER developments. The project was approached from different parties asking how one could participate and contribute data to the EULER system. The question of a continued EULER service after the end of the project was asked several times. EULER use of standards, especially Dublin Core, was a point of extensive discussions with people involved in DC development.

The exploitation plan is detailed in Deliverable 5.2: "Plans and recommendations for the continuation of the EULER services". The following excerpts from this Deliverable form the key components of the exploitation plan:

Aims and mission statement The continuation of the EULER prototype will strive to provide a real virtual library, transparent to the end user and integrating external services. External services include document delivery, access to electronic full texts, and the offerings of publishing houses or bookstores.

International consortium After the project's end, a consortium will be formed consisting of a subset of the project participants. The aims of the consortium will be to ensure the continuation of the EULER service and to administer and supervise the addition of new information providers. The tasks of the consortium can be outlined as:

- technical management of the EULER engine - scientific supervision - legal and rights management - service provider support - information providers - end user support

Contractors and partners The consortium will consist of consortium members (contractors) and associated partners participating in EULER as information providers only. The consortium will, through the membership and supervision of EMS, represent the interests of the mathematical community. To protect these interests, the addition of new consortium members as well as associated partners shall be subject to EMS approval.

Consortial and partnership entry requirements The EULER participants who are going to form the core of the EULER consortium have contributed a substantial amount of efforts into establishing the service. New consortium members will be invited to become contractors based upon comparable contributions to the service. Other institutions or enterprises can become associated partners by providing an EULER Z39.50 server with the data of their holdings, along with paying regular fees to the consortium to ensure the operation of the service. These fees will be determined on a case-by-case basis and can be waived for educational and other nonprofit organizations. Associated partnership is open to all institutions dealing with mathematical information resources, regardless of their geographical location, provided that they conform to the consistency and quality standards set forth by the EMS. In particular, the EULER service seeks to establish partnerships with information providers from non-EU countries as well.

Economic and financial questions In order to create a sustainable service from the EULER prototype, there arises the need to account for the costs of running the service and to balance it against possible sources of revenues. The prospective consortium members have submitted their cost estimates for continuous operation of the EULER service to the project leader (FIZ). Members will ensure that these costs are covered by their respective institutions until sustainable revenue flows have been established.

Costs The costs for operating the EULER service have been be divided into two segments of the operation: the central (engine) administration costs and the costs for providing and maintaining the service at the information provider sites.

Central costs: - administration of the EULER web pages - operation and maintenance of the EULER engine - technological adaptations and development - end user support for questions relating to the EULER engine - public relations and marketing

Information provider costs: - creation of the infrastructure for an EULER database (one-time costs, see below) - technological adaptations following developments of the EULER engine - running and maintaining an EULER Z39.50 server with adequate internet access

p. 20 EULER Final Project Report - regular updating of the indices of the EULER database - end user support for questions relating to information content

The one-time costs for setting up an EULER database will entail the following: - adapting existing databases to the EULER format - installing the appropriate software packages on a web server

Parts of the information provider costs can be reduced through the sharing of know-how and software between participants. The EULER consortium will assist in this by lending support to EULER information providers (see "Service Provider Support" above).

Possible sources of revenues It will be the task of the EULER consortium to ensure the sustainability of the EULER service by the utilization of revenue sources. For this, the consortium require commercial information providers to provide reasonable reimbursements to the consortium in exchange for their partnership in the EULER service based upon the financial benefit from the participation in the EULER service, which from a commercial point of view can be seen as a tool which aids in the marketing of both paper and electronic publications.

Noncommercial information providers such as public libraries will likewise be able to use EULER to increase their revenues, e.g. by document delivery services, and shall be permitted to keep this for financing their own internal participation costs as well for the pursuit of their objectives.

Other possible sources of revenues are: - contributions from mathematical societies - contributions from sponsors (publishers, software houses) - other sources of public funding - user fees and charges

With respect to user fees and charges, appropriate procedures are not part of the existing prototype of the EULER service, but the issue of access restriction has been discussed and is potentially ready for implementation. Access control mechanisms will be usable by information providers to ensure that only subscribers will be able to access their full records. There is agreement, however, that access to the engine and the holding information as presented in the result lists of EULER queries shall remain free of charge to all users.

Rights and Licenses The EULER service will store metadata and access points to full texts (URLs, document delivery nodes, etc.), but not the full texts of electronic documents themselves. This means that copyright questions relating to the storage of copyrighted full texts of scientific articles are not an issue of concern for the EULER consortium. Nonetheless, there are possible copyright issues relating to the storage, use, and display of metadata that were obtained from third parties, such as cataloguing services like OCLC . The responsibility for ensuring the consent of the copyright holders of such metadata for inclusion in the EULER system has to be placed on the information provider side, as the EULER consortium itself cannot easily determine from the metadata records that are made available to the EULER engine if there are any third-party rights pertaining to these data.

The questions of software licensing relating to the engine have been clarified insofar as the current, stable version of the engine prototype rests on components which have been made available free to the public domain. The "Zebra" Z39.50 server currently employed by the partners will be available free of charge to prospective information providers through the courtesy of Zebra's manufacturer, IndexData Corporation of Denmark. If changes or updates of the engine or its client software are envisioned, however, software licensing costs may become an issue for the operation of the EULER service.

Architecture and further developments Speed and scalability: query response time One of the crucial points of concern for an interactive web-based service such as EULER is response time to user queries. The present, decentralized architecture poses specific problems in this regard: the response time of the system tends to rise along with an increasing number of participating information providers and also depends directly on the quality of their internet connections, posing severe scalability problems. Moreover, partners' Z39.50 server downtimes also affect the service response time adversely, because there is no possibility to find out if the server is not responding or the internet connection to the server is temporarily congested. This means that the engine has to wait for the Z39.50 server to respond until a predefined timeout.

These problems are of a structural nature, and possible remedies may require changing the decentralized architecture to a more centralized system. The optimal response time for an initial query could be achieved if the indices of the partners' EULER databases were not only kept at the participants' EULER servers, but were available directly at engine's place. Another possibility, halfway in this direction, is to have some (regionally divided) indexing nodes which keep complete indices for all

p. 21 EULER Final Project Report the participating partners from that region, as practiced by MathDoc Cell in their inclusion of the Strasbourg and Orsay OPACs. The consortium members may provide such indexing nodes for the associated partners within their scope or region.

Service integration: document delivery At present, service integration with respect to document delivery is not optimal. It is currently in the sole responsibility of the participating information providers to provide seamless access to document delivery services. A possible enhancement could be reached by providing a centralized document delivery tool which transfers user requests to the institution in charge. Such a slightly more centralized service could be provided in addition to the present system without necessarily competing with it. Advantages would be enhanced reliability, comfort for the user, and less implementation work for the information provider who offers document delivery.

Information brokerage: the future of EULER? With the offering of such mediating services, EULER will increasingly acquire the characteristics of an information brokerage system. In "pay per view" schemes envisioned by a variety of publishers, EULER could provide an interface capable of interacting with both buyers and sellers of information. Such a scenario, in which EULER would be a link in the cash flow exchanged between publishers and the mathematical community, could be beneficial by providing extra negotiatory leverage to the mathematical community as long as the EULER consortium remains under control of organizations representing the public interest. To ensure that this will be the case, it is recommended that commercial publishers are allowed only associated partnership, but not membership in the consortium itself.

p. 22 EULER Final Project Report Results of the Final Project Review

The following is the main text from the Consensus Review Report that the two independent experts to the Commission have prepared at the final review meeting on 26. September 2000 in Luxembourg.

CONSENSUS REVIEW REPORT

Summary of Reviewers' Conclusions

Compliance with objectives an workplan, including usage of resources an impact of previous review recommendations (if applicable):

There has been full compliance with objectives and workplan, including following the recommendations of the interim reviews. The project has delivered a prototype which complies with the objectives of the Technical Annex. Resources have been applied evenly throughout the project and exploited effectively.

Approach, methods and results:

The project has undertaken very significant research into aspects of information management and retrieval within the Dublin Core and Z39.50 environments. The project has revealed important findings in relation to the applicability of these standards. The project has also made valuable explorations into the O(pen) A(rchive) initiative and other relevant and topical areas.

Management, dissemination and concertation:

The project team is well balanced to incorporate the users, developers, practitioners, etc. Each partner has contributed to the project to a significant degree. Management has been very effective, including the resolution of difficulties as these arose. Dissemination has been extensive and well planned. Concertation has been effective, including good use of the EMS network.

Exploitation potential:

A full evaluation of the prototype by the voluntary partners is necessary before the exploitation potential can be fully assessed. The project appears to make a significant contribution to the area, with potential for portability to other disciplines, as well as further potential for development of the existing service model.

Reviewers' Recommendations

Overall recommendation:

Successful completion, pending the final submission of the exploitation and evaluation reports.

Recommendations for the future work:

1.) It is imperative that a solution be found to the technical difficulties encountered with response times. 2.) Future income generation should be based on securing the participation of commercial content providers. The service should remain free at the point of use.

p. 23 EULER Final Project Report Outlook

p. 24 EULER Final Project Report APPENDIX

Background Information

Compliance of the Project with Objectives of the Libraries Workprogramme EULER addresses a large number of objectives of the Libraries Sector, Action Line B, mainly Call Topics 4-5bis, and Action Line C, Call Topic 10. A pilot service for distributed digital library services has been developed, comprising different libraries and associated services in the field of mathematics. EULER has integrated different existing functions, and formed a new service, offering new models of integrated access and use of library materials. EULER has integrated the building blocks and components for interconnecting different functions (scientific databases, OPACs, Document Delivery, electronic documents, etc., for-pay and not-for-pay services) in order to develop a new, user- friendly access point to mathematical literature and relevant networked resources. End-users get access to mathematical library resources, irrespective of library type and location. EULER improves the usability of academic electronic publications within libraries and for library users. The project is an example of a large scale distributed digital library, that comprises access to traditional, printed publications and offers high-quality access to networked mathematical resources. The EULER consortium is composed of partners from different fields of scientific information, communication, and publication that form a new promising alliance. EULER has integrated some results of previous projects and has established new partnerships, in parallel with the technical development of new, integrated services. Some major players in the field of mathematical information and library resources have taken part in the project. The EULER services apply the relevant open standards, such as Internet Protocols, HTML, SR/Z39.50, and Dublin Core as basis for metadata descriptions of distributed mathematical resources, thus providing interoperability between different library and database services. The project has monitored additional services and standard developments to support integration of further services. Standardisation questions also included document formats, delivery mechanisms, and methods of licensing and accounting. The technologies, methodologies, models and architectures used in EULER comprise common network infrastructures, Internet, Web, Client-server architecture, distributed database design, state- of-the-art retrieval and browsing tools, metadata formats, distributed query protocols, harvesting technology, standard interface design, etc. To sum up the main characteristics and priorities of EULER:

• The project has integrated different types of applications based on real user needs and requirements, leading to concrete results: a one-stop-shopping point for mathematical information. The approach can serve as a model for replication in other subject domains.

• EULER has integrated existing and emerging technologies and has demonstrated the integration potential of library applications in a new service area. Details of the integration approach are described below.

• The project has included and exploited results from preceding projects and build on the impetus developed. A list of relevant projects is given below.

• Only open standards were used throughout the project.

• Information dissemination and concertation with other national and EU projects has secured knowledge and skills transfer, and lead to a better understanding of organisational and technical problems and common solutions.

• By it's very nature, EULER has a broad scope for links with other sectors of the Telematics Applications Programme, especially to Research, Education and Training, and Information Engineering.

• The EULER consortium is a new alliance of traditional and new partners, that includes some of the major players in it's field: mathematics, and mathematical literature and information. The expertise of the EULER consortium members is described below.

p. 25 EULER Final Project Report Consortium Experiences from prior and on-going work of the paricipating institutions, sketched below, form the baseline of the EULER project. The membership of the European Mathematical Society (EMS) consists of almost all mathematical societies in Europe (including Central and Eastern Europe) and about 2000 individual members. The EMS has brought in its Electronic Library of Mathematics, distributed through EMS's system of Internet servers, EMIS, http://www.emis.de/. This Electronic Library is today the most comprehensive archive of freely available mathematical electronic journals and conference proceedings. Scientific coordination of of EMIS is currently with the Department of Mathematics of the Technical University of Berlin (TUB). FIZ Karlsruhe is incorporated in the Federal Government's Programme of Specialised Information. This implies a special engagement on the part of FIZ Karlsruhe to actively support integration of scientific and technical information in research and education at universities and state-funded research institutions. Zentralblatt für Mathematik / Mathematics Abstracts (http://www.zblmath.fiz-karlsruhe.de/), founded in 1931 by O. Neugebauer, is today the longest-running international abstracting and reviewing service in the field of pure, applied and industrial mathematics. It covers the entire spectrum of mathematics and computer science with special emphasis on areas of applications with about 60.000 reviews per year. Development efforts have been undertaken in cooperation with MDC (France) to offer enhanced search functions in MATH Database via the World Wide Web. On an experimental basis, special links to library based document delivery services (GAUSS [Göttingen] and JASON [Bielefeld]) are operational. Libraries automated management of The University of Florence (UNIFI) started in 1986 with the participation to the Sistema Bibliotecario Nazionale (SBN), promoted by the Italian Ministero per i Beni Culturali ed Ambientali. Currently, 50 Libraries exist, including Faculties, Departments and Institutes, spread over Florence. They are grouped in six functional Poles which are headed by a Coordination Service of the University Central Administration. During past two years libraries services were extended by implementing an On Line Public Access Catalog (OPAC) interfaced to the Web and integrated with the management system (http://www.unifi.it:8000/). Through this WWW/OPAC gateway, world-wide users may freely navigate in the Univ. of Florence Libraries Catalogue 24 hours/day. Recently, in the context of the EU project Caselibrary (no. 3130) an experimental Z39.50 server has been activated too. The CWI library (http://www.cwi.nl/cwi/departments/BIBL.html) has a large and extensive collection of literature in the fields of mathematics and (theoretical) computer science. Due to the this large collection, the CWI library has a central position in the support of research in the related fields in The Netherlands. Key personnel from CWI has actively participated in the development of the Dublin Core Element Set. CWI has made it's OPAC data available as Dublin Core Metadata Database. The big CWI collection of preprints and grey literature was made accessible via the common EULER approach. The "Cellule de Coordination Documentaire Nationale pour les Mathématiques" (MDC), with a national scope, assists in any aspect of computer documentation the mathematics research libraries and mathematics departments. Relevant activities of MDC are: establish and update a map of documentation resources in mathematics in France; assist librarians and end users on software for circulating and accessing scientific documentation and information; assist libraries and departments for their local information and communication systems. The Ministry in charge of the universities asked the MathDoc Cell to manage the French-German cooperation about the database MATH, first step of its transformation in the European Database in Mathematics (EDBM). In this direction, the MathDoc Cell is involved in the following topics: realisation of the European Mathematics Search Engine (EMASE), whose first application is running on the database MATH. The application to the MATH DB and the installation procedures are worked out by the MathDoc Cell too; realisation of a protocol of electronic input of bibliographical data direct out of the journal editorial office (academic or private publishers); promoting the EDBM, by improving its visibility and its users group, by lobbying various authorities. The State Library of Lower Saxony and University Library of Göttingen (SUB) is one of the five largest libraries in Germany. Göttingen is in charge of more than 20 specialist collections supported by the German Research Association, for example Natural Sciences (general), Astronomy, Astrophysics, Pure Mathematics, General Theory of Science, History and Organisation of Science, Universal academic journals. Literature published after 1977 and before 1945 (more than 3 million entries) are part of the Göttingen on-line Catalogue, under the aegis of PICA. A comprehensive Direct Order Service is being established. Orders for literature (especially for Mathematics too) can be carried out - by mail, fax or over the WWW (http://www.gwdg.de/~sub/homepage.htm) directly. For a fee, the articles ordered will be processed and sent directly to the user within 48 hours by mail, fax and by E-mail or Ariel. NetLab, the Research and Development Department at Lund University Library, Sweden, is running or participating in a number of projects in collaborative efforts with other institutions and organisations from the Nordic Countries, Europe and USA: DESIRE (http://www.ub2.lu.se/desire/), the Development of a European Service for Information on Research and Education, is one of the largest projects in the European Union Telematics For Research Sector of the Fourth Framework Program. During two years from Jan 1996, DESIRE will try to develop an information infrastructure for the European academic community by providing methods, tools and demonstrator services. NetLab is part of the resource discovery and indexing work package and contributes to the development of a general model of quality subject services (incl. quality and p. 26 EULER Final Project Report selection methods, production of metadata, information structuring). NetLab's main responsibility is the development of a robotbased European Web Index. Steps will be taken to integrate quality subject services and the Web Index into a coherent discovery and retrieval environment. Nordic Metadata Project (http://linnea.helsinki.fi/meta/) supported by NORDINFO, intends to create a Nordic Metadata production, indexing and retrieval environment. The goal is to enhance end-user services by making digital documents more easily searchable and deliverable over the Net. NetLab cooperates with the international metadata community, especially regarding the Dublin Core specification. NetLab will create a user environment and support service and develop conversion software from Dublin Core to Nordic MARC formats and vice versa. NetLab's main task is to improve the discovery and retrieval of Nordic Internet documents through a metadata aware search service (a extension of the Nordic Web Index). EELS (http://www.ub2.lu.se/eel/), Engineering Electronic Library, Sweden, is an information system for quality assessed Internet resources in the technical sciences. It is a cooperation between the Swedish Universities of Technology Libraries and it is arranged according to the subject classification scheme from Engineering Information Inc., USA.

Involvement in and Relationship to National, EU or Other Relevant Programmes Prior to EULER, participants were involved in the following related EU funded projects from the Telematics Applications Programme: • CASA, Cooperative Archive of Serials and Articles (UNIFI) • CASELIBRARY, Library Services Interface Toolset (UNIFI) • DESIRE, Development of a European Service for Information on Research and Education (NetLab) • EDILIBE II, Electronic Data Interchange for Libraries and Booksellers in Europe (SUB) • ELITE, Electronic Library Teleservices (UNIFI) • FASTDOC, Fast Document Ordering and Document Delivery (FIZ) • RIDDLE, Rapid Information Display and Dissemination in a Library Environment (CWI) The partners were involved in the following national or EU funded projects: • EUROMATH, (SCIENCE SC1*0497) (FIZ) • DELOS, (ESPRIT LTR No. 21057) (CWI) • MeDoc, Entwicklung und Erprobung offener volltextbasierter Informationsdienste für die Informatik (FIZ) • Verbesserung des benutzerorientierten Zugriffs auf fachspezifische OnlineDatenbanken und CD-ROM für mathematische Institute in der Bundesrepublik (DMV-Projekt "Fachinformation") (FIZ) • Aufbau eines Volltextarchives forschungsrelevanter mathematischer Texte; Auswahl, Zugang und Erschliessung durch einen Datenbank aufgebaut aus dem mathematischen Referateorgan "Jahrbuch über die Fortschritte der Mathematik" (1868-1943) (SUB) • Acela Interactive Books, Architecture of a Computer Environment for Lie Algebras (CWI) • DING (Dynamic Interactive Graphics Tools for Scientific Encyclopaedias and Networks) (CWI) • DIENST, NCSTRL, Networked Computer Science Technical Report Library (CWI) • NWI, Nordic Web Index, within the Nordic Net Center (NNC) (NetLab) • Nordic Metadata Project (NetLab) • EELS, Engineering Electronic Library (NetLab) • Länkskafferiet, "The Link Larder" (NetLab) • Sistema Bibliotecario Nazionale (SBN), (UNIFI) • EMASE, European Mathematics Search Engine (EMS, FIZ, MathDoc) • WAIS catalogues for French mathematics research libraries (MathDoc) • The Merged Catalog of all mathematical serials publications in French mathematics research libraries (MathDoc) • MathNet, Informationsdienste für die Mathematik im Internet (DFN DT11)

p. 27 EULER Final Project Report Modifications of Workplan

Modifications and developments following the interim reviews The conclusions from the interim project reviews were very positive in general, however, the following main recommendations were made, and actions were initiated:

"Management: The project management techniques and quality control measures may need to be further elaborated." Following this recommendation, the project has adopted a more formal procedure for internal review of Deliverables. A more formal procedure for determining the "Estimated Achievements" of the Tasks was adopted.

"Exploitation Potential: A richer user interface could make this model even more attractive." The recommendation was, that additional SDI services, personal electronic shelves, and extended download facilities could make the service more attractive. Research on these issues was subsequently done, with proposals during the October 1999 management meeting. A field "Metadata Creation Date" was added to the EULER profile, thus enabling SDI services in principle. Concrete implementation was left to the beta-version programming (Demonstrator). However, due to implementation problems (no programmers available) during the late stages of EULER Engine programming, the issues were not resolved.

"Recommendations for future work: Adopting the Z-STARTS proposal for parallel Z39.50 searching should be considered. A solution to the de-duplication problem should be identified as a critical activity in terms of project planning." Project participants have investigated ZSTARTS, which, in addition to Z39.50, has enhanced provisions for finding fields in databases, scoring, merging, and query routing. ZSTARTS seems to be a "dead" project, there are only prototypes, no large scale implementations or ongoing development in this area. A report on ZSTARTS was given during the June 1999 meeting by NetLab, and was subsequently formulated as a contribution to the periodical methodology reports (WP 1). Partners are very skeptical that the ZSTARTS methodology would be viable for the EULER project. Concerning deduplication: Provisions for a deduplication matchkey identifier were already included in the very first draft of the common EULER metadata profile. During the management meeting that has immediately preceded the last annual review, it was decided to systematically work on its specifications and to include the implemented software into the iso-tool (common metadata postprocessor, developed by CWI and used by all partners). The reviewers recommendations were an additional justification to put efforts into this work, which was not explicitly foreseen in the Technical Work Program of the project.

"Pay more attention to document delivery to remote users and to creating a "real" virtual library environment." A report in response to the Reviewers comments on document delivery was prepared by SUB as part of T1.2. It was noted that display of multiple document delivery services is difficult in the current model of separate "full record" pages. A "de- duplication key" search for all document delivery providers able to deliver the current item was suggested. It was decided to produce short uniform information pages ("orange sheets") for all individual EULER databases. UNIFI and SUB have presented a draft template for these sheets. After discussion between the partners these templates were completed by all partners for their databases. Links from the public EULER service pages to the information sheets were installed by NetLab, as part of the work on the Demonstrator (T3.4).

"Quality control issues (in particular related to websites) need to be worked on." It was decided to require users to explicitly choose uncontrolled resources when doing a query. Not quality controlled web- page collections were removed from the default selection of databases to query. With a view to evaluation results it seems highly questionable whether robot-generated and thus not quality controlled databases of web pages should be included in EULER at all.

"For exploitation: clarify copyright and licensing problems with a view to implementing feasible technical solutions." Copyright and licensing questions concerning the software in use have been clarified. Copyright questions relating to the storage of copyrighted full texts of scientific articles are not an issue of concern for the EULER consortium. Nonetheless, there are possible copyright issues relating to the storage, use, and display of metadata that were obtained from third parties, such as cataloguing services like OCLC . The responsibility for ensuring the consent of the copyright holders of such metadata for inclusion in the EULER system must be placed on the information providers side, as the EULER consortium itself cannot easily determine from the metadata records that are made available to the EULER engine if there are any third- party rights pertaining to these data. The relevant statements appear in the text of the Exploitation Task Deliverable.

Further Problems and Decisions, Changes to the Workplan Progress in Task 1.1 was delayed due to problems recruiting personnel in the start of the project. The final evaluation of a user questionnaire was delivered later than expected. Initial dependencies with WP 3 activities were readjusted.

EULER's usage of DC was compared to that of other important existing applications in the mathematics area - especially other metadata schemes and creators - as part of Task 1.2 activities. Due to the fact that the results of this work was likely to have

p. 28 EULER Final Project Report some impact on the final EULER metadata creator, the final version of the metadata creator was not presented until after this work has been carried out. The draft version of the metadata creator was also evaluated by external experts as part of Task 3.3 activities. This re-arrangement has ensured that EULER's metadata creator is in line and interoperable with other metadata creators. No further dependencies between Tasks were affected.

At the 4th management meeting in Grenoble it was decided to delay the end of Task 3.2 and the Task 3.3 for one month, due to restricted availability of potential evaluators during the summer months.

It was observed that WP-2 Tasks 2.2 to 2.4 would have no time to adopt to new requirements that will emerge during the intermediate evaluation (T3.3). Therefore it was decided to extend the resource adaptation tasks T2.2-4 to January 2000.

The "Exploitation" task (T5.2) was originally scheduled for only 1 month running time. At the Florence meeting it was decided to start the task in February 2000, with more partners. This seems to be a necessary decision, also with respect to the recommendations from the second Annual Review. An action plan for the task was presented at the Göttingen meeting by TUB and FIZ.

Additional work in the internal peer-review process for D2.* Deliverables has delayed the completion of T2.* tasks. There were no dependencies with other tasks.

Concertation activities in the Telematics for Libraries sector P. Cotoneschi (UNIFI), A. Brümmer (NetLab), and H.J. Becker (SUB) participated in the 2nd Metadata Workshop in Luxembourg, 26 June 1998.

Tomas Schönthal (NetLab) participated in the 3rd Metadata Workshop in Luxembourg, 12. April 1999.

Aleksandar Perovic (TUB) participated in the IESERV2 workshop "Interactive Electronic Publishing in the 5th Framework Programme" in Luxembourg on May 20, 1999.

P. Cotoneschi (UNIFI), A. Perovic (TUB), and M. Jost (FIZ) participated in the concertation meeting "Consolidating the European Library Space", November 17-19, 1999 in Luxembourg. Presentation of the alpha version of the system.

Colm Doyle (NetLab) participated in the Cultural Heritage Projects Concertation Event, Vienna, 30 June 2000. Presentation on metadata issues.

p. 29 EULER Final Project Report Dissemination Activities All public reports and Deliverables, and relevant other information from the project are online accessible from the public EULER WWW site: http://www.emis.de/projects/EULER/.

The following lists of publications and presentations at events and workshops are presented in reverse chronological order.

List of presentations at events and workshops en información y comunicación en matemáticas Congreso de la Real Sociedad Matemática Española Madrid, Complutense, 27-29 enero 2000 Laurent Guillopé Presentation of EULER Elizabeth Cherhal Round table "Les mathématiques et la publication électronique" L'accès multibases/multiserveurs, le RNBM et Euler Rennes, May 31, 2000 Meeting of "Réseau National des Bibliothèques de Mathématiques" Anna Maria Tammaro, Patrizia Cotoneschi Paris, December 6th 1999 Presentation of EULER Convegno "Le biblioteche accademiche del futuro: idee, Bernd Wegner progetti, risorse" Projects in Electronic Information and Electronic Publications CRUI - Conferenza dei Rettori delle Università Italiane supervised by EMS Roma, 22-23 maggio 2000 The Future of Mathematical Communication: 1999 Berkeley, California, December 1-3, 1999 Michael Jost http://www.msri.org/activities/events/9900/fmc99/ EULER und LIMES: zwei Europäische Initiativen IuK2000: Information, Knowledge and Knowledge Management Bernd Wegner Sitzung der IuK-Fachgruppe der Deutschen Mathematiker- The electronic information offer of the EMS Vereinigung Campus of U.A.E. University TU Darmstadt, 29 March 2000 Al-Ain, U.A.E., November 24, 1999 Bernd Wegner Aleksandar Perovic, Patrizia Cotoneschi, Michael Jost Presentation "The Electronic Offers in EMIS" EULER systems demonstration Brainstorming Session on Electronic Services in Mathematics Consolidating the European Library Space Springer-Verlag, New York, 28.3.-30.3 2000 Luxembourg, November 17-19, 1999 Mårten Berggren, Traugott Koch Anna Brümmer Presentation of and discussion about the methodologies behind the EULER - a One Stop Shopping Site EULER-service and presentations of Alpha version. The Swedish Society for Technical Documentation, Digital Library Seminar "Advances in resource discovery", Autumn Conference, Lithuania Stockholm, 8-9 November 1999 Kaunus, 8.3. - 9.3.2000 Annamaria Tammaro, Patrizia Cotoneschi, Valdo Pasqui, Mårten Berggren, Traugott Koch Bernd Wegner, Michael Jost Presentation of and discussion about the methodologies behind the Presentazione del prototipo del sistema EULER EULER-service and presentations of the Alpha version. EULER: sistema di informazione integrata per la matematica Digital Library Seminar "Advances in resource discovery", Firenze, 12 Ottobre 1999 Lithuania Vilnius, 6.3.- 7.3. 2000 Michael Jost EULER meets KOBV Bernd Wegner Kooperativer Bibliotheksverbund Berlin-Brandenburg Plenary Conference "Información y Comunicación en Konrad-Zuse-Zentrum für Informationstechnik Berlin (ZIB) Matemática Aplicada - Berlin, 6. Oktober 1999 Ofertas Mejoradas para América Latina" 4. Congreso Internacional sobre Investigación Operativa Elizabeth Cherhal, Annius Groenink Havanna, 6.3.-7.3.2000 EULER project demonstration Third European Conference on Research and Advanced Bernd Wegner Technology for Digital Libraries, ECDL'99 Plenary Lecture "Proyectos de la SME en Información y Paris, France, September 22-24, 1999 Comunicación en Matemáticas" http://www-rocq.inria.fr/EuroDL99/ Reunión de Decanos y Directores de Matemáticas Santiago de Compostela, 18.2.-19.2.2000 Bernd Wegner Editarea electronica si sisteme de informatie electronice - un Bernd Wegner domeniu al cooperarii romano-germane Plenary Lecture "EMIS - The Offer of EMS in Electronic Matematicienii au cuvantul Information and Communication in Mathematics" Institutul de Matematica al Academiei Romane, Electronic Information and Electronic Libraries Goethe Institut - Bucuresti Puschino/Moscow, 16.-18. February 2000 Bucuresti, 23 September 1999 An article, translated into Russian, will appear in the conference Proceedings Bernd Wegner, Patrizia Cotoneschi EULER presentation Patrizia Cotoneschi XVI Congresso Unione Matematica Italiana Presentation of Euler project Tavola rotonda sui sistemi informativi sull'editoria elettronica Seminar "Formati Bibliografici e Metadata" Presiede: il Prof. R. Piccinini. Interventi di V. Valzano (Lecce), Roma, Biblioteca Angelo Monteverdi, 10-11 febbraio 2000 coordinatore e B. Wegner (Berlino), coordinatore. Napoli 13-18 settembre 1999 Bernd Wegner http://www.congrumi.unina.it/ Presentación del proyecto LIMES y otras actividades de la SME

p. 30 EULER Final Project Report

Patrizia Cotoneschi, Bernd Wegner EULER system demonstration Patrizia Cotoneschi XVI Congresso Unione Matematica Italiana Interoperabilità: standard e metadata Napoli 13-18 settembre 1999 Progetto Euler: Conversione Unimarc-Dublin Core La biblioteca Digitale - Seminario in tre moduli Michael Jost Associazione Italiana Biblioteche Seminari '99 Short EULER Status Report Roma, 16-17-18 marzo 1999 Jahrestagung der Deutschen Mathematiker-Vereinigung http://www.aib.it/aib/corsi/99c-01.htm Sektion IuK Mainz, 7. September 1999 Elizabeth Cherhal Utilisation de métadonnées "dublin core" pour l'intégration de Bernd Wegner ressources documentaires hétérogèbes en mathématiques: le projet EULER presentation européen EULER Summer School on Differential Geometry Journée d'Etude ADBS Coimbra, 3-7 September 1999 Décrire, stocker et retrouver l'information sur le web/ les métadonnées Jorgen Eriksson Paris la défense, 2 février 1999 Presentation of EULER Internationalisation and Information and Communication Annius Groenink Technology Participation in DC Implementor's working group SANTANDER Sectoral Group Meeting Presentation: ``The EULER common DC profile'' Lund, 15 June 1999 2nd DFG MetaLib Workshop, Bibliographic Metadata and the Challenge of Heterogeneity and Standardisation Hans J. Becker Die Deutsche Bibliothek, Frankfurt/M, February 1st-2nd, 1999 Vortrag über EULER Sektion Geschichte der DMV (Jahrestagung) Bernd Wegner Bautzen, 4. June 1999 Presentation of EULER Joint Mathematics Meeting Bernd Wegner San Antonio (Texas), January 12.-16., 1999 Presentation of EULER Stochastic Geometry, Convex Bodies, Empirical measures, Bernd Wegner Congress in Mazara del Vallo, 28. May 1999 Presentation of EULER Benemérita Unviversdad Autónoma de Puebla (BUAP) Laurent Guillopé Puebla, Mexico, December 22, 1998 Statique et dynamique des documents mathématiques Journées Gutenberg 1999 Bernd Wegner Lyon, 18-19 May 1999 Presentation of EULER http://www-mathdoc.ujf-grenoble.fr/GUT99 Sociedad Mexicana de Matemática Universidad Nacional Autónoma de México, December 21, 1998 Bernd Wegner Presentation of EULER Annius Groenink, Michael Jost Session of the Flemish librarians, EULER: Requirements and Design University of Limburg, Diepenbeek, 11. May 1999 Presentation at the workshop MetaData: Interoperability and Heterogeneity Katrin Große MetaData Working Group of the IuK Commission of Learned Gemeinsame Aufgaben im Math-Bib-Net Projekt und im Societies in Germany EULER Projekt Bonn, Germany, 10.-12. December 1998 Math-Bib-Net Treffen http://www.mathematik.uni-osnabrueck.de/ak- Göttingen, 11. May 1999 technik/workshop98/index.html

Bernd Wegner Tuulikki Mäkeläinen Presentation of EULER Presentation of EULER Session of the Cientific Board of CIM (Centro Internacional de Towards the Fifth Framework Programme of the EU Matematica) a seminar for libraries, archives and museums Coimbra, 10. March 1999 University of Helsinki, Finland, December 11, 1998

Frank A. Roos Katrin Große Presentation of EULER EULER und Math-Net: Ergebnis der EULER-Nutzer-Umfrage Meeting of the LOBBI consortium (Dutch mathematics and und erste Ergebnisse eines Formatvergleichs. computer science librarians in the Netherlands) Presentation at the Math-Net meeting: Mathematical Institute of the Leiden University, 14 April 1999 Kaiserslautern, Germany, December 3-4, 1998 http://kbibmp3.ub.uni-kl.de/Math-Net-Treffen/ Bernd Wegner Presentation of EULER Ralf Schimmer, Hans J. Becker APPOPT 5 - International Conference on approximation and Metaform and Metaguide: comparison of different DC-dialects e.g. optimization DC and DC Euler Guadeloupe, March 31, 1999 Meta Lib Beiratstreffen Göttingen, 18. November 1998 Bernd Wegner Presentation of EULER Bernd Wegner Treffen von Multiplikatoren aus Bibliotheken, Museen und Informational note at Kolloquium über Kombinatorik, Archiven zum Programm Benutzerfreundliche TU Braunschweig, 14. November 1998 Informationsgesellschaft (IST-Programm) Stiftung Preussischer Kulturbesitz und Deutsches Bernd Wegner Bibliotheksinstitut Berlin Lecture at the Brainstorming Workshop of the Committee on Berlin, March 18, 1999 Electronic Information and Communication (CEIC) of the

p. 31 EULER Final Project Report

International Mathematical Union (IMU) Olaf Ninnemann: ZIB Berlin, 13. November 1998 EULER und Math-Net: Gemeinsame Perspektiven Presentation at the DMV workshop during the Bernd Wegner Workshop of the Electronic Information and Communication Lecture at the Mathematics Faculty Initative (IuK) of the German Professional Scientific Societies: Universidad de Santiago, 2-3. November 1998 "Integrated Scientific Information Systems" Hamburg, Germany, March 16-18, 1998 Bernd Wegner http://elfikom.physik.uni-oldenburg.de/IuK/iuk-hh-engl.html Oral presentation at the assembly of deans Universitat de Barcelona, 29. October 1998 Michael Jost: Bausteine für Global-Info, Schwerpunkt 3, aus Sicht des Bernd Wegner EULER Projektes Plenary lecture Presentation at the workshop Asamblea general de UMALCA Global-Info (Global Electronic and Multimedial Information Olmúe, Santiago de Chile, 9. October 1998 Systems for Natural Science and Engineering, Innovation Programme of the BMBF) Bernd Wegner Focal Point III Workshop, oral presentation at the executive committee (6.10.), Göttingen, Germany, February 12-13, 1998 plenary lecture (8.10.) International Congress of Sociedad de Matemática de Chile Olmúe bei Santiago de Chile, 6-9. October 1998 Michael Jost: The EULER Project Bernd Wegner Presentation at the workshop Lecture at MetaData: Qualifying WebObjects Pontificia Universidad Católica de Chile, 5. October 1998 IuK-Kommission der wissenschaftlichen Fachgesellschaften AK-MetaDaten und Klassifikation Osnabrück, Germany, 13.-15. Oct 1997 http://www.mathematik.Uni-Osnabrueck.DE/projects/workshop97/ Michael Jost, Anna Brümmer Poster Presentation: EULER: An EU 'Telematics for Libraries' Project Michael Jost: 2nd European Conference on Research and EULER und COMMEDIANT: Pläne fuer zwei europäische Projekte Advanced Technology for Digital Libraries Presentation at the DMV workshop during the Heraklion, Crete, 19-23 September 1998 Third Joint IuK Workshop http://www.ics.forth.gr/2EuroDL/index.html of the six learned societies DGfE, DGS, DMV, DPG, GDCh und Poster at http://www.emis.de/MATH/EULER/planned/eulerp.doc GI Würzburg, Germany, March 3rd-5th, 1997 http://schiele.organik.uni-erlangen.de/cic/IuK97/ Bernd Wegner Presentation of EULER Weizmann Institute Rehovot, Israel, September 17-18, 1998

Bernd Wegner Presentation of EULER ISIS Symmetry Congress Technion, Haifa, Israel, September 13-16, 1998

Laurent Guillopé, Michael Jost, Peter W. Michor, Olaf Ninnemann, Bernd Wegner Presentations of EULER at the booths of EMS and FIZ / Zentralblatt MATH International Congress of Mathematicians Berlin, August 18-27, 1998 http://www.emis.de/mirror/ICM98/

Jörgen Eriksson Bringing it together (with Dublin Core) "Integrated information systems in academic libraries " conference Klaipeda, June 23-27, 1998 http://www.lub.lu.se/~jorgen/Undervisning/klaipeda.html

Laurent Guillopé "Présentation du Projet Euler" Conseil Supérieur des Bibliothèques Paris, 28 Avril 1998

Elizabeth Cherhal: Round Table presentations: "Les expérences thématiques: Mathématiques, Médecine" "Les métadonnées et le catalogage des documents électroniques" Les Rencontres de BIBLIO-FR Caen, 3 - 6 avril 1998 http://www.info.unicaen.fr/bnum/biblio-fr/rencontres98/index.html

p. 32 EULER Final Project Report

List of publications Sudak, Autonomous Republic of Crimea, Ukraine, June 9-17, 2001, Volume 1: 351-354.

Bernd Wegner: Bernd Wegner: Electronic Publishing with EMIS. EMIS 2000: The European Mathematical Information Service and its in: 3rd Int. Congress of Eng. Math. and Phys., developments. Cairo University 1997, xv- xxi (1997). Online Information Review 25, no. 3, 165-172 (2001)

Bernd Wegner: Mårten Berggren, Anna Brümmer EULER - a DC-based Integrated Access to Library Catalogues and Design considerations for the EULER project Other Mathematics Information in the Web. The Nordic Journal of Documentation 1999(54) p.15-24. Seventh International Conference ‘Crimea 2000’ Libraries and ISSN 0040-6872 Associations in the Transient World: New Technologies and New Forms of Cooperation. Traugott Koch: Conference Proceedings. Sudak, International Cooperation - Real Opportunities? Autonomous Republic of Crimea, Exploit Interactive, Issue 01, 1999 Ukraine, June 3-11, 2000, Volume 1: 264-267 http://www.exploit-lib.org/issue1/

Bernd Wegner: EULER - a DC-based Integrated Access to Library Catalogues and Other Mathematics Information in the Web, Michael Jost, Anna Brümmer ECDL 2000, EULER: An EU 'Telematics for Libraries' Project Lecture Notes in Computer Science 1923, 461 - 466 (2000). (Extended Abstract) in: C. Nikolaou, C. Stephanidis (Eds.): Salvador Segura Gomis, Bernd Wegner: Research and Advanced Technology for Digital Libraries EMIS - Información Electrónica y Comunicación en Matemáticas, Second European Conference, ECDL'98, Heraklion, Crete, La Gaceta de la Real Sociedad Matemática Española Greece, Vol. 3, no. 1, 135-142 (2000). September 21-23, 1998, Proceedings Lect. Notes Comput. Sci. 1513, p. 675-676 (1998) Bernd Wegner: EMIS - the offer of EMS in electronic information and Michael Jost: communication in mathematics. EULER - Ein EU-Projekt zur Integration heterogener UK Nonlinear News, vol. 18. Informationsquellen BIBLIOTHEKSDIENST, Heft 3, 1998 http://www.amsta.leeds.ac.uk/Applied/news.dir/issue18.dir/art/emis.html http://www.dbi-berlin.de/dbi_pub/bd_art/98_03_00.htm

Bernd Wegner: EMIS 2000: the European Mathematical Information Service and its Michael Jost: developments. EULER - European Libraries and Electronic Resources in IV SEMINARIO SISTEMA INFORMATIVO NAZIONALE PER Mathematical Sciences LA MATEMATICA 2000 European Mathematical Society Newsletter, No. 26, December http://siba2.unile.it/sinm/4sinm/interventi/emis.htm 1997, p. 14-15

Bernd Wegner: Michael Jost: Proect EULER - integrirovannyj dostup k bibliotechym katalogam EULER - European Libraries and Electronic Resources in imatematicheskoy informatsii v Internete (Russian). Mathematical Nauch. i Tekhn. Biblioteki 2001, no. 2, 75-81 (2001). Sciences - Ziele des Antrags für ein EU-Projekt in: Martin Grötschel: Der Weg der Mathematik in die Bernd Wegner: Informationsgesellschaft, Teil II Zentralblatt MATH and Related Gateways to Electronic Information Mitteilungen der Deutschen Mathematiker-Vereinigung, 4/1997, p. in Mathematics. 47 Eight International Conference ‘Crimea 2001’ Libraries and Associations in the Transient World: New Technologies and New Forms of Cooperation. Conference Proceedings.

p. 33