Permalink to this page
SEALS: Semantic Evaluation at Large Scale
Natural Language Processing, Semantic Web And Knowledge Services
June 2009 through May 2012
The goal of the SEALS project is to provide an independent, open, scalable, extensible and sustainable infrastructure (the SEALS Platform) that allows the remote evaluation of semantic technologies thereby providing an objective comparison of the different existing semantic technologies. This will allow researchers and users to effectively compare the available technologies, helping them to select appropriate technologies and advancing the state of the art through continuous evaluation.
The SEALS Platform will provide an integrated set of semantic technology evaluation services and test suites. They will be used in two public and worldwide evaluation campaigns. The results of these evaluation campaigns will be used to create semantic technology roadmaps identifying sets of efficient and compatible tools for developing large-scale semantic applications.
The semantic technology evaluation services will initially be available for five different types of technologies (ontology engineering tools, storage and reasoning systems, matching tools, semantic search tools, and semantic web service tools) and for different evaluation criteria (interoperability, scalability, etc.). The platform will provide easy and free access to the evaluation services and to the results of the evaluations performed.