Sitemap
Yasiru Kavishka

Yasiru Kavishka

Software Engineering Undergraduate at University of Kelaniya

SWOOGLE

2 min readDec 29, 2020

Swoogle is a crawler-based indexing and retrieval system for the Semantic Web. Swoogle is especially for semantic web ontologies, documents, terms and data that have been published on the web. As I mentioned earlier it is a crawler based indexing and retrieval system and it crawls for documents written in RDFs and OWL. The engine is primarily written in Java with the PHP used for the front-end and MySQL for database. Swoogle has the capability of searching over 10,000 ontologies and indexes more than 1.3 million web documents.

Swoogle searches for semantic ontologies, semantic web instance data and semantic web terms (URIs). It provides metadata of SWDs and supports browsing semantic web data. And it gives different versions of SWDs for the users.

There is a large number of semantic web documents (SWDs), ontologies as well as instances physically distributed all over the semantic web. Swoogle organizes these documents well in a systematic manner. It extracts metadata for each discovered document, and computes relations between documents as well as those documents index into an information retrieval system. Because of these mechanisms, users can easily query and retrieve information from this repository. By using swoogle we can avoid creating new ontologies.

Get Yasiru Kavishka’s stories in your inbox

Join Medium for free to get updates from this writer.

Now I would like to discuss the searching process of the Swoogle. When the user inputs the appropriate search term for search, it visits the web to collect necessary SWDs, ignoring other documents including images and pdfs. For the discovered SWDs it extracts metadata as i mentioned indexes it to an information retrieval system for the querying. Index is updated regularly and ignores already defined and outdated URLs. when documents are no longer accessible, those SWDs will be removed from the database.

Swoogle crawls the semantic web using manual submission, google based metadata crawling, bounded HTML crawling, RDF crawling. When a user submits a new URL with a new web page including hyperlinks to the SWDs of the user. Swoogle starts running crawling starting from given URLs.

Now I would like to discuss the architecture of Swoogle. As in the image given it includes SWD discovery, metadata creation, data analysis, and interface which are the four major components. This architecture can be considered as a data centric and extensible architecture in which components work independently and interact with one another through a database.

--

--

Yasiru Kavishka
Yasiru Kavishka

Written by Yasiru Kavishka

Software Engineering Undergraduate at University of Kelaniya