WS-Aggregation -

Distributed and Event-Based Aggregation of Web Services Data

 

Problem Description

During the last years, the Web has emerged as a vast collection of resources that provide data both in the form of (static) documents and in the form of services. The huge number of available data resources in the Web, as well as ongoing trends of Web-based data processing such as service mashups, Data-as-a-Service or Web content integration portals call for techniques to aggregate (i.e., collect, select and transform) heterogeneous data from distributed sources in a uniform way.

Brief Overview

We argue that there is still a lack of generic frameworks that support loosely coupled, distributed aggregation of heterogeneous data published in the Web. We present the WS-Aggregation framework as a generic solution to this problem. WS-Aggregation employs a set of interconnected aggregator nodes, which cooperate with each other to execute client requests. Following the SOA paradigm, WS-Aggregation decouples the aggregation platform from the target data services. The endpoint information of the system participants is stored in the VRESCo service registry and binding takes place dynamically at runtime.

The WAQL Query Language

WS-Aggregation makes use of the Web services Aggregation Query Language (WAQL), which is based on XQuery and provides a set of additional convenience features which we deem important in the context of data aggregation on the Web. The WAQL parser and preprocessor have been implemented with the aid of the parser generator JavaCC. A detailed description of the implementation can be found here.

Web User Interface

We have deployed a publicly available version of the WS-Aggregation Web user interface here. You can use it to get acquainted with the features of WS-Aggregation. The registration is free and fast - try it out now!
(System requirements: Mozilla Firefox, Flash Plugin)

screenshot Please consider a fair use policy. Please let us know if you find a bug or have any suggestions for improvement.

Contribute

We offer several student projects and (unpaid) internships where you can contribute to this project (see our Open Topics page for details). If you are interested in contributing to this project or have any question concerning the project, do not hesitate to contact us.

Source Code and Examples

You can download the code (source and binary) here:

Snapshots

Releases

Please read the README.txt for installation instructions.

Publications

  1. Journal Papers (1)
  2013 (1)
Elastic Stream Processing in the Cloud Hummer, W.; Satzger, B.; and Dustdar, S. Wiley Interdisciplinary Reviews (WIRE), Data Mining and Knowledge Discovery, (to appear). 2013.
Elastic Stream Processing in the Cloud [pdf]Paper   bibtex   2 downloads
  2. Conference Proceedings (3)
  2012 (2)
Deriving a Unified Fault Taxonomy for Event-Based Systems Hummer, W.; Inzinger, C.; Leitner, P.; Satzger, B.; and Dustdar, S. In 6th ACM International Conference on Distributed Event-Based Systems (DEBS'12), 2012.
Deriving a Unified Fault Taxonomy for Event-Based Systems [pdf]Paper   bibtex
Specification and Deployment of Distributed Monitoring and Adaptation Infrastructures Inzinger, C.; Satzger, B.; Hummer, W.; and Dustdar, S. In 2nd Int. Workshop on Performance Assessment and Auditing in Service Computing (co-located with ICSOC'12), 2012.
bibtex
  2011 (4)
Esc: Towards an Elastic Stream Computing Platform for the Cloud Satzger, B.; Hummer, W.; Leitner, P.; and Dustdar, S. In 4th IEEE International Conference on Cloud Computing (CLOUD'11), 2011.
bibtex
Distributed Continuous Queries Over Web Service Event Streams Hummer, W.; Satzger, B.; Leitner, P.; Inzinger, C.; and Dustdar, S. In 7th International Conference on Next Generation Web Services Practices (NWeSP'11), 2011.
Distributed Continuous Queries Over Web Service Event Streams [pdf]Paper   bibtex
WS-Aggregation: Distributed Aggregation of Web Services Data Hummer, W.; Leitner, P.; and Dustdar, S. In 26th ACM SIGAPP Symposium On Applied Computing (SAC'11), SOAP Track, 2011.
WS-Aggregation: Distributed Aggregation of Web Services Data [pdf]Paper   bibtex
Dynamic Migration of Processing Elements for Optimized Query Execution in Event-based Systems Hummer, W.; Leitner, P.; Satzger, B.; and Dustdar, S. In 1st International Symposium on Secure Virtual Infrastructures (DOA-SVI'11), OnTheMove Federated Conferences, 2011.
Dynamic Migration of Processing Elements for Optimized Query Execution in Event-based Systems [pdf]Paper   bibtex
  2010 (1)
A Step-By-Step Debugging Technique To Facilitate Mashup Development and Maintenance Hummer, W.; Leitner, P.; and Dustdar, S. In 4th International Workshop on Web APIs and Services Mashups (Mashups'10), co-located with ECOWS 2010, 2010.
A Step-By-Step Debugging Technique To Facilitate Mashup Development and Maintenance [pdf]Paper   bibtex
  4. Technical Reports (1)
  2011 (1)
Distributed Continuous Data Aggregation Over Web Service Event Streams Hummer, W.; Satzger, B.; Leitner, P.; and Dustdar, S. Technical Report (TUV-1841-2011-04), Vienna University of Technology, 2011.
Distributed Continuous Data Aggregation Over Web Service Event Streams [pdf]Paper   bibtex

People

Contact

email address

Staff