university website

Y. Zhang (Ying), L.H.A. Scheers (Bart) and M.L. Kersten (Martin)

2012

Astronomical Data Processing Using SciQL, an SQL Based Query Language for Array Data

Publication

Publication

Presented at the Extremely Large Databases Conference, Stanford, California, USA

Additional Metadata
THEME Information (theme 2)
Conference Extremely Large Databases Conference
Note Lightening Talk ABSTRACT: Data-intensive scientific research, such as in astronomy, calls for functional enhancements to DBMS technologies. To brige the gap between the needs of the Data-Intensive Research fields and the current DBMS technologies, we have introduced SciQL (pronounced as ‘cycle’), a novel SQL-based array query language for scientific applications with both tables and arrays as first class citizens. SciQL lowers the entrance fee of adopting relational DBMS in scientific domains, because it includes functionality often only found in mathematics software packages. In this talk, we demonstrate SciQL using examples taken from a real-life astronomical data processing system, e.g. the Transient Key Project (TKP) of the LOFAR radio telescope. In particular, we show how a a full Stokes spectral light-curve database of all detected sources can be constructed, by cross-correlation over multiple catalogues can be constructed. By exposing the properties of array data to the relational DBMS, SciQL also opens up many opportunities to enhance the data mining possibilities for real-time transient and variability searches.
Organisation Database Architectures
Citation
Zhang, Y., Scheers, B., & Kersten, M. (2012). Astronomical Data Processing Using SciQL, an SQL Based Query Language for Array Data.


User Publication Person Organisation Collection
Close