2012-01-01
Astronomical Data Processing Using SciQL, an SQL Based Query Language for Array Data
Publication
Publication
Presented at the
Extremely Large Databases Conference, Stanford, California, USA
| Additional Metadata | |
|---|---|
| THEME | Information (theme 2) |
| Conference | Extremely Large Databases Conference |
| Note | Lightening Talk ABSTRACT: Data-intensive scientific research, such as in astronomy, calls for functional enhancements to DBMS technologies. To brige the gap between the needs of the Data-Intensive Research fields and the current DBMS technologies, we have introduced SciQL (pronounced as ‘cycle’), a novel SQL-based array query language for scientific applications with both tables and arrays as first class citizens. SciQL lowers the entrance fee of adopting relational DBMS in scientific domains, because it includes functionality often only found in mathematics software packages. In this talk, we demonstrate SciQL using examples taken from a real-life astronomical data processing system, e.g. the Transient Key Project (TKP) of the LOFAR radio telescope. In particular, we show how a a full Stokes spectral light-curve database of all detected sources can be constructed, by cross-correlation over multiple catalogues can be constructed. By exposing the properties of array data to the relational DBMS, SciQL also opens up many opportunities to enhance the data mining possibilities for real-time transient and variability searches. |
| Citation |
Zhang, Y, Scheers, L.H.A, & Kersten, M.L. (2012). Astronomical Data Processing Using SciQL, an SQL Based Query Language for Array Data.
|