Mining the SDSS SkyServer SQL queries log

Vitor Makiyama Hirota; Rafael Santos; Jordan Raddick; Ani Thakar

doi:10.1117/12.2224237

12 May 2016 Mining the SDSS SkyServer SQL queries log

Vitor Makiyama Hirota, Rafael Santos, Jordan Raddick, Ani Thakar

Proceedings Volume 9851, Next-Generation Analyst IV; 98510S (2016) https://doi.org/10.1117/12.2224237
Event: SPIE Defense + Security, 2016, Baltimore, MD, United States

Abstract

SkyServer, the Internet portal for the Sloan Digital Sky Survey (SDSS) astronomic catalog, provides a set of tools that allows data access for astronomers and scientific education. One of SkyServer data access interfaces allows users to enter ad-hoc SQL statements to query the catalog. SkyServer also presents some template queries that can be used as basis for more complex queries. This interface has logged over 330 million queries submitted since 2001. It is expected that analysis of this data can be used to investigate usage patterns, identify potential new classes of queries, find similar queries, etc. and to shed some light on how users interact with the Sloan Digital Sky Survey data and how scientists have adopted the new paradigm of e-Science, which could in turn lead to enhancements on the user interfaces and experience in general. In this paper we review some approaches to SQL query mining, apply the traditional techniques used in the literature and present lessons learned, namely, that the general text mining approach for feature extraction and clustering does not seem to be adequate for this type of data, and, most importantly, we find that this type of analysis can result in very different queries being clustered together.

Citation Download Citation

Vitor Makiyama Hirota, Rafael Santos, Jordan Raddick, and Ani Thakar "Mining the SDSS SkyServer SQL queries log", Proc. SPIE 9851, Next-Generation Analyst IV, 98510S (12 May 2016); https://doi.org/10.1117/12.2224237

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available