Jim Gray’s research while affiliated with University of Arizona and other places

What is this page?


This page lists works of an author who doesn't have a ResearchGate profile or hasn't added the works to their profile yet. It is automatically generated from public (personal) data to further our legitimate goal of comprehensive and accurate scientific recordkeeping. If you are this author and want this page removed, please let us know.

Publications (190)


Cosmological Parameters from Eigenmode Analysis of Sloan Digital Sky Survey Galaxy Redshifts
  • Article

September 2016

·

8 Reads

Symposium - International Astronomical Union

·

Adrian Pope

·

·

[...]

·

We present estimates of cosmological parameters from the application of the Karhunen-Loève transform to the analysis of the 3D power spectrum of density fluctuations using Sloan Digital Sky Survey galaxy redshifts. We use Ω m h and f b = Ω b /Ω m to describe the shape of the power spectrum, σ L 8 g for the (linearly extrapolated) normalization, and β to parametrize linear theory redshift space distortions. on scales k ≤ 0.16 h Mpc ⁻⁻¹ , our maximum likelihood values are Ω m h = 0.264 ± 0.043, f b = 0.286 ± 0.065, σ L 8 g = 0.966 ± 0.048, and β = 0.45 ± 0.12. When we take a prior on Ω b from WMAP, we find Ω m h = 0.207 ± 0.030, which is in excellent agreement with WMAP and 2dF. This indicates that we have reasonably measured the gross shape of the power spectrum but we have difficulty breaking the degeneracy between and Ω m h and f b because the baryon oscillations are not resolved in the current spectroscopic survey window function.


TABLE 1 Characteristics of the SDSS Fourth Data Release ( DR4)
TABLE 2 Special Chunks and Plates
TABLE 3 Target Selection Flags
The Fourth Data Release of the Sloan Digital Sky Survey
  • Article
  • Full-text available

November 2012

·

309 Reads

·

25 Citations

This paper describes the Fourth Data Release of the Sloan Digital Sky Survey (SDSS), including all survey-quality data taken through 2004 June. The data release includes five-band photometric data for 180 million objects selected over 6670 deg2 and 673,280 spectra of galaxies, quasars, and stars selected from 4783 deg2 of those imaging data using the standard SDSS target selection algorithms. These numbers represent a roughly 27% increment over those of the Third Data Release; all the data from previous data releases are included in the present release. The Fourth Data Release also includes an additional 131,840 spectra of objects selected using a variety of alternative algorithms, to address scientific issues ranging from the kinematics of stars in the Milky Way thick disk to populations of faint galaxies and quasars.

Download

Wireless Sensor Networks for Soil Science

September 2010

·

432 Reads

·

46 Citations

International Journal of Sensor Networks

Wireless sensor networks can revolutionise soil ecology by providing measurements at temporal and spatial granularities previously impossible. This paper presents our first steps towards fulfilling that goal by developing and deploying two experimental soil monitoring networks at urban forests in Baltimore, MD. The nodes of these networks periodically measure soil moisture and temperature and store the measurements in local memory. Raw measurements are incrementally retrieved by a sensor gateway and persistently stored in a database. The database also stores calibrated versions of the collected data. The measurement database is available to third-party applications through various Web Services interfaces. At a high level, the deployments were successful in exposing high-level variations of soil factors. However, we have encountered a number of challenging technical problems: need for low-level programming at multiple levels, calibration across space and time, and sensor faults. These problems must be addressed before sensor networks can fulfil their potential as high-quality instruments that can be deployed by scientists without major effort or cost.


The Sloan Digital Sky Survey Quasar Catalog. V. Seventh data release

April 2010

·

215 Reads

·

983 Citations

The Astronomical Journal

We present the fifth edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog, which is based upon the SDSS Seventh Data Release. The catalog, which contains 105,783 spectroscopically confirmed quasars, represents the conclusion of the SDSS-I and SDSS-II quasar survey. The catalog consists of the SDSS objects that have luminosities larger than Mi = –22.0 (in a cosmology with H 0 = 70 km s–1 Mpc–1, ΩM = 0.3, and ΩΛ = 0.7), have at least one emission line with FWHM larger than 1000 km s–1 or have interesting/complex absorption features, are fainter than i ≈ 15.0, and have highly reliable redshifts. The catalog covers an area of ≈9380 deg2. The quasar redshifts range from 0.065 to 5.46, with a median value of 1.49; the catalog includes 1248 quasars at redshifts greater than 4, of which 56 are at redshifts greater than 5. The catalog contains 9210 quasars with i < 18; slightly over half of the entries have i < 19. For each object the catalog presents positions accurate to better than 01 rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800-9200 Å at a spectral resolution of 2000; the spectra can be retrieved from the SDSS public database using the information provided in the catalog. Over 96% of the objects in the catalog were discovered by the SDSS. We also include a supplemental list of an additional 207 quasars with SDSS spectra whose archive photometric information is incomplete.


TABLE 1 Coverage and Contents of DR6
Fig. 2.-Stripe 82, the equatorial stripe in the south Galactic cap, has been imaged multiple times. The bottom pair of curves show the number of scans covering a given right ascension in the north and south strip through the fall of 2004 (these data were also included in DR5); these data are available through the DAS. Since that time, stripe 82 has been covered many more times as part of a comprehensive survey for 0:05 < z < 0:35 supernovae, although often in conditions of poor seeing, bright moon, and /or clouds; the numbers of additional scans at each right ascension in the north and south strip are indicated in the upper pair of curves. These latter data have not been flux-calibrated. [See the electronic edition of the Supplement for a color version of this figure.]
TABLE 3 Spectroscopic Plates Calibrated with Fiber Magnitudes
Fig. 4.— Distribution of differences between r-band photometry synthesized from SDSS spectra ( labeled SPECTRO), and PSF and fiber magnitudes, for stars and galaxies; results are shown for DR6 (left) and the previous version of the calibration available in DR5 (right). Only objects with PSF magnitude brighter than 19 are shown. The most important difference is the offset of 0.35 mag between the two, due to the change in calibration from fiber to PSF photometry. Each panel includes the mean and standard deviation of the best-fit Gaussian, as well as the number of objects lying beyond 3 (as a measure of the non-Gaussianity of the tails). Results are shown for r band, but g-and i-band results are very similar.  
TABLE 5 Outputs of the specBS Pipeline Made Available in the DR6 CAS
The Sixth Data Release of the Sloan Digital Sky Survey

April 2008

·

320 Reads

·

1,399 Citations

The Astrophysical Journal Supplement Series

This paper describes the Sixth Data Release of the Sloan Digital Sky Survey. With this data release, the imaging of the northern Galactic cap is now complete. The survey contains images and parameters of roughly 287 million objects over 9583 deg^2, including scans over a large range of Galactic latitudes and longitudes. The survey also includes 1.27 million spectra of stars, galaxies, quasars, and blank sky (for sky subtraction) selected over 7425 deg^2. This release includes much more stellar spectroscopy than was available in previous data releases and also includes detailed estimates of stellar temperatures, gravities, and metallicities. The results of improved photometric calibration are now available, with uncertainties of roughly 1% in g, r, i, and z, and 2% in u, substantially better than the uncertainties in previous data releases. The spectra in this data release have improved wavelength and flux calibration, especially in the extreme blue and extreme red, leading to the qualitatively better determination of stellar types and radial velocities. The spectrophotometric fluxes are now tied to point-spread function magnitudes of stars rather than fiber magnitudes. This gives more robust results in the presence of seeing variations, but also implies a change in the spectrophotometric scale, which is now brighter by roughly 0.35 mag. Systematic errors in the velocity dispersions of galaxies have been fixed, and the results of two independent codes for determining spectral classifications and redshifts are made available. Additional spectral outputs are made available, including calibrated spectra from individual 15 minute exposures and the sky spectrum subtracted from each exposure. We also quantify a recently recognized underestimation of the brightnesses of galaxies of large angular extent due to poor sky subtraction; the bias can exceed 0.2 mag for galaxies brighter than r = 14 mag.


Table 1. The indexMap schema. 
Figure 1. The Catalog Archive Server schema. Note the various database tables and the relationships (foreign keys) between them; tables are grouped by the kind of data they contain.  
Figure 2. Metadata tables used for diagnostics and integrity checks on the schema. Everything except the Versions, SiteDBs, and SiteConstants tables is autogenerated.  
Figure 4. Dependency chart for region and sector functions and stored procedures. These functions compute the spectroscopic plate tiling geometry required for large-scale structure studies. The shading represents the functional group that each function belongs to; the chart illustrates the complex programming achieved with SQL functions and stored procedures inside the database management system.  
Figure 5. Hierarchical Triangular Mesh (HTM) functions. The cover functions provide the entry interface that calls functions in the spherical libraries. SphericalHTM is an HTM layer on top of SphericalLIB.  
The Catalog Archive Server Database Management System

February 2008

·

723 Reads

·

55 Citations

Computing in Science & Engineering

The Sloan Digital Sky survey (SDSS) has employed a relational database management system with SQL query access and a built-in query optimizer to provide the storage, organization, distribution, and data mining capabilities. The RDBMS provides built-in, advanced data mining and query optimization capabilities for increasing access speed. The SDSS photometric pipeline includes a table that contains the photometric parameters for each astronomical object that the photometric pipeline identifies. The SDSS camera records all observations that include repeat observations of objects. Primary and secondary objects in the PhotoObjall table are listed that is defined by an SQL query. The Metadata labels include the contents of the documentation pages in the CAS Web sties.


The sqlLoader Data-Loading Pipeline

February 2008

·

1,158 Reads

·

14 Citations

Computing in Science & Engineering

A data-loading pipeline called the sqlLoader for loading large multidimensional data sets such as Sloan Digital Sky Server (SDSS) into a database management systems has been developed. The loading process is subdivided into a sequence of steps and a largely automated workflow system is developed that executes these steps on a distributed cluster of load servers. The SQL Server agent process controls the loader workflow using agent jobs called load and pub. The load job runs once every minute, picking up the next step from the load stage for the first active task and executing it. The pub job wakes up once every minute and picks up the next step in the publish/merge or finish stage. Several load servers can be in the load role but only one server can be in the pub role at a time. The sqlLoader framework contains several kinds of scripts such as windows command scripts, SQL scripts, data transformation services packages, and Visual Basic scripts.


TABLE 1 Characteristics of the DR5 Imaging Survey
TABLE 2 Characteristics of the DR5 Spectroscopic Survey
Fig. 5.-Test of spectrophotometric accuracy, performed by dividing the restframe spectra of elliptical galaxies observed over the redshift range 0:04 z 0:2 (see text). Points show the residual inferred from 160 redshift-bin spectra (each an average of 300-1000 individual galaxies) spaced by Áz ¼ 0:01, and the central line shows the median residual. [See the electronic edition of the Supplement for a color version of this figure.]
Fig. 6.-Comparison of photometric redshift estimates PhotoZ and PhotoZ2 to SDSS spectroscopic redshifts and to each other.
The Fifth Data Release of the Sloan Digital Sky Survey

October 2007

·

188 Reads

·

659 Citations

The Astrophysical Journal Supplement Series

This paper describes the Fifth Data Release (DR5) of the Sloan Digital Sky Survey (SDSS). DR5 includes all survey quality data taken through 2005 June and represents the completion of the SDSS-I project (whose successor, SDSS-II, will continue through mid-2008). It includes five-band photometric data for 217 million objects selected over 8000 deg2 and 1,048,960 spectra of galaxies, quasars, and stars selected from 5713 deg2 of that imaging data. These numbers represent a roughly 20% increment over those of the Fourth Data Release; all the data from previous data releases are included in the present release. In addition to "standard" SDSS observations, DR5 includes repeat scans of the southern equatorial stripe, imaging scans across M31 and the core of the Perseus Cluster of galaxies, and the first spectroscopic data from SEGUE, a survey to explore the kinematics and chemical evolution of the Galaxy. The catalog database incorporates several new features, including photometric redshifts of galaxies, tables of matched objects in overlap regions of the imaging survey, and tools that allow precise computations of survey geometry for statistical investigations.


TABLE 1 Characteristics of the DR5 Imaging Survey
TABLE 2 Characteristics of the DR5 Spectroscopic Survey
Fig. 5.-Test of spectrophotometric accuracy, performed by dividing the restframe spectra of elliptical galaxies observed over the redshift range 0:04 z 0:2 (see text). Points show the residual inferred from 160 redshift-bin spectra (each an average of 300-1000 individual galaxies) spaced by Áz ¼ 0:01, and the central line shows the median residual. [See the electronic edition of the Supplement for a color version of this figure.]
Fig. 6.-Comparison of photometric redshift estimates PhotoZ and PhotoZ2 to SDSS spectroscopic redshifts and to each other.
The Fifth Data Release of the Sloan Digital Sky Survey

August 2007

·

106 Reads

·

83 Citations

This paper describes the Fifth Data Release (DR5) of the Sloan Digital Sky Survey (SDSS). DR5 includes all survey quality data taken through 2005 June and represents the completion of the SDSS-I project (whose successor, SDSS-II, will continue through mid-2008). It includes five-band photometric data for 217 million objects selected over 8000 deg2 and 1,048,960 spectra of galaxies, quasars, and stars selected from 5713 deg2 of that imaging data. These numbers represent a roughly 20% increment over those of the Fourth Data Release; all the data from previous data releases are included in the present release. In addition to ``standard'' SDSS observations, DR5 includes repeat scans of the southern equatorial stripe, imaging scans across M31 and the core of the Perseus Cluster of galaxies, and the first spectroscopic data from SEGUE, a survey to explore the kinematics and chemical evolution of the Galaxy. The catalog database incorporates several new features, including photometric redshifts of galaxies, tables of matched objects in overlap regions of the imaging survey, and tools that allow precise computations of survey geometry for statistical investigations.


The Sloan Digital Sky Survey Quasar Catalog. IV. Fifth Data Release

July 2007

·

428 Reads

·

438 Citations

The Astronomical Journal

We present the fourth edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog. The catalog contains 77,429 objects; this is an increase of over 30,000 entries since the previous edition. The catalog consists of the objects in the SDSS Fifth Data Release that have luminosities larger than Mi=-22.0 (in a cosmology with H0=70 km s-1 Mpc-1, OmegaM=0.3, and OmegaLambda=0.7), have at least one emission line with FWHM larger than 1000 km s-1 or have interesting/complex absorption features, are fainter than i~15.0, and have highly reliable redshifts. The area covered by the catalog is ~5740 deg2. The quasar redshifts range from 0.08 to 5.41, with a median value of 1.48; the catalog includes 891 quasars at redshifts greater than 4, of which 36 are at redshifts greater than 5. Approximately half of the catalog quasars have i<19 nearly all have i<21. For each object the catalog presents positions accurate to better than 0.2" rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains basic radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800-9200 Å at a spectral resolution of ~=2000 the spectra can be retrieved from the public database using the information provided in the catalog. The average SDSS colors of quasars as a function of redshift, derived from the catalog entries, are presented in tabular form. Approximately 96% of the objects in the catalog were discovered by the SDSS.


Citations (85)


... We should be able to evaluate our tools in the same environment and with the same scenarios. In information retrieval community, authors of the Lowell report [69] clearly calls for the design of a test collection. Thalia [72], INEX [62] and TREC [10] were therefore proposed. ...

Reference:

Towards a Generic Approach for Schema Matcher Selection: Leveraging User Pre- and Post-match Effort for Improving Quality and Time Performance
The Lowell report
  • Citing Conference Paper
  • January 2003

... SC07 November 10-16, 2007, Reno, NevadaTable 1Table 1 indicates that the storage subsystem is consistently one of the primary sources of failure on large supercomputers. The situation is only likely to worsen in the near future, due to the growing relative size of the storage system forced by two trends: (1) disk performance increases slower than that of CPUs and (2) users' data needs grow faster than does the available compute power [14]. A survey of DOE applications suggests that most applications require a sustained 1 GB/sec I/O throughput for every TeraFlop of peak computing performance. ...

Scientific Data Federation
  • Citing Chapter
  • December 2004

... The data utilized in this paper originates from the 16th release of SDSS. SDSS-DR16 comprises a total of 930,268 photometric images, encompassing 1.2 billion observation sources and tens of millions of spectra [15]. Photometric data from SDSS consists of images in five bands: u, g, r, i, and z, with each photometric image packaged in single-band format within FITS files. ...

Designing and Mining Multi-Terabyte Astronomy Archives: The Sloan Digital Sky Survey

ACM SIGMOD Record

... Sorting is a fundamental operation in computer science, used in databases [23,24], scientific computing [18], scheduling [58], artificial intelligence and robotics [11], image [35], video [14], and signal processing [46]. The latency and energy consumptions of the sorting algorithm directly affect the efficiency of these systems. ...

GPUTeraSort
  • Citing Conference Paper
  • June 2006

... This section discusses related work that introduces locality in distributed computing. According to Szalay et al. [34], the reason for introducing locality in distributed computing is to improve the performance (particularly turnaround latency) of distributed computing, not locality itself. Subsequently, many distributed engines introduced locality to improve processing performance. ...

The Importance of Data Locality in Distributed Computing Applications
  • Citing Article
  • January 2006

... Disk Filesystem Write performance is generally sensitive to the performance of the backend storage subsystem. The large majority of disks exhibit poor random Write performance [21]. Also, depending on the organization of the in-memory file system, ramfs based systems have also been shown to exhibit poor performance for random Write operations [22]. ...

A Quick Look at Serial ATA (SATA) Disk Performance
  • Citing Article
  • April 2004

... Although terminologists might not rely entirely on corpus data, corpora can still provide useful context information for terminological analysis. In particular, domain-specific research with a corpus approach shows that data processing is the prerequisite for methodological innovations in terminology studies, with the nature of such research gradually becoming 'data-driven' rather than 'knowledge-based' (Szalay and Gray, 2006). Furthermore, thoughtprovoking further readings at the end of each chapter are not merely a simple list of references, but more of critical reviews that offer a collection of valuable resources pertinent to the topics involved. ...

Science in an exponential world
  • Citing Article
  • January 2006

Nature

... Wireless sensor networks have been used in a number of environmental monitoring applications [1][2][3], offering scien- tists the ability to observe physical phenomena in spatial and temporal granularities not previously possible. In turn, these observations reveal previously unknown physical phenomena and subtle variations (e.g. ...

Life under your feet: Wireless sensors in soil ecology
  • Citing Conference Paper
  • May 2006