Click on the arrow on the right side of the citation to display the respective abstract.
Publications are listed in reverse chronological order (i.e. most recent first).
Array Processing of Teleseismic Body Wave Phases Recorded by the Transportable Array
Pavlis, G. L., Vernon, F. L. (2007)
Earthscope 2007 Meeting, Monterey, California
Questions we addressed:
* How can we use the TA for coherent wavefield processing?
* What are the limits of coherent processing?
* How to adapt to standard methods?
* What phases can be analyzed this way?
Issues:
Standard plane wave methods used in array processing need
to be adapted to account for two fundamental issues
with a broaband array the scale of the TA:
1. Alignment: we cannot use the conventional plane wave
approximation due to scale and large statics problems.
2. Data volume: the data volume is so large we need ways to
automatically handle noisy and bad stations
|
The EarthScope USArray Array Network Facility (ANF): Metadata, Network and Data Monitoring, and Quality Assurance
Eakins, J., Vernon, F. L., Martynov, V., Astiz, L., Newman, R. L., Cox, T. (2007)
Earthscope 2007 Meeting, Monterey, California
As we begin our fourth year of operations, the Array Network Facility
(ANF) for the EarthScope USArray Transportable Array seismic network
has continued the timely delivery of metadata and waveform data from
the growing number of Transportable Array stations. The network has
increased in size to 307 stations with 244 out of the 400 new TA sites
installed (as of February 2007). Starting next spring, equipment will
start to roll from current stations to new locations to the east of the
current footprint.
Use of the Antelope software package has allowed us to maintain and
operate such a dynamic network configuration, facilitating the
collection and transfer of data, the generation and merging of the
metadata as well as the real-time monitoring of state of health of TA
station data-loggers and their command and control. Four regional
networks (Anza, BDSN, SCSN, and UNR) as well as the USNSN
contribute data to the Transportable Array in real-time. Although the
real-time data flow to the IRIS DMC has been consistently above 90% in
the last year, the ANF has strived to recover the remaining 10% of data
to the DMC by connecting to a data storage device (Baler) at each
station to generate day long seed files: automation of this process is
ongoing.
Operation of the USArray at the ANF has benefited by the real-time
interface with the ORB and the Datascope database using PHP for display
on the ANF website (http://anf.ucsd.edu). A recent feature in the
website is round-robin database (rrd) plots allowing for scoping of
individual and grouped state of health parameters. Information
available for all stations includes: location, maps, photographs,
equipment deployed, communications, distribution of events recorded by
each station, and displays of daily, weekly, and monthly station noise
spectra as generated by the DMC.
Analyst review of automatic locations for the USArray network is being
done at the ANF to monitor data quality. All events are associated
with the USGS and regional network bulletins. As of February 2007,
around 13,000 weekly picks are being fully reviewed by analysts at the
ANF and over 19,000 events have been recorded. We find a small
percentage of events that cannot be associated with existing
bulletins. This information is used by the regional network operators
to help them determine which stations may be beneficial to permanently
add to their seismic networks.
|
Advances in web-based visualization of the state-of-health of Earthscope's Transportable Array: webdlmon
Newman, R. L., Lindquist, K. G., Vernon, F. L., Davis, G. A., Eakins, J., Astiz, L. (2007)
Earthscope 2007 Meeting, Monterey, California
The Earthscope Transportable Array has increased in size over the last
three years to over 250 broadband seismic stations. Critical real-time
assessment of datalogger state-of-health information and data transfer
metadata is fundamental to maintaining a healthy network. Providing
this information to analysts, station engineers, administrative staff,
researchers and the public is the responsibility of the Array Network
Facility (ANF). Various interconnected software packages (including the
Antelope Environmental Monitoring System, Round Robin Database Tool,
Generic Mapping Tools, MATLAB) and web services (including Nagios and
Flickr) build data products in near real-time that are organized and
integrated into the ANF website using XML, Javascript, and PHP. These
metadata and data products are readily accessible via the
world-wide-web at http://anf.ucsd.edu. This poster will highlight
recent advances in web-based tool development, including an XML-based
Datalogger Monitor (dlmon) that is integrated with real-time graphing
capabilities.
|
Real-time operation of the NSF EarthScope USArray Transportable Array
Astiz, L., Eakins, J., Vernon, F. L., Martynov, V., Newman, R. L., Cox, T., Mulder, T. L., Busby, R. W. (2007)
Eos Transactions AGU, General Assembly Meet. Suppl. 88 (23) Abstract S34A-01
The Transportable Array (TA) component of USArray uses real-time telemetry to send data to the Array
Network
Facility (ANF) through a variety of satellite, mobile phone, wireless and wired communication
links. The ANF is
responsible for the timely delivery of metadata and waveform data to the IRIS DMC from the growing
number of
Transportable Array stations. The IRIS DMC makes these data available to the research community.
The network
has increased in size to 327 stations with 259 out of the 400 new TA sites installed (as of 28
February 2007).
Starting in Fall 2007, equipment will start to roll from current stations to new locations to the
east of the current
footprint.
Use of the Antelope software package has allowed the ANF to maintain and operate this extremely
dynamic
network configuration, facilitating the collection and transfer of data, the generation and merging
of the metadata
as well as the real-time monitoring of state of health of TA station data-loggers and their command
and control.
Four regional networks (ANZA, BDSN, SCSN, and UNR) as well as the USNSN contribute data to the
Transportable Array in real-time. Although the real-time data flow to the IRIS DMC has been 93.4%
over the last
year, the ANF and the TA field teams have extended every effort and have managed to recover an
additional 4.8%
by recovering data from the local data storage device (Baler 14) at each station. Once the missing
data is
recovered, we then generate station-channel-day volume seed files, which are resent to the DMC to
bring the total
data recovery rate to 98.4%. The total network uptime is above 99%.
Analyst review of automatic locations for the USArray network is being done at the ANF as part of
the data quality
monitoring strategy. All events are associated with the USGS and regional network bulletins. As
of February
2007, around 13,000 weekly picks are being fully reviewed by analysts at the ANF and over 19,000
events have
been recorded. We find a small percentage (about 10 %) of events that cannot be associated with
existing
bulletins. This information is used by the regional network operators to help them determine which
TA stations
may be beneficial to permanently add to their seismic networks.
Operation of the USArray at the ANF has benefited by the real-time interface with the ORB and the
Datascope
database using PHP for display on the ANF website (http:anf.ucsd.edu) to provide station and system
state-of-
health information to field teams. Information available for all stations includes: location,
maps, photographs,
equipment deployed, communications, distribution of events recorded by each station, and displays
of daily,
weekly, and yearly state of health parameters as well as station noise spectra generated by the
DMC.
|
Web-based tools for real-time assessment of Earthscope's Transportable Array state-of- health: integration of the Antelope Real Time System, RRDtool, AJAX and PHP
Newman, R. L., Lindquist, K. G., Vernon, F. L., Davis, G. A., Eakins, J., Astiz, L. (2007)
Eos Transactions AGU, General Assembly Meet. Suppl. 88 (23) Abstract S23A-03
Over the past three years the Array Network Facility (ANF) has
developed a robust, extensible web-based toolkit for monitoring the
state-of-health of Earthscope's Transportable Array. The tools are
constructed within a framework of the Antelope Real Time System (ARTS)
and the Antelope interface to the PHP Hypertext Processor (PHP), an
inline scripting language. Exporting data from Datascope databases and
Object Ring Buffer (ORB) packets into XML allows comprehensive
client-side interaction via Asynchronous Javascript And XML (AJAX)
calls.
Navigating and displaying the resultant XML Document Object Model (DOM)
trees are done using eXtensible Stylesheet Language Transformation
(XSLT) and PHP's built-in DOM classes. Tools include regional and
individual station and event maps, state-of-health statistics, waveform
plots, and datalogger monitoring. Combined with real-time graphing of
state-of-health parameters from status ORB packets using Round Robin
Database Tool (RRDtool), this toolkit allows analysts, station
engineers, scientists, and the general public to view, assess, interact
with, and download data collected from the 250+ stations in the
Transportable Array seismic network. Tools are available at the Array
Network Facility website, http:anf.ucsd.edu.
|
USArray Applications of Antelope PHP web technologies: ANF.UCSD.EDU
Newman, R. L., Lindquist, K. G., Vernon, F. L., Eakins, J., Hansen, T. S., Davis, G. A., Foley, S., Astiz, L. (2006)
Eighteenth Annual IRIS Worskhop, Westward Look Resort, Tucson, AZ, June 2006
The Array Network Facility website (http://anf.ucsd.edu) displays a variety of diverse
meta-data associated with the USArray Transportable and Flexible Arrays. A suite of online
tools has been developed to allow visual and interactive exploration of the data and
meta-data from the array stations.
The website is partitioned into public and administrative areas. The public area provides
dynamic maps of station locations, along with network affiliations, communication
providers, hardware configurations, associated latencies and event maps. The public pages
also show waveform data returned for the last 1, 2 and 24 hours. This allows rapid
assessment of array health from anywhere with internet access. Graphical representations
of state-of-health parameters are generated nightly for each station, creating a searchable
archive. The station maps and metadata details are fully dynamic, updating immediately
based on changes in the underlying databases and streaming data returned. The
password-protected administrative area provides access to a searchable database of
station-maintenance email from field personnel, filed by station, as well as upload and
search facilities for digital photos of field sites integrated with the Flickr photo-sharing
facility at http://www.flickr.com.
The underlying architecture of this dynamic environment is the Datascope RDBMS, part of
the Antelope Environmental Monitoring System (http://www.brtt.com), in combination with
the PHP Hypertext Processing (PHP) scripting language. This configuration provides an
easily extensible platform for real time environmental monitoring, with many re-usable
components.
We present the various types of data available from the ANF website, in addition to simple
descriptions of how these data were collected and displayed. We also outline upcoming
tools that we are currently developing to improve monitoring as this already large array
continues to grow.
|
The EarthScope USArray Array Network Facility (ANF): Metadata, Network and Data Monitoring, Quality Assurance During the Third Year of Operations
Eakins, J., Vernon, F. L., Martynov, V., Astiz, L., Newman, R. L., Cox, T., Foley, S. (2006)
Eos Transactions AGU, Fall Meet. Suppl. 87 (52) Abstract U41B-0816
During the third year of operations, the Array Network Facility (ANF)
for the EarthScope USArray Transportable Array seismic network has
continued the timely delivery of metadata and waveform data from the
growing number of Transportable Array stations. The network has nearly
doubled in size over the last year to 233 stations with 170 out of the
400 new TA sites installed (as of September 2006). Use of the Antelope
software package has allowed us to maintain and operate such a dynamic
network configuration, facilitating the collection and transfer of data,
the generation and merging of the metadata as well as the real-time
monitoring of state of health of TA station data-loggers and their command
and control. Currently four regional networks (Anza, BDSN, SCSN, and UNR)
as well as the USNSN contribute data to the Transportable Array with
additional contributions expected from UUSS and the Montana Regional
Seismic Network. Although the real- time data flow to the IRIS DMC has
been consistently above 90% in the last year, the ANF has strived to
recover the remaining 10% of data to the DMC by connecting to a data
storage device (Baler) at each station to generate day long seed files:
automation of this process is ongoing. The results of this process will
be presented. Operation of the USArray at the ANF has benefited by the
real-time interface with the ORB and the Datascope database using PHP
for display on the ANF website (http://anf.ucsd.edu). A recent feature
in the website is station grouping, by communication provider, network,
and equipment deployed at each site that helps to diagnose and reduce
response time to operational problems. Information available for all
stations includes: location, maps, photographs, equipment deployed,
communications, distribution of events recorded by each station, and
displays of daily, weekly, and monthly station noise spectra as generated
by the DMC is also available. Analyst review of automatic locations
for the USArray network are being done in quasi real-time at the ANF to
monitor data quality. All events are associated with the USGS and regional
network bulletins. We find a small percentage of events that cannot be
associated with existing bulletins. The pick information generated at the
ANF for all USArray stations is made available as a basic product to the
scientific community and regional data centers. As of September 2006, an
average of 10,000 weekly picks are being generated by analysts at the ANF.
|
An SOA-based Framework for Instrument Management for Large-scale Observing Systems (USArray Case Study)
Cotofana, C., Ding, L., Shin, P., Tilak, S., Fountain, T., Eakins, J., Vernon, F. L. (2006)
Proceedings of the IEEE International Conference on Web Services
Large-scale observing systems are poised to become the dominant means of
study for a variety of natural phenomena. These systems are comprised
of hundreds to thousands of instruments that must be queried, managed,
and shared in a scalable fashion. Services-oriented architectures (SOAs)
are widely recognized as the preferred framework for building scalable
and extensible cyberinfrastructure. By applying SOA concepts, we created
a framework for organizing observing system resources. Guided by this
framework, we developed web services, custom workflow applications,
and an integrated user interface of monitors and controls for managing
instruments in large-scale sensor network observing systems. In this
paper we present our approach and discuss its application to the NSF
EarthScope USArray large-scale seismic observing system.
|
Scientific Visualizations of Multidimensional Data Collected from Various Sensors
Samilo, D., Nayak, A. M., Kilb, D., Im, T., Vernon, F. L., Astiz, L., Eakins, J., Moschetti, M., Ritzwoller, M. H. (2006)
Eos Transactions AGU, Fall Meet. Suppl. 87 (52) Abstract IN31A-1321
With the advances in the collection of greater quantities of
higher caliber data, the field geophysics demands a new device to
appropriately synthesize and compare the continuously-incoming slew
of heterogeneous datasets from various branches of earth science.
These data include earthquakes, sediment thickness, focal mechanisms,
topography, tomography, Moho depth, aquifers, mines, geology, magnetics,
faults, gravity, and photo-imagery. Due to the terminology, domain
knowledge, and file formats associated with each data type and respective
sub-discipline, the coherent translation of the data made accessible for
all involved parties of researchers becomes a difficult task. Herein,
interactive 3D visualizations succor in advancing comprehension of
interdependencies between datasets, even manifesting never-before-seen
relations previously masked by directly interpreting raw data. One such
example would be the examination of Californian fault systems. To assay
the discrete intricacies of fault systems, we use 3D visualizations to
posit representations of first motion mechanisms as sets of dual nodal
planes (strike & dip) into a geographically-bound environment; once this
is accomplished, a mere visual inspection yields the identification of
certain regions as of high fault complexity (e.g., Coalinga, the San
Jacinto fault) and of relative fault simplicity (e.g., Parkfield).
These visualizations can be appended with imagery from earthquake
locations (lat, lon, depth), surface fault traces, and seismic
instrument locations. Other projects include interpreting and using
data recorded by the USArray Transportable Array network to generate
temporal snapshots of how surface wave tomography derived from ambient
seismic noise has evolved with the expansion of the sensor network.
Likewise, these "snapshots" can be visualized to produce stunning
presentations. Visualizations such as the aforementioned are available
to the public through download at the Scripps Visualization Center's
visual objects library (http://siovizcenter.ucsd.edu/library.php).
This library includes 3D interactive visualizations, Quicktime movies,
and on-line tools. Please contact us at vizinfo@ucsd.edu if you would
like to collaborate on visualizing your geophysical data.
|
EarthScope's Transportable Array: Advancing Eastward
Busby, R. W., Vernon, F. L., Newman, R. L., Astiz, L. (2006)
Eos Transactions AGU, Fall Meet. Suppl. 87 (52) Abstract U41B-0820
EarthScope's Transportable Array has installed more than 200 high-quality
broadband seismic stations over the last 3 years in the western US. These
stations have a nominal spacing of 70 km and are part of an eventual 400
station array that migrates from west to east at a rate of 18 stations per
month. The full 400 stations will be operating by September 2007. Stations
have a residence time of about 2 years before being relocated to the
next site. Throughout the continental US, 1623 sites are expected to be
occupied. Standardized procedures and protocols have been developed to
streamline all aspects of Transportable Array operations, from siting
to site construction and installation to equipment purchasing and data
archiving. Earned Value Management tools keep facility installation
and operation on budget and schedule. A diverse, yet efficient,
infrastructure installs and maintains the Transportable Array. Sensors,
dataloggers, and other equipment are received and tested by the IRIS
PASSCAL Instrument Center and shipped to regional storage facilities. To
engage future geoscientists in the project, students are trained to
conduct field and analytical reconnaissance to identify suitable seismic
station sites. Contract personnel are used for site verification; vault
construction; and installation of sensors, power, and communications
systems. IRIS staff manages permitting, landowner communications, and
station operations and maintenance. Seismic signal quality and metadata
are quality-checked at the Array Network Facility at the University
of California-San Diego and simultaneously archived at the IRIS Data
Management Center in Seattle. Station equipment has been specifically
designed for low power, remote, unattended operation and uses diverse
two-way IP communications for real-time transmission. Digital cellular
services, VSAT satellite, and commercial DSL, cable or wireless transport
services are employed. Automatic monitoring of status, signal quality
and earthquake event detection as well as operational alarms for low
voltage and water intrusion are performed by a robust data acquisition
package. This software is coupled with a host of network management tools
and display managers operated by the Array Network Facility to allow
managers, field personnel, and network operations staff to visualize
array performance in real-time and to access historical information for
diagnostics. Current data recording proficiency is 99.1%, with real-time
telemetry averaging about 91%. EarthScope, IRIS and the USGS are working
with regional seismic network operators, both existing and newly formed,
to transition some of the Transportable Array stations into regional
network assets. Each region has unique circumstances and interested
parties are invited to exchange ideas on how this might be accomplished
in their area. Contact busby@iris.edu for more information.
|
Monitoring the Monitors: Assessing and Visualizing the State-of-Health of Earthscope's Transportable Array
Newman, R. L., Foley, S., Davis, G. A., Lindquist, K. G., Vernon, F. L., Eakins, J., Astiz, L. (2006)
Eos Transactions AGU, Fall Meet. Suppl. 87 (52) Abstract IN23A-1213
The Earthscope Transportable Array has increased in size over the
last three years to over 200 broadband seismic stations. Assessing
the state-of-health of the station equipment, collecting data transfer
metadata, and providing this information to analysts, station engineers,
administrative staff, researchers and the public is the responsibility
of the Array Network Facility (ANF). Various interconnected software
packages (including the Antelope Environmental Monitoring System, RRD,
GMT, MATLAB, Nagios and Flickr) build data products in near real-time that
are organized and integrated into the ANF website using PHP (a web-based
scripting language embedded in HTML). These metadata and data products
are readily accessible via the world-wide-web at http://anf.ucsd.edu,
where multiple web-based tools have been developed to display and
visualize these products.
|
Virtualization and Federation of Multiple Real-time Observatories Through the ROADNet Point of Presence
Lindquist, K. G., Vernon, F. L., Hansen, T. S., Rajasekar, A., Orcutt, J., Foley, S., Davis, G. A., Terrill, E., Otero, M. (2006)
Eos Transactions AGU, Fall Meet. Suppl. 87 (52) Abstract IN23A-1211
Recent progress on the Antelope interfaces to the Storage Resource Broker
and on the deployable ROADNet Point Of Presence ("RPOP") has allowed three
real-time observatories to be federated for virtual access to ROADNet
image and meteorological data, coastal ocean current-monitoring data,
and hundreds of gigabytes of USArray seismic data. The new Antelope-SRB
Strdisp utility allows interactive review of waveform data from these
data sources, with observatory-grade tools, on any computer with internet
access, sufficient bandwidth, and system authentication. Similarly, the
new Antelope-SRB Strexcerpt utility allows arbitrary subset databases
of waveform data to be extracted, via simple or complex queries,
and downloaded to the researcher's machine in any of approximately 20
user-specifiable formats. Key parts of the Antelope interface for PHP have
been extended to the Antelope-SRB interface, providing web-scriptable
world-wide-web access to these datasets. Similarly, key parts of the
Antelope Toolbox for Matlab have been ported to the Antelope-SRB
interface, making these large, federated data sets accessible to
researchers for custom interactive exploration and processing based
on their individual research needs. We end by discussing ongoing
work on generalized remote database exploration and analysis tools for
Antelope-SRB virtualized data sets. We also discuss the Antelope-SRB ORB
(Virtual-ORB) interfaces in the RPOP cyberinfrastructure node.
|
Virtualization of Command and Control of Large-scale Observing Systems Using SOA (USArray Case Study)
Cotofana, C., Ding, L., Shin, P., Tilak, S., Fountain, T., Eakins, J., Vernon, F. L. (2006)
Eos Transactions AGU, Fall Meet. Suppl. 87 (52) Abstract U41B-0817
Large-scale observing systems are poised to become the dominant means of
study for a variety of natural phenomena. These systems are comprised
of hundreds to thousands of instruments that must be queried, managed,
and shared in a scalable fashion. Services-oriented architectures
(SOAs) are widely recognized as the preferred framework for building
scalable and extensible cyberinfrastructure. By applying SOA concepts,
we created a framework for organizing observing system resources and
virtualizing command and control. We developed a suite of web services,
custom workflow applications, and an integrated user interface of monitors
and controls for managing instruments in large-scale sensor network
observing systems. In particular, by virtualizing command and control,
were able to decouple deployment processes from the target computer
hosting the sensor network middleware, thus enabling more efficient
administration. This poster illustrates our approach and its application
to the NSF EarthScope USArray large-scale seismic observing system.
|
Improvements to Web Toolkits for Antelope-based Real-time Monitoring Systems
Lindquist, K. G., Newman, R. L., Vernon, F. L., Hansen, T. S., Orcutt, J. (2005)
Eos Transactions AGU, Fall Meet. Suppl. 86 (52) Abstract IN13A-1081
The Antelope Environmental Monitoring System (http://www.brtt.com) is
a robust middleware architecture for near-real-time data collection,
analysis, archiving and distribution. Antelope has an extensive toolkit
allowing users to interact directly with their datasets. A rudimentary
interface was developed in previous work between Antelope and the
web-scripting language PHP (The PHP language is described in more
detail at http://www.php.net). This interface allowed basic application
development for remote access to and interaction with near-real-time
data through a World Wide Web interface. We have added over 70 new
functions for the Antelope interface to PHP, providing a solid base
for web-scripting of near-real-time Antelope database applications. In
addition, we have designed a new structure for web sites to be created
from the Antelope platform, including PHP applications and Perl CGI
scripts as well as static pages. Finally we have constructed the first
version of the dbwebproject program, designed to dynamically create
and maintain web-sites from specified recipes. These tools have already
proven valuable for the creation of web tools for the dissemination of
and interaction with near-real-time data streams from multi-signal-domain
real-time sensor networks. We discuss current and future directions of
this work in the context of the ROADNet project. Examples and applications
of these core tools are elaborated in a companion presentation in this
session (Newman et al., AGU 2005, session IN06).
|
The Earthscope USArray Array Network Facility (ANF): Metadata, Network and Data Monitoring, Quality Assurance During the Second Year of Operations
Eakins, J., Vernon, F. L., Martynov, V., Newman, R. L., Cox, T., Lindquist, K. G., Hindley, A., Foley, S. (2005)
Eos Transactions AGU, Fall Meet. Suppl. 86 (52) Abstract S33B-0327
The Array Network Facility (ANF) for the Earthscope USArray Transportable
Array seismic network is responsible for: the delivery of all
Transportable Array stations (400 at full deployment) and telemetered
Flexible Array stations (up to 200) to the IRIS Data Management Center;
station command and control; verification and distribution of metadata;
providing useful remotely accessible world wide web interfaces for
personnel at the Array Operations Facility (AOF) to access state of health
information; and quality control for all data. To meet these goals,
we use the Antelope software package to facilitate data collection and
transfer, generation and merging of the metadata, real-time monitoring of
dataloggers, generation of station noise spectra, and analyst review of
individual events. Recently, an Antelope extension to the PHP scripting
language has been implemented which facilitates the dynamic presentation
of the real-time data to local web pages. Metadata transfers have been
simplified by the use of orb transfer technologies at the ANF and
receiver end points. Web services are being investigated as a means
to make a potentially complicated set of operations easy to follow and
reproduce for each newly installed or decommissioned station. As part of
the quality control process, daily analyst review has highlighted areas
where neither the regional network bulletins nor the USGS global bulletin
have published solutions. Currently four regional networks (Anza, BDSN,
SCSN, and UNR) contribute data to the Transportable Array with additional
contributors expected. The first 100 stations (42 new Earthscope stations)
were operational by September 2005 with all but one of the California
stations installed. By year's end, weather permitting, the total number of
stations deployed is expected to be around 145. Visit http://anf.ucsd.edu
for more information on the project and current status.
|
iCluster : Visualizing USArray data on a scalable high resolution tiled display using the OptIPuter
Nayak, A. M., Vernon, F. L., Kent, G., Orcutt, J., Kilb, D., Newman, R. L., Eakins, J., Smarr, L., DeFanti, T., Leigh, J., Renambot, L., Johnson, A. (2005)
GEON 3rd Annual National Meeting on Research Frontiers in Cyperinfrastructure
A 16.4 megapixel display wall has been constructed at the Array Network
Facility (ANF) in the Cecil H. & Ida M. Green Institute of Geophysics
and Planetary Physics (IGPP) for the display of multiple interactive
visualizations of various geophysical datasets.
This system is designed through collaboration between major NSF funded
projects such as OptIPuter and USArray (Earthscope), and will allow
researchers to access large stores of data on remote servers using
dedicated links, visually analyze data and present results at extremely
high resolution. The system is nicknamed iCluster and will be scaled
to a 50 megapixel display as the USArray (currently about 80 stations)
expands its operations.
The OptIPuter project (www.optiputer.net) leverages the capabilities of
dedicated optical networks that interconnect instruments, processors,
computer storage and visualization resources to aid in Earth Sciences
research. The iCluster comprises a cluster of three Apple Power Mac
G5 machines and four Apple 30" LCD screens (of maximum resolution 2560
x 1600 each) tiled to form a 2x2 array and is the first tiled display
built using Apple hardware (to our knowledge). The Antelope software
is used for seismic data monitoring and archiving along with web-based
analytical tools developed at the ANF (http://anf.ucsd.edu/). OptIPuter
visualization software (developed by the Electronic Visualization
Laboratory, University of Illinois at Chicago) such as JuxtaView (an image
viewer for interacting with remotely located extremely high resolution
2D images) and Vol-a-Tile (interactive volume rendering software
allowing navigation into gigabyte-sized seismic volumes) will also be
used. Interactive visualizations created by scientists at IGPP that
overlay heterogeneous datasets such as seismic profiles, geology strata,
earthquake locations, bathymetry and high resolution satellite imagery
and aerial photos, using the Fledermaus software can also be viewed.
The configuration of each cluster node is: dual CPU 2.5 GHz PowerPC G5,
8 GB RAM, 500 GB disk space, NVIDIA Ultra 6800 GeForce card, and the
nodes are interconnected over gigabit Ethernet. This system will also
be part of the OptIPuter infrastructure, with fiber connections to
the OptIPuter CAVEwave on the National Lambda Rail. The design of the
system is based on the Geowall-2 class of displays and the OptIPuter
Visualization Cluster at Scripps. More information about this system
is available at (http://www.siovizcenter.ucsd.edu/icluster/index.html).
|
Applying a toolkit for dissemination and analysis of near real-time data through the World Wide Web: integration of the Antelope Real Time System, ROADNet, and PHP
Newman, R. L., Lindquist, K. G., Hansen, T. S., Vernon, F. L., Eakins, J., Foley, S., Orcutt, J. (2005)
Eos Transactions AGU, Fall Meet. Suppl. 86 (52) Abstract IN13A-1078
The ROADNet project has enabled the acquisition and storage of diverse
data streams through seamless integration of the Antelope Real Time
System (ARTS) with (for example) ecological, seismological and geodetic
instrumentation. The robust system architecture allows researchers
to simply network data loggers with relational databases; however,
the ability to disseminate these data to policy makers, scientists and
the general public has (until recently) been provided on an 'as needed'
basis. The recent development of a Datascope interface to the popular
open source scripting language PHP has provided an avenue for presenting
near real time data (such as integers, images and movies) from within
the ARTS framework easily on the World Wide Web. The interface also
indirectly provided the means to transform data types into various formats
using the extensive function libraries that accompany a PHP installation
(such as image creation and manipulation, data encryption for sensitive
information, and XML creation for structured document interchange through
the World Wide Web). Using a combination of Datascope and PHP library
functions, an extensible tool-kit is being developed to allow data
managers to easily present their products on the World Wide Web. The
tool-kit has been modeled after the pre-existing ARTS architecture to
simplify the installation, development and ease-of-use for both the
seasoned researcher and the casual user. The methodology and results
of building the applications that comprise the tool-kit are the focus
of this presentation, including procedural vs. object oriented design,
incorporation of the tool-kit into the existing contributed software
libraries, and case-studies of researchers who are employing the tools
to present their data.
|
VORBrouter: A dynamic data routing system for Real-Time Seismic networks
Hansen, T. S., Lindquist, K. G., Vernon, F. L., Orcutt, J. (2004)
Eos Transactions AGU, Fall Meet. Suppl. 85 (47) Abstract SF41A-0749
For anyone who has managed a moderately complex buffered real-time
data transport system, the need for reliable adaptive data transport
is clear. The ROADNet VORBrouter system, an extension to the ROADNet
data catalog system [AGU-2003, Dynamic Dataflow Topology Monitoring
for Real-time Seismic Networks], allows dynamic routing of real-time
seismic data from sensor to end-user. Traditional networks consist of
a series of data buffer computers with data transport interconnections
configured by hand. This allows for arbitrarily complex data networks,
which can often exceed full comprehension by network administrators,
sometimes resulting in data loops or accidental data cutoff. In order
to manage data transport systems in the event of a network failure, a
network administrator must be called upon to change the data transport
paths and to recover the missing data. Using VORBrouter, administrators
can sleep at night while still providing 7/24 uninterupted data streams at
realistic cost. This software package uses information from the ROADNet
data catalog system to route packets around failed link outages and to
new consumers in real-time. Dynamic data routing protocols operating
on top of the Antelope Data buffering layer allow authorized users to
request data sets from their local buffer and to have them delivered from
anywhere within the network of buffers. The VORBrouter software also
allows for dynamic routing around network outages, and the elimination
of duplicate data paths within the network, while maintaining the nearly
lossless data transport features exhibited by the underlying Antelope
system. We present the design of the VORBrouter system, its features,
limitations and some future research directions.
|
Web-based Data Mining to Systematically Determine Data Quality From the EarthScope USArray Seismic Observatory Project
Newman, R. L., Lindquist, K. G., Hansen, T. S., Vernon, F. L., Eakins, J., Foley, S. (2004)
Eos Transactions AGU, Fall Meet. Suppl. 85 (47) Abstract NG43A-0435
When fully operational, the Transportable Array (TA) and Flexible
Array (FA) components of the continent-scale EarthScope USArray seismic
observatory project will provide telemetered real-time data from up to 600
stations. By the fifth year of the deployment the predicted total amount
of data production for the TA and FA will be approximately 1500 Gb/yr
and approximately 1000 Gb/yr respectively. In addition to delivering the
data to the IRIS Data Management Center (DMC) for permanent archiving,
the Array Network Facility (ANF) is charged with real-time data quality
control, calibration, metadata storage and retrieval, network monitoring
and local archiving. The Antelope real-time processing software provides
the back-bone to this effort, supported by the Storage Resource Broker
data replication/archiving system and the Nagios network monitoring
tool. Real-time, web-based data mining, with support for multiple
database schemas, is provided by an Antelope interface to both Perl and
PHP scripting languages. This allows embedding of database functions
in HTML. A suite of online tools allows query and graphical display
of dynamic real-time sensor network parameters such as data latency,
network topologies, and data return rates. Data and metadata are also
web-accessible, for example XML trees of seismic data and graphical
display of instrument response functions. The purpose of these tools is
to provide the ANF, IRIS and end-users of USArray data with a real-time
systematic method of determining data quality for the spatio-temporal
area of interest. The tools are accessible at http://anf.ucsd.edu
|
High resolution visualization of USArray data on a 50 megapixel display using OptIPuter technologies
Nayak, A. M., Vernon, F. L., Kent, G., Orcutt, J., Kilb, D., Newman, R. L., Smarr, L., DeFanti, T., Leigh, J., Renambot, L., Johnson, A. (2004)
Eos Transactions AGU, Fall Meet. Suppl. 85 (47) Abstract SF13A-0713
A 50 megapixel display wall is under construction at the Cecil H. &
Ida M. Green Institute of Geophysics and Planetary Physics (IGPP)
for the display of multiple interactive 3D visualizations of various
geophysical datasets. This system is designed through collaboration
between major NSF funded projects such as OptIPuter and USArray
(EarthScope), and will allow researchers to visually analyze data and
present results at extremely high resolution. The OptIPuter project
(www.optiputer.net) leverages the capabilities of dedicated optical
networks that interconnect instruments, processors, computer storage and
visualization resources to aid in Earth Sciences research. This system
comprises a cluster of seven Apple Power Mac G5 machines and twelve
Apple 30" LCD screens (of maximum resolution 2560 x 1600 each) tiled to
form a 4x3 array and will be the first Apple-driven tiled display to our
knowledge. The Antelope software will be used for seismic data monitoring
and archiving along with web-based analytical tools developed at the Array
Network Facility (ANF http://anf.ucsd.edu/) at IGPP. OptIPuter software
(developed by the Electronic Visualization Laboratory) such as JuxtaView
(an image viewer for interacting with remotely located extremely high
resolution 2D images) and Vol-a-Tile (interactive volume rendering
software allowing navigation into gigabyte-sized seismic volumes)
will also be used. Interactive visualizations created by scientists
at IGPP that overlay heterogeneous datasets such as seismic profiles,
geology strata, earthquake locations, bathymetry and high resolution
satellite imagery and aerial photos, using the Fledermaus software will
also be viewed. The configuration of each cluster node is: dual CPU 2.5
GHz PowerPC G5, 8 GB RAM, 500 GB disk space, NVIDIA Ultra 6800 GeForce
card, and the nodes are interconnected over gigabit Ethernet. This
system will also be part of the OptIPuter infrastructure, with fiber
connections to the OptIPuter CAVEwave on the National Lambda Rail. The
design of the system is based on the Geowall-2 class of displays
(http://www.geowall.org) and the OptIPuter Visualization Cluster at
Scripps (http://www.siovizcenter.ucsd.edu/optiputer/index.html).
|
USArray Array Network Facility (ANF): Metadata, Network and Data Monitoring, and Quality Assurance During the First Year of Operations
Eakins, J., Vernon, F. L., Martynov, V., Newman, R. L., Foley, S. (2004)
Eos Transactions AGU, Fall Meet. Suppl. 85 (47) Abstract S53B-0210
The deployment of Transportable Array stations for the EarthScope USArray
project has begun and will ramp up to 400 real-time telemetered stations
over the next four years. The role of the Array Network Facility (ANF)
in the USArray project is to guarantee delivery of all Transportable
Array stations (400) and telemetered Flexible Array stations (200)
to the IRIS Data Management Center, ensure proper calibration and
metadata are always up to date, and provide quality control for all
data. In support of these goals, we use the Antelope software package
to facilitate data collection and transfer, generation and merging of
the metadata, monitoring of dataloggers, generation of noise spectra,
and analyst review of individual events. The SRB, and a newly developed
Antelope/SRB interface, is used for off-site backup of the data. A
freeware package, Nagios, adapted to include Antelope plug-ins, as
well as newly developed in-house tools allow network and data flow
monitoring. Quality control checks include: daily review by an analyst
to look for obvious discrepancies in channel polarization or change
in noise characteristics; associations made against regional network
and global bulletins to help spot timing errors; spectral noise plots;
and daily reports of outages and data gaps.
|