NM Climate Center Operational Overview
Introduction
The New Mexico Climate Center (NMCC) uses a small set of server computers to collect, store, and display climate data. Data is collected over the Internet and through analog phone connections to weather stations deployed around New Mexico. There are currently three servers in use by the NMCC: Weather, Nmcc, and Virga. Refer to Figure 1 for a visual representation of the data collection network maintained by NMCC.
Figure 1.
Internet Data Collection
Refer to Figure 2 for an expanded view of the Internet data network from which Weather collects data. With the exception of the Meteorological Assimilation Data Ingest System (MADIS) Hyper-text Transfer Protocol (HTTP) server, Weather collects data for only one weather station network from each server. The Middle Rio Grande Conservancy District (MRGCD) data is gathered from the MRGCD File Transfer Protocol (FTP) server, National Resources Conservation Service SNOTEL data is collected from the SNOTEL FTP server, Los Alamos National Labs (LANL) Tower data is collected from the LANL HTTP server, and Remote Automated Weather Station (RAWS) data is gathered from the RAWS HTTP server. Data from the National Weather Service (NWS) automated stations, Union Pacific Railroad (UPR) network, and the Citizen Weather Observer Program (CWOP) are collected from the MADIS HTTP server. Data from some weather stations are directly accessed via the Internet, using software applications such as Loggernet.
Figure 2.
Phone Network Collection
Weather collects data directly from many weather stations using a standard phone network. The phone connected weather stations belong to the following networks: NMCC Network, Dr. Salim Bawazir's Elephant Butte Irrigation District (EBID) network, and the NMSU Viticulture network (WINE). Miscellaneous weather stations include the Farmington NAPI station, NMSU and Albuquerque golf course stations. These weather stations use either a standard analog phone line connection or a cellular connection. A hardware modem is directly connected to Weather, via the RS-232 serial port, and this modem is connected to an analog phone line in the NMCC office. At a given time, Loggernet, installed on Weather, will call each station individually and request the station's data be transmitted via the phone connection to Weather. Refer to Figure 3 for a representation of this collection network.
Figure 3.
Internet Connected Weather Stations
There are several Internet connected weather stations, where data is collected by the climate center. Refer to Figure 4 for a representation of these stations. Leyendecker PSRC II and Carlsbad SWCD are accessible via Loggernet, using the IP address of the stations' network equipment. La Chiripada Vineyard is a special case whereby station data is sent to the climate center's office email address every day. La Chiripada's data currently requires human interaction for the download of its data.
Figure 4.
Nmcc Server
Nmcc collects and serves only NM Community, Collaborative, Rain, Hail and Snow data. The climate data Weather collects is available to Nmcc for copying, however, there is currently no need for that functionality. See Figure 5 for a representation of the data network used by Nmcc.
Figure 5.
Virga Server
Virga functions as a copy of Weather, so it uses the data collected by Weather to populate its database. The only exception is LANL Tower data, where both Weather and Virga download the data concurrently. Because the LANL Tower data is available only in 15 minute increments, both servers download the data to insure that, if one server goes down, the other server will be able to get the data. Refer to Figure 6 to view the data collection network for Weather.
Figure 6.
Served Data
After all data has been downloaded by the servers, Weather runs a processing application to interpolate any missing or skewed values. The processed data is made available and the raw data is also made available, via HTTP. LANL Tower data is only available in raw form and no processing is performed on that data set. Nmcc makes available the NM CoCoRaHS data and station information immediately after download with no processing necessary. The schedule for downloading and processing the data is discussed in another document. Refer to Figure 7.
Figure 7.
Conclusion
This concludes the operational overview for the NMCC office. By no means is this a static system, and will have to be updated regularly as operations change. However, this system has worked for many years without too many problems. Please refer to more specific documentation detailing the several aspects of the NMCC computer systems.