1. Eight times acceleration of geospatial data archiving and distribution on the grids
- Author
-
Wang, Frank Z., Helian, Na, Wu, Sining, Guo, Yike, Deng, Derek Yuhui, Meng, Lingkui, Zhang, Wen, Crowncroft, Jon, Bacon, Jean, and Parker, Michael Andrew
- Subjects
Computer network protocols -- Research ,Geospatial imaging -- Methods ,Electronic data processing -- Methods ,Protocol ,Business ,Earth sciences ,Electronics and electrical industries - Abstract
A grid-powered Web Geographical Information Science (GIS)/Web Processing Service (WPS) system has been developed for archiving and distributing large volumes of geospatial data. However, users, WPS servers, and data resources are always distributed across different locations, attempting to access and archive geospatial data from a GIS survey via conventional Hypertext Transport Protocol, Network File System Protocol, and File Transfer Protocol, which often encounters long waits and frustration in wide area network (WAN) environments. To provide a 'local-like' performance, a WAN/grid-optimized protocol known as 'Grid Jet' developed at our lab was used as the underlying engine between WPS servers and clients, which utilizes a wide range of technologies including the one of paralleling the remote file access. No change in the way of using software is required since the multistreamed Grid Jet protocol remains fully compatible with the existing IP infrastructures. Our recent progress includes a real-world test that PyWPS and Google Earth over the Grid Jet protocol beat those over the classic ones by a factor of two to eight, where the distribution/archiving distance is over 10 000 km. Index Terms--Bulk data transfer, data archiving, geodata set, grid computing, Web Processing Service (WPS).
- Published
- 2009