Search

Video question answering (VideoQA) is a complex task that requires diverse multi-modal data for training. Manual annotation of question and answers for videos, however, is tedious and prohibits scalability. To tackle this problem, recent methods consider zero-shot settings with no manual annotation of visual question-answer. In particular, a promising approach adapts frozen autoregressive language models pretrained on Web-scale text-only data to multi-modal inputs. In contrast, we here build on frozen bidirectional language models (BiLM) and show that such an approach provides a stronger and cheaper alternative for zero-shot VideoQA. In particular, (i) we combine visual inputs with the frozen BiLM using light trainable modules, (ii) we train such modules using Web-scraped multi-modal data, and finally (iii) we perform zero-shot VideoQA inference through masked language modeling, where the masked text is the answer to a given question. Our proposed approach, FrozenBiLM, outperforms the state of the art in zero-shot VideoQA by a significant margin on a variety of datasets, including LSMDC-FiB, iVQA, MSRVTT-QA, MSVD-QA, ActivityNet-QA, TGIF-FrameQA, How2QA and TVQA. It also demonstrates competitive performance in the few-shot and fully-supervised setting. Our code and models are publicly available at https://github.com/antoyang/FrozenBiLM., NeurIPS 2022 Camera-Ready; Project Webpage: https://antoyang.github.io/frozenbilm.html; 25 pages; 5 figures

International audience; This paper examines spatial variations in the geomorphology of the Ninety East Ridge (NER), located in the Indian Ocean. The NER is an extraordinary long linear bathymetric feature with topography reflecting complex geophysical setting and geologic evolution. The research is based on a compilation of high-resolution bathymetric, geological, and gravity datasets clipped for the study area extent (65° - 107°E, 35°S - 21°N): General Bathymetric Chart of the Oceans (GEBCO), Earth Gravitational Model (EGM2008, EGM96). The submarine geomorphology of the NER was modeled by digitized cross-sectional profiles using Generic Mapping Tools (GMT). The availability of the method is explained by 1) the free datasets; 2) the open source GMT toolset; 3) the available tutorials of the GMT and the codes explained in this work. Three segments of the NER were selected, digitized, and modeled: 1) northern 89°E, 7°S to 90°E, 7°N; 2) central 88.4°E, 14.7°S to 88.8°E, 8.2°S; 3) southern 87.9°E, 17°S to 87.5°E, 27°S. Measured depths were visualized in graphs, compared, and statistically analyzed by the histograms. The northern segment has a steepness of 21.3° at the western slopes, and 14.5° at the eastern slope. The slopes on the eastern flank have dominant SE orientation. The central segment has a bell-shaped form, with the highest steepness comparing to the northern and southern segments. The eastern flank has a steepness of 49.5°. A local depression at a distance of 50 km off from the axis (90°E) continues parallel to the NER, with the shape of the narrow minor trench. The western slope has a steepness of 57.6°, decreasing to 15.6°. The southern segment has a dome-like shape form. Compared to the northern and central segments, it has a less pronounced ridge crest, with a steepness of 24.9° on the west. The eastern flank has a steepness of 36.8° until 70 km, gradually becoming steeper at 44.23°. A local minor trench structure can be seen on its eastern flank (100 km off the axis). This corresponds to the very narrow long topographic depressions stretching parallel to this segment of the NER at 90.5°E. The study contributes to regional geographic studies of Indian Ocean geomorphology and cartographic presentation of GMT functionality for marine research and oceanographic studies.

Vegetation of Cameroon includes a variety of landscape types with high biodiversity. Ecological monitoring of Yaoundé requires visualization of vegetation types in context of climate change. Vegetation Indices (VIs) derived from Sentinel-2 multispectral satellite image were analyzed in SAGA GIS to separate wetland biomes, as well as savannah and tropical rainforests. The methodology includes computing 6 VIs: NDVI, DVI, SAVI, RVI, TTVI, CTVI. The VIs shown correlation of data with vegetation distribution rising from wetlands, grassland, savanna, and shrub land towards tropical rainforests, increasing values along with canopy greenness, while also being inversely proportional to soils, urban spaces and Sanaga River. The study contributed to the environmental studies of Cameroon and demonstration of the satellite image processing.

The study presents an analysis of the sediment thickness compared with bathymetric and geophysical settings in the Bay of Bengal and Andaman Sea, Indian Ocean. It uses a combination of the high-resolution data: topographic GEBCO, satellite and marine gravity anomalies, EGM2008 geoid and GlobSed to visualize the correlation between relief, gravity and trends in continent-ocean sediment transport. The results include thematic maps and 3D model showing increased sediment thickness in the Bengal Fan (8,0 to 8,2 km) in NE direction with maximum in Ganges Fan (16,2 km), and southward decrease in the Andaman Sea from Irrawaddy river mouth (6-7 km) to the Strait of Malacca (1-2 km). All maps and 3D model have been plotted by Generic Mapping Tools (GMT) cartographic scripting toolset version 6.0.0.

The main purpose of this article is to present the use of R programming language in cartographic visualization demonstrating using machine learning methods in geographic education. Current trends in education technologies are largely influenced by the possibilities of distance-learning, e-learning and self- learning. In view of this, the main tendencies in modern geographic education include active use of open source GIS and publicly available free geospatial datasets that can be used by students for cartographic exercises, data visualization and mapping, both at intermediate and advanced levels. This paper contributes to the development of these methods and is fully based on the datasets and tools available for every student: the R programming language and the free open source datasets. The case study demonstrated in this paper show the examples of both physical geographic mapping (geomorphology) and socio-economic geography (regional mapping) which can be used in the classes and in self-learning. The objective of this research includes geomorphological modelling of the terrain relief in Italy and regional mapping. The data include DEM SRTM90 and datasets on regional borders of Italy embedded in R packages ‘maps’ and ‘mapdata’. Modelling references to the characteristics of slope, aspect, hillshade and elevation, their visualization using R packages: ‘raster’ and ‘tmap’. Regional mapping of Italy was made using main package ‘ggmap’ with the ‘ggplot2’ as a wrapper. The results present five thematic maps (slope, aspect, hillshade, elevation and regions of Italy) created in R language. Traditionally used in statistical analysis, R is less known as a perfect tool in geographic education. This paper contributes to the development of methods in geographic education by presenting new technologies of the machine learning methods of mapping.

International audience; Detailed mapping based on the high-resolution grids, such as GEBCO, ETOPO1, GlobSed, EGM-2008 is crucial for various domains of Earth sciences: geophysics, glaciology, Quaternary, sedimentology, geology, environmental science, geomorphology, etc. The study presented a GMTbased scripting technique of the cartographic data processing aimed at the comparative analysis of the bathymetry, sediment thickness, geologic objects and geophysical settings in the study area based on various datasets. The study area is located in the Ross Sea, Antarctic. The highest values of the sediment thickness over 7,500 m are dominating in the southwest segment of the Ross Sea closer to the Victoria Land, followed by the region over the Ross Ice Shelf with values between 5,500 to 7,000 m (170°-175°W). The increased sediment thickness (2,500 to 3,000 m) was also mapped seen in the region NE off the Sulzberger Bay (70-75°S to 140-155°W), caused by the closeness of the Marie Bird Land ice coasts. A remarkable correlation between the gravity and the topography of the sea-land border in the Marie Bird Land area is well reflected in the coastal line and a set of the higher values in the free-air gravity. On the contrary, negative values (-60 to-80 mGal) are notable along the submarine troughs stretching parallel in the western part of the basin: e.g. the trough stretching in NW-SE direction in the 170°W-175°E, 65°S-68°S, between the 167°W-175°W, 70°S-72°S. Such correlations are clearly visible on the map, indicating geological lineaments and bathymetric depressions correlating with gravity grids. The paper contributes to the regional studies of the Ross Sea, the Antarctic and Polar region, and development of the technical cartographic methodologies by presenting an application of the GMT for thematic mapping.; O mapeamento detalhado com base em grades de alta resolução, como GEBCO, ETOPO1, GlobSed, EGM-2008 é fundamental para vários campos das ciências da terra: geofísica, glaciologia, quaternário, sedimentologia, geologia, ciências ambientais, geomorfologia, etc. O estudo apresenta métodos de processamento de dados de mapas com script baseado em GMT visando a análise comparativa de batimetria, espessura de sedimentos, características geológicas e condições geofísicas na área de estudo com base em vários conjuntos de dados. A Área de Estudo está localizada no Mar de Ross, na Antártica. Os valores mais altos de espessura de sedimento de mais de 7.500 m prevalecem no sudoeste do Mar de Ross próximo a Victoria Land, seguido pela área acima da plataforma de gelo de Ross em valores entre 5.500 e 7.000 m (170 ° -175 ° W). ... O aumento da espessura do sedimento (de 2.500 a 3.000 m) também foi mapeado na área nordeste da Baía Sulzberger (de 70-75 ° S a 140-155 ° W), devido à proximidade das costas de gelo da Terra Marie Bird. A notável correlação entre a gravidade e a topografia da fronteira marítima perto da Terra Marie Bird é bem refletida na linha costeira e em muitos dos maiores valores de gravidade ao ar livre. Em contraste, os valores negativos (-60 a -80 mGal) são perceptíveis ao longo das muralhas submarinas que se estendem paralelamente na parte oeste da bacia: por exemplo, uma trincheira que se estende na direção noroeste-sudeste a 170 ° W-175 ° E, 65 ° S-68 ° S, entre 167 ° W-175 ° W, 70 ° S-72 ° S Essas correlações são claramente visíveis no mapa, indicando lineamentos geológicos e depressões batimétricas correlacionadas com grades gravimétricas. O documento contribui para estudos regionais do Mar de Ross, Antártica e região polar, bem como para o desenvolvimento de metodologias técnicas de mapeamento, introduzindo a aplicação GMT para mapeamento temático.

International audience; Detailed mapping based on the high-resolution grids, such as GEBCO, ETOPO1, GlobSed, EGM-2008 is crucial for various domains of Earth sciences: geophysics, glaciology, Quaternary, sedimentology, geology, environmental science, geomorphology, etc. The study presented a GMTbased scripting technique of the cartographic data processing aimed at the comparative analysis of the bathymetry, sediment thickness, geologic objects and geophysical settings in the study area based on various datasets. The study area is located in the Ross Sea, Antarctic. The highest values of the sediment thickness over 7,500 m are dominating in the southwest segment of the Ross Sea closer to the Victoria Land, followed by the region over the Ross Ice Shelf with values between 5,500 to 7,000 m (170°-175°W). The increased sediment thickness (2,500 to 3,000 m) was also mapped seen in the region NE off the Sulzberger Bay (70-75°S to 140-155°W), caused by the closeness of the Marie Bird Land ice coasts. A remarkable correlation between the gravity and the topography of the sea-land border in the Marie Bird Land area is well reflected in the coastal line and a set of the higher values in the free-air gravity. On the contrary, negative values (-60 to-80 mGal) are notable along the submarine troughs stretching parallel in the western part of the basin: e.g. the trough stretching in NW-SE direction in the 170°W-175°E, 65°S-68°S, between the 167°W-175°W, 70°S-72°S. Such correlations are clearly visible on the map, indicating geological lineaments and bathymetric depressions correlating with gravity grids. The paper contributes to the regional studies of the Ross Sea, the Antarctic and Polar region, and development of the technical cartographic methodologies by presenting an application of the GMT for thematic mapping.; O mapeamento detalhado com base em grades de alta resolução, como GEBCO, ETOPO1, GlobSed, EGM-2008 é fundamental para vários campos das ciências da terra: geofísica, glaciologia, quaternário, sedimentologia, geologia, ciências ambientais, geomorfologia, etc. O estudo apresenta métodos de processamento de dados de mapas com script baseado em GMT visando a análise comparativa de batimetria, espessura de sedimentos, características geológicas e condições geofísicas na área de estudo com base em vários conjuntos de dados. A Área de Estudo está localizada no Mar de Ross, na Antártica. Os valores mais altos de espessura de sedimento de mais de 7.500 m prevalecem no sudoeste do Mar de Ross próximo a Victoria Land, seguido pela área acima da plataforma de gelo de Ross em valores entre 5.500 e 7.000 m (170 ° -175 ° W). ... O aumento da espessura do sedimento (de 2.500 a 3.000 m) também foi mapeado na área nordeste da Baía Sulzberger (de 70-75 ° S a 140-155 ° W), devido à proximidade das costas de gelo da Terra Marie Bird. A notável correlação entre a gravidade e a topografia da fronteira marítima perto da Terra Marie Bird é bem refletida na linha costeira e em muitos dos maiores valores de gravidade ao ar livre. Em contraste, os valores negativos (-60 a -80 mGal) são perceptíveis ao longo das muralhas submarinas que se estendem paralelamente na parte oeste da bacia: por exemplo, uma trincheira que se estende na direção noroeste-sudeste a 170 ° W-175 ° E, 65 ° S-68 ° S, entre 167 ° W-175 ° W, 70 ° S-72 ° S Essas correlações são claramente visíveis no mapa, indicando lineamentos geológicos e depressões batimétricas correlacionadas com grades gravimétricas. O documento contribui para estudos regionais do Mar de Ross, Antártica e região polar, bem como para o desenvolvimento de metodologias técnicas de mapeamento, introduzindo a aplicação GMT para mapeamento temático.

International audience; The paper discusses the geomorphology of the Sunda Trench, an oceanic trench located in the eastern Indian Ocean along the Sumatra and Java Islands of the Indonesian archipelago. It analysis difference in depths and variation in slope steepness between the two segments of the trench: southern Java transect (108.8°E 10.10°S - 113.0°E 10.75°S) and northern Sumatra transect (97.5°E 1.1°S - 101.0°E 5.5°S). The maps and geomorphological modelling were plotted using Generic Mapping Tools (GMT). The data include high-resolution grids on topography, geology, geodesy and geophysics: GEBCO, EGM2008 EGM-2008, GlobSed. The results include modelled segments, slope gradients, and cross-section profiles. The geological processes take place in the Indian Ocean at different stages of its evolution and influence the nature of the submarine geomorphology and geomorphology of the trench that differs in two segments. Java segment has a bell- shaped data distribution in contrast to the Sumatra with bimodal pattern. Java segment has the most repetitive depths at -2,500 to -5,200 m. Sumatra transect has two peaks: 1) a classic bell-shaped peak (-4,500 m to -5,500 m); 2) shelf area (0 to -1,750 m). The data at middle depths (-1,750 to -4,500 m) have less than 300 samples. The most frequent bathymetry for the Sumatra segment corresponds to the -4,750 m to -5,000 m. Comparing to the Sumatra segment, the Java segment is deeper. For depths > -6,000 m, there are only 138 samples for Sumatra while 547 samples for Java. Furthermore, Java segment has a more symmetrical geometric shape while Sumatra segment is asymmetric, one-sided. The Sumatra segment has a steepness of 57.86° on its eastern side (facing Sumatra Island) and a contrasting 14.58° on the western part. The Java segment has a steepness of 64.34° on its northern side (facing Java Island) and 24.95° on the southern part (facing the Indian Ocean). The paper contributes to the studies of the submarine geomorphology in Indonesia.; Резиме: У раду су детаљно анализиране геоморфолошке карактеристике Сундског рова, који се пружа дуж острва Суматра и Јава у оквиру индонежанског архипелага, у источном делу Индијског океана. Познато је да је геоморфологија океанских ровова настала као резултат субдукције тектонских плоча током сложене геолошке еволуције. Упркос покушајима да се детаљно проучи његова геодинамика, природа и структура рова још увек нису довољно јасни. Конкретно, геоморфолошке карактеристике рова, формиране кроз сложене интеракције геофизичких, геолошких и тектонских фактора, у фокусу су многих истраживања. Сврха овог рада је да истражи разлике у геоморфолошким карактеристикама два различита сегмента Сундског рова (јужни део дуж острва Јава и северни део дуж острва Суматра) како би се олакшало боље разумевање структуре морског дна у североисточном делу Индијског океана. Методолошки приступ овог рада заснован је на употреби GMT, односно универзалних картографских инструмената, који су примењени у циљу конструисања графичких прилога. У овом квалитативном и квантитативном истраживању израђено је осам карата и обављен је преглед бројне литературе о истраживаном подручју.Јужни, јавански сегмент рова простире се дуж линије са следећим координа- тама (почетна и крајња тачка): 108,8°Е 10,10°S - 113,0°Е 10,75°S. Северни, суматрански сегмент лоциран је дуж линије са следећим координатама (почетна и крајња тачка) 97,5°Е 1,1°S - 101,0°Е 5,5°S. Подаци укључују растерску координатну мрежу високе резолуције о топографији, геологији, геодезији и геофизици: GEBCO, EGM2008EGM-2008, GlobSed. Представљено је и визуализовано неколико тематских карата са циљем демонстрирања просторне варијације у дистрибуцији геофизичких поља на проучаваном подручју. Карте посебно илуструју геолошке процесе који су се одвијали у источном делу Индијског океана у различитим фазама његове еволуције, а које су утицале на изглед подморске геоморфологије рова. Попречни профили су дигитализовани помоћу приступа машинског учења којег нуди GMT. Упоредна анализа оба сегмента извршена je визуелизацијом података у виду хистограма. Резултати истраживања показују да је геоморфологија рова зависна од локалних геолошких, геофизичких и тектонских карактеристика. Конкретно, јавански сегмент има дистрибуцију дубина у "облику звона", за разлику од суматранског са бимодалном дистрибуцијом. У сегменту Јаве најчешће је распрострањен појас дубина између -2.500 и -5.200 m. Сегмент Суматре има два јасно видљива врха: 1) врх у облику звона (-4.500 m до -5.500 m); 2) подручје шелфа (0 до -1.750 m). У поређењу са сегментом Суматре (северни), сегмент Јаве (јужни) је дубљи. На пример, за дубине преко -6.000 m постоји само 138 узорака за сегмент22Суматре, док постоји 547 узорака за сегмент Јаве. Даље, јавански сегмент има симетричан геометријски облик, док је сегмент Суматре углавном асиметричан. Сегмент Суматре има нагиб од 57,86° на источној страни (страна окренута према острву Суматра) и 14,58° на западној страни. Сегмент Јаве има нагиб од 64,34° на северној страни (страна окренута према острву Јава) и 24,95° у јужном делу (према Индијском океану).Значај картографске визуелизације је добро познат, јер тачно представљање података помаже да се изврши корелација и укаже на разлике у дистрибуцији геолошких и географских објеката, процеса и појава. Најчешће, традиционални GIS софтвери преовлађују у картографским истраживањима. Овај рад указује на ефикасну функционалност софтвера GMT за визуализацију геофизичких и геолошких података и за проучавање геоморфолошких карактеристика. Нејасност и неразумевање геолошких и геодинамичких процеса често проистиче из недостатка картографске визуализације која покрива одређено истраживачко подручје у правилној пројекцији и палети боја. Да би се повећала ефикасност у анализи података, представљене карте конструисане су у три различите пројекције: поликонусној, меркаторовој и азимутној пројекцији Ламберта, док су попречни профили урађени са декартовим xy координатама. Значај овог рада састоји се у мултидисциплинарном приступу који комбинује савремена картографска представ- љања података и геолошку анализу индонежанског региона. Резултати ове студије показују да су коришћење картографских метода за обраду геоинформација драгоцено средство за даља геофизичка и геоморфолошка моделовања и помоћ у бољем разумевању морског дна, јединствене скривене структуре Земљине површи- не.

International audience; Present study is focused on the satellite image processing by means of SAGA GIS. The objective of the study is assessment and analysis of the core urban areas and its spatial distribution in the limits of the city and suburbs. The study area includes Yaoundé and its surroundings, Republic of Cameroon. The methodology includes Object Based Image Segmentation (OBIS) approach by SAGA GIS. The paper presents a methodologically structured workflow used in SAGA GIS for segmentation of the Sentinel-2A image. The segmentation techniques includes adjusting technical parameters, performing neighborhood approach and post-processing procedures (unsupervised classification, number of clusters). The OBIS model and SAGA GIS were used as main methods and machine learning techniques for image segmentation. Data include Sentinel-2A satellite image with high resolution (10 m). The image was analyzed by two approaches of cell neighborhood analysis: Moore and Neumann. The results showed following numerical parameters of the computed area: the perimeter of 1,060,560 km and an area estimated for the Yaoundé city 191,745,000 km 2. The Neumann approach demonstrated better results for image clustering. The results presented automatically detected and separated segments of the city areas and other land cover types (savannah, forests, mountains). The spectral reflectance of various land cover types on a satellite image enables to group pixels of the image into classes using segmentation technique which has an important impact on the conceptual methodology of the urban mapping. The results of the image segmentation show the average values of the Neumann approach more correct in urban area than Moore approach. The accuracy assessment demonstrated 74.63% for the core urban area by using the Neumann method. The applicability of SAGA GIS for automated methods of image processing using machine learning algorithm of OBIS is presented and the advantages are discussed. The study demonstrated the effectiveness of the high-resolution Sentinel-2A for socioeconomic studies, exemplified by urban mapping where remote sensing data serve as reliable sources of geoinformation. The advantages of the OBIS are discussed with detailed explanation of the SAGA GIS workflow.

International audience; Insights on the Indian Ocean Tectonics and Geophysics Supported by GMT. This paper presented analyzed and summarized data on geological and geophysical settings about the tectonics and geological structure of the seafloor of the Indian Ocean by thematic visualization of the topographic, geophysical and geological data. The seafloor topography of the Indian Ocean is very complex which includes underwater hills, isolated mountains, underwater canyons, abyssal and accumulative plains, trenches. Complex geological settings explain seismic activity, repetitive earthquakes, and tsunami. Understanding and prognosis of the disastrous and catastrophic geological events is strongly based on correct data analysis, modelling and visualization. An important feature of this paper is mapping multi-source high-resolution data by GMT. Data include raster grids in NetCDF and GRD formats: ETOPO1, geologic and marine free-air gravity data, EGM96, age, spreading rates, and spreading asymmetry of the ocean crust by NOAA, total sediment thickness. Data were visualized by GMT modules to compare and analyze geophysical and geological settings of the Indian Ocean. Visualization revealed correlations between high bathymetric variations of the oceanic seafloor, distribution of main geological seafloor fabric: Southwest, Southeast, Mid and Carlsberg ridges. Tectonic maps were plotted to perform comparative analysis of several variables: crust age, spreading half rates (mm/yr), asymmetries in crustal accretion on conjugate ridge flanks (%), variations in the geopotential and gravimetric models. Being the warmest of the world's ocean, Indian Ocean has specific climatic conditions (repetitive monsoons, tsunamis, cyclones and storms), complex geologic seafloor structure with triple junction and unique geographic settings. Presented paper contributed to the regional studies of the Indian Ocean.

International audience; This paper concerns the Caribbean Sea submarine geomorphology and bathymetry and especially the Puerto Rico Trench and the Cayman Trough, using thematic mapping, geomorphological modelling and statistical analysis. The technical tools include Generic Mapping Tools (GMT) cartographic scripting toolset. The data include GEBCO digital bathymetric model in grid format, geopotential model of the Earth's gravity field EGM2008, marine free-air Faye gravity anomalies from a combined GEOS3/SEASAT/GEOSAT altimeter data set, sediment thickness from the GlobSed 5-arc-minute grid model and vector layers of GMT (coastlines, river network, borders). The cross-sectioning was done by the "grdtrack" module. Differences between the form of the Puerto Rico Trench and Cayman Trough presumably result from different structure and geological evolution. The geomorphology of the segment of the Puerto Rico Trench (67.5°W and 19.90°N to 64.1°W and 19.82°N) has a gentle curvature of the slope in plane (about 13° slope steepness). The slopes are steeper in the northern part (about 32°) but higher on the continental slope. The profiles of the Puerto Rico Trench are asymmetric due to the tectonic factors. The seabed of the Cayman Trough is fl at at the segment (80.0°W and 17.7°N to 78.5°W and 19.5°N). Its profile is asymmetric: northern part is steep (about 57°), southern part is about 16°. A very large negative Faye free-air gravity anomaly (up to-380 mGal) is seen in the Puerto Rico Trench, south of Cuba as well as in the northeastern part of the Cayman Trough. The tectonic plate subduction in the Lesser Antilles, Central America and seafloor spreading is reflected in the morphostructure in the Cayman Trough and Puerto Rico Trench. Modeled cross-sectioning profiles show differences both for the Trench and Trough. In contrast with the Puerto Rico Trench with distinct density peak (680 samples for depths-5,200 to-5,400 m), the Cayman Trough has a bimodal data distribution: two peaks correspond to the two intervals: 1)-3,250 m to-1,000 m; and 2)-5,250 to-3,500. The paper contributes to Caribbean Sea geological studies by using GMT for geomorphological modelling.; W artykule opisano badania wybranych elementów rzeźby dna Morza Karaibskiego na tle budowy geologicznej, tektoniki oraz wybranych właściwości pola geofizycznego wpływające- go na powstawanie rowów głębinowych. Analizę batymetrii wzdłuż Rowu Puerto Rico i Rowu Kajmańskiego wykonano z wykorzystaniem mapowania tematycznego, modelowania geomorfo- logicznego i analizy statystycznej. Wykorzystano zestaw narzędzi do tworzenia skryptów karto- graficznych w środowisku Generic Mapping Tools (GMT). Dane obejmują numeryczny model batymetryczny o strukturze GRID z bazy GEBCO, globalny model geopotencjału EGM2008, anomalie grawitacyjne z uwzględnieniem redukcji wolnopowietrznej (redukcja Faye’a) z połą- czonego zestawu danych altymetrycznych z misji GEOS3/SEASAT/GEOSAT, numeryczny model miąższości osadów o strukturze GRID i rozdzielczości 5 minut z programu GlobSed oraz warstwy wektorowe w formacie GMT (linie brzegowe, sieć rzeczna, granice). Przekrój został wykonany z wykorzystaniem modułu „grdtrack”. Wyniki pokazały różnice między strukturą Rowu Puerto Rico i Rowu Kajmańskiego, na które wpływ miała ewolucja geologiczna. Średnie nachylenie zbo- czy rowu Puerto Rico (67,5°W i 19,90°N do 64,1°W i 19,82°N) wynosi 13°. W części północnej zbocza są bardziej strome (32,09°), ale wyższe na zboczu kontynentalnym. Profile Rowu Puerto Rico są asymetryczne dla obu boków z powodu uskoków i ruchów tektonicznych płyty karaibskiej i płyty północnoamerykańskiej. Dno morskie Rowu Kajmańskiego jest płaskie w tym segmencie (80,0°W i 17,70°N do 78,5°W i 19,50°N). Jego profil jest asymetryczny: północna część jest stro- ma (57°), a południowa jest bardziej łagodna (16°). Bardzo duże ujemne anomalie grawitacyjne Faye’a na wolnym powietrzu (do –380 mGal) widoczne są w Rowie Puerto Rico, na południe od Kuby oraz w północno-wschodniej części Rowu Kajmańskiego. Subdukcja płyt tektonicznych w Małych Antylach, Ameryce Środkowej i na dnie morskim, obejmująca nieckę kajmańską, ko- reluje ze zmianami falowania geoidy wywołanymi właściwościami skał powodujących anomalie grawitacyjne. Analiza warunków topograficznych na przekroju podłużnym ujawnia różnice dla Rowu i niecki. W przeciwieństwie do Rowu Puerto Rico z wyraźnym pikiem gęstości (680 pró- bek dla głębokości od –5200 do –5400 m), Rów Kajmański ma bimodalny rozkład danych: dwa szczyty odpowiadają dwóm interwałom: 1) od –3250 m do –1000 m; 2) od –5250 m do –3500 m. Wnioski zawarte w artykule mogą przyczynić się do badań geologicznych Morza Karaibskiego z technicznym zastosowaniem GMT do modelowania geomorfologicznego.

This research focuses on the 2D and 3D geospatial analysis of the Ryukyu Trench, a deep-sea trench located in the western Pacific Ocean between Japan and Taiwan. The aim of the research is to visualize regional differences in the topography of the southern (S) and northern (N) parts of the trench. Technically, the methodology is based on using the Generic Mapping Tools (GMT) scripting toolset, for modelling the General Bathymetric Chart of the Oceans (GEBCO), and Earth Topography and Bathymetry dataset (ETOPO1) raster grids. The results demonstrated topographic differences in the two segments. The most frequent depths lie between −5,000 and −6,000 m. The N part has steeper gradient slopes and deeper bathymetry. Of the depth differences >−6,000 m, S has nine values with depths >−6,800 m while N shows 123 records (max −7,460 m). The submarine terraces of S have gentler slopes compared with the N segment. The technical approach presents GMT-based 2D and 3D cartographic modelling aimed at visualizing regional variations of the seafloor topography.

The paper presents a comparison of the two languages Python and R related to the classification tools and demonstrates the differences in their syntax and graphical output. It indicates the functionality of R and Python packages {dendextend} and scipy.cluster as effective tools for the dendrogram modelling by the algorithms of sorting and ranking datasets. R and Python programming languages have been tested on a sample dataset including marine geological measurements. The work aims to detect how bathymetric data change along the 25 bathymetric profiles digitized across the Mariana Trench. The methodology includes performed hierarchical cluster analysis with dendrograms and plotted clustermap with marginal dendrograms. The statistical libraries include Matplotlib, SciPy, NumPy, Pandas by Python and {dendextend}, {pvclust}, {magrittr} by R. The dendrograms were compared by the model-simulated clusters of the bathymetric ranges. The results show three distinct groups of the profiles sorted by the elevation ranges with maximal depths detected in a group of profiles 19-21. The dendrogram visualization in a cluster analysis demonstrates the effective representation of the data sorting, grouping and classifying by the machine learning algorithms. The programming codes presented in this study enable to sort a dataset in a similar research aimed to group data based on the similarity of attributes. Effective visualization by dendrograms is a useful modelling tool for the geospatial management where data ranking is required. Plotting dendrograms by R, comparing to Python, presented functional and sophisticated algorithms, refined design control and fine graphical data output. The interdisciplinary nature of this work consists in application of the coding algorithms for spatial data analysis.

International audience; Current research presents study of the hydrological characteristics in the surroundings of the Laguna de Gallocanta (Spain) using remote sensing methods and combination of two GIS: ArcGIS and Idrisi GIS. The methodology includes following workflow: 1) selection of the multi-temporal Landsat images and creating color composites; 2) Masking and overlaying study area out of the whole image; 3) Calculation of the direction and length of stream flow in the lake basin; 4) assessment of possible risks of floods and stability of coastal slopes. The research has aim of hydrological assessment testing GIS tools for environmental monitoring. The images are presented by Landsat ETM+, MSS and TM scenes acquired on years 1976, 1987, 1992 and 2000, respectively, with a cloud cover of 0%. The images were georeferenced in ArcGIS and rectified to the Grid Coordinate System using available vector layers. The georeferenced rectified image was then re-projected to the UTM projection WGS84 datum. The combinations of various bands (channels 2-1-4, 5-4-7, and 2-4-7) were tested and visualized. Second step included processing DEM (Digital Elevation Model) Data acquired by the SRTM providing high quality elevation data. The pre-processing included mosaicing images and cutting out study area. The hydrologically conditioning the DEM was performed: the elevations are modified in order to model flow directions. Modelling flow direction and flow accumulation was performed on the conditioned DEM using ArcGIS. The next step included extracting hydrologic features such as stream directions, length and basin extents from a DEM. The pit removal tool was used to remove error pits from a DEM. Final step included calculations of the flow direction and flow length that demonstrate the direction of flow out of each cell. Finally, using Basin function all cells belonging to the watersheds of one or more target cells were calculated. The results shown that area has sensitive hydrological settings which explains its prone to the environmental change. The research demonstrated successful use of GIS for the purposes of hydrological modeling in the environmental studies.

We introduce a simple expression for the map of Asplund's distances with the multiplicative Logarithmic Image Processing (LIP) law. It is a difference between a morphological dilation and a morphological erosion with an additive structuring function which corresponds to a morphological gradient., Accepted to the 12th European Congress for Stereology and Image Analysis 2017, Kaiserslautern, Germany, September 11-14, 2017

We establish the link between Mathematical Morphology and the map of Asplund's distances between a probe and a grey scale function, using the Logarithmic Image Processing scalar multiplication. We demonstrate that the map is the logarithm of the ratio between a dilation and an erosion of the function by a structuring function: the probe. The dilations and erosions are mappings from the lattice of the images into the lattice of the positive functions. Using a flat structuring element, the expression of the map of Asplund's distances can be simplified with a dilation and an erosion of the image; these mappings stays in the lattice of the images. We illustrate our approach by an example of pattern matching with a non-flat structuring function., Comment: The final publication is available at link.springer.com

The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-319-52277-7_5; International audience; Asplünd 's metric, which is useful for pattern matching, consists in a double-sided probing, i.e. the over-graph and the sub-graph of a function are probed jointly. This paper extends the Asplünd 's metric we previously defined for colour and multivariate images using a marginal approach (i.e. component by component) to the first spatio-colour Asplünd 's metric based on the vectorial colour LIP model (LIPC). LIPC is a non-linear model with operations between colour images which are consistent with the human visual system. The defined colour metric is insensitive to lighting variations and a variant which is robust to noise is used for colour pattern matching.

We address the problem of automatically learning the main steps to complete a certain task, such as changing a car tire, from a set of narrated instruction videos. The contributions of this paper are three-fold. First, we develop a new unsupervised learning approach that takes advantage of the complementary nature of the input video and the associated narration. The method solves two clustering problems, one in text and one in video, applied one after each other and linked by joint constraints to obtain a single coherent sequence of steps in both modalities. Second, we collect and annotate a new challenging dataset of real-world instruction videos from the Internet. The dataset contains about 800,000 frames for five different tasks that include complex interactions between people and objects, and are captured in a variety of indoor and outdoor settings. Third, we experimentally demonstrate that the proposed method can automatically discover, in an unsupervised manner, the main steps to achieve the task and locate the steps in the input videos., Comment: Appears in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016). 21 pages

International audience; We present two algorithms that extend existing HMM parameter adaptation algorithms (MAP and MLLR) by adapting the HMM structure. This improvement relies on a smart combination of MAP and MLLR with a structure optimization procedure. Our algorithms are semi-supervised: to adapt a given HMM model on new data, they require little labeled data for parameter adaptation and a moderate amount of unlabeled data to estimate the criteria used for HMM structure optimization. Structure optimization is based on state splitting and state merging operations and proceeds so as to optimize either the likelihood or a heuristic criterion. Our algorithms are successfully applied to the recognition of printed characters by adapting the HMM character models of a polyfont printed text recognizer to new fonts. Our experiments involve a total of 1,120,000 real and 3,100,000 synthetic character images and concern a set of 89 HMM models. A comparison of our results with those of state-of-the-art adaptation algorithms (MAP and MLLR) shows a significant increase in the accuracy of character recognition.

Presented work illustrates application of the GIS based processing of various geographic data: satellite images and CORINE (Coordination of Information on the Environment) layers at the lessons of geography in the high schools and universities. The research illustrates GIS application for understanding, visualizing and modeling landscapes of the Earth. Practically, the work aims to demonstrate students, how mapping land cover types can be done using GIS and combination of vector and raster geospatial data., P. Lemenkova. "Opportunities for Classes of Geography in the High School: the Use of CORINE Project Data, Satellite Images and IDRISI GIS for Geovisualization". In: Perspectives for the Development of Higher Education. Proceedings of 7th International Conference (Grodno State Agrarian University GGAU, Apr. 24–25, 2014). Ed. by V. Pestis et al. Belarus, Grodno: GGAU Press, 2014, pp. 284–286. isbn: 978-985-537-042-1. doi: 10.6084/m9.figshare.7211933.

Introduction. The study area encompasses selected regions of the Brussels municipality, Belgium. In the past years the city of Brussels is experiencing intensification of the density of building structures. Unlike in some other European cities, where the most evident problem is urbanization and expansion of the city margins to the suburbia, the urban structure Brussels is the intensification of the buildings density in the city centre and the existing dwelling districts. Thus, the city structure tends to become more intense and dense, due to the process of filling the empty spaces in the urban patterns and high level housing. Another example of urban processes in Brussels is reorganisation of the industrial areas. At the same time, monitoring vegetation areas is essential for environmental sustainability of the capital city. The lack of the green spaces may cause ecological instability and increase atmospheric pollution. For studies of the specific problems of the Brussels city the remote sensing data (raster image) was used together with NDVI function, in order to detect areas covered by city parks. Methods and ResultsStep I. The panchromatic image was loaded into project and processed.Step II. The image was segmented using the principle of Multiresolution Segmentation. This operation consists in the splitting of an image into segments in order to simplify complexity of the whole initial image. It is performed by the machine embedded logic based on mathematic algorithms and simplifying models. The general rule divides the area into regions according to the principle “neighbour pixels have similar parameters” (spectral reflectance value, texture, form, shape).Step III. All vegetation coverage has been detected and separated from other objects (impervious structures) using natural characteristics of the vegetation spectral reflectance. For this, first the arithmetic expression for Normalized Difference Vegetation Index (NDVI) was created in eCognition operators using formula for spectral reflectance in visible (VIS) and near infrared (NIR) bands. This enables to detect pixels of vegetation: NDVI=(NIR-VIS)/(NIR+VIS). After this operation was created, it was added to the conditions of objects processing.Step IV. After this, the operation of extraction of vegetation was performed. The logical condition for vegetation detection is that we assign all objects which have values of NDVI more than 0.3 to vegetation. This is based on the properties of vegetation: dense tree canopy usually have positive values of NDVI (0.3 to 0.8). On the contrary, other objects, which do not belong to vegetation, have low NDVI values. For example, water bodies have low reflectance in both spectral bands (band 3 and band 4). Therefore, they have very low positive and sometimes slightly negative NDVI values (depending on local hydro-chemical conditions, depth, etc). Bare soils usually also have small positive NDVI values (0.1 to 0.2), since their spectral reflectance in near-infrared bands is larger than in red ones. So, using this knowledge, the NDVI formula was applied, and green areas within the city of Brussels were distinguished. The objects with NDVI values more than 0.3 were assigned to the “vegetation” class.Conclusions. The urban landscapes have complex environmental and socio-economic function and serve as habitat and agricultural surface in the surroundings. Land cover studies supported by satellite image contribute to the development of urban management system. Using object-oriented approach together with GIS techniques applied to remote sensing data enables to perform geospatial analysis with focus on urban landscapes.

MIRRH, held in conjunction with ACM MM 2013.; International audience; We herein present a hierarchical model-based framework for event recognition using multiple sensors. Event models combine a priori knowledge of the scene (3D geometric and semantic information, such as contextual zones and equipments) with moving objects (e.g., a Person) detected by a monitoring system. The event models follow a generic ontology based on natural language; which allows domain experts to easily adapt them. The framework novelty relies on combining multiple sensors (heterogeneous and homogeneous) at decision level explicitly or implicitly by handling their conflict using a probabilistic approach. The implicit event conflict handling works by computing the event reliabilities for each sensor, and then combine them using Dempster-Shafer Theory. The multi-sensor system is evaluated using multi-modal recording of instrumental daily living activities (e.g., watching TV, writing a check, preparing tea, organizing the week intake of prescribed medication) of participants of a clinical study of Alzheimer's disease. The evaluation presents the preliminary results of this approach on two cases: the combination of events from heterogeneous sensors (a RGB camera and a wearable inertial sensor); and the combination of conflicting events from video cameras with a partially overlapped field of view (a RGB- and a RGB-D-camera). The results show the framework improves the event recognition rate in both cases.

International audience; We study the relations between the ac- tivity of corticomotoneuronal (CM) cells and the forces exerted by fingers. The activity of CM cells, located in the primary motor cortex is recorded in the thumb and index fingers area of a monkey. The activity of the fingers is recorded as they press two levers. The main idea of this work is to establish and use a collection of neuronal states. At any time, the neuronal state is defined by the firing rates of the recorded neurons. We assume that any such neuronal state is related to a typical variation (or absence of variation) in the muscular effort. Our forecasting model uses a linear combination of the firing rates, some synchrony information between spike trains and averaged variations of the positions of the levers.

National audience; This paper presents a complete processing chain for decoding intracranial data recorded in the cortex of a monkey and replicates the associated movements on a JACO robotic arm by Kinova. We developed specific modules inside the OpenViBE platform in order to build a Brain-Machine Interface able to read the data, compute the position of the robotic finger and send this position to the robotic arm. More pre- cisely, two client/server protocols have been tested to transfer the finger positions: VRPN and a light protocol based on TCP/IP sockets. According to the requested finger position, the server calls the associ- ated functions of an API by Kinova to move the fin- gers properly. Finally, we monitor the gap between the requested and actual fingers positions. This chain can be generalized to any movement of the arm or wrist.

We study a norm for structured sparsity which leads to sparse linear predictors whose supports are unions of prede ned overlapping groups of variables. We call the obtained formulation latent group Lasso, since it is based on applying the usual group Lasso penalty on a set of latent variables. A detailed analysis of the norm and its properties is presented and we characterize conditions under which the set of groups associated with latent variables are correctly identi ed. We motivate and discuss the delicate choice of weights associated to each group, and illustrate this approach on simulated data and on the problem of breast cancer prognosis from gene expression data.; Nous étudions une norme qui induit des prédicteurs linéaires structurés parcimonieux, dont les supports sont des unions d'un certain nombre de groupes de variables définis a priori et non nécessairement disjoints. L'approche proposée est baptisée Latent group Lasso, puisque dans son principe elle applique la régularisation du group Lasso sur des variables latentes. L'article présente un analyse détaillée de la norme et de ses propriétés et caractérise notamment les conditions pour lesquelles l'ensemble des groupes associés aux variables latentes est correctement estimé dans un problème de régression. Le choix difficile des poids associés à chaque groupe dans la définition de la norme est discuté. L'approche est enfin illustrée d'une part sur des données simulées et d'autre part par une application au problème du pronostic du cancer du sein à partir de données d'expression de gènes.

International audience; A new set of mathematical morphology (MM) operators adaptive to illumination changes caused by variation of exposure time or light intensity is defined thanks to the Logarithmic Image Processing (LIP) model. This model based on the physics of acquisition is consistent with human vision. The fundamental operators, the logarithmic-dilation and the logarithmic-erosion, are defined with the LIP-addition of a structuring function. The combination of these two adjunct operators gives morphological filters, namely the logarithmic-opening and closing, useful for pattern recognition. The mathematical relation existing between ``classical'' dilation and erosion and their logarithmic-versions is established facilitating their implementation. Results on simulated and real images show that logarithmic-MM is more efficient on low-contrasted information than ``classical'' MM.