Search

Semantic segmentation is a widespread image analysis task; in some applications, it requires such high accuracy that it still has to be done manually, taking a long time. Deep learning-based approaches can significantly reduce such times, but current automated solutions may produce results below expert standards. We propose agLab, an interactive tool for the rapid labelling and analysis of orthoimages that speeds up semantic segmentation. TagLab follows a human-centered artificial intelligence approach that, by integrating multiple degrees of automation, empowers human capabilities. We evaluated TagLab's efficiency in annotation time and accuracy through a user study based on a highly challenging task: the semantic segmentation of coral communities in marine ecology. In the assisted labelling of corals, TagLab increased the annotation speed by approximately 90% for nonexpert annotators while preserving the labelling accuracy. Furthermore, human-machine interaction has improved the accuracy of fully automatic predictions by about 7% on average and by 14% when the model generalizes poorly. Considering the experience done through the user study, TagLab has been improved, and preliminary investigations suggest a further significant reduction in annotation times.

Mesostructured patterns are a modern and efficient concept based on designing the geometry of structural material at the meso-scale to achieve desired mechanical performances. In the context of bending-active structures, such a concept can be used to control the flexibility of the panels forming a surface without changing the constituting material. These panels undergo a formation process of deformation by bending, and application of internal restraints. This paper describes a new constructional system, FlexMaps, that has initiated the adoption of bending-active mesostructures at the architectural scale. Here, these modules are in the form of four-arms spirals made of CNC-milled plywood and are designed to reach the desired target shape once assembled. All phases from the conceptual design to the fabrication are seamlessly linked within an automated workflow. To illustrate the potential of the system, the paper discusses the results of a demonstrator project entitled FlexMaps Pavilion (3.90x3.96x3.25 meters) that has been exhibited at the IASS Symposium in 2019 and more recently at the 2021 17th International Architecture Exhibition, La Biennale di Venezia. The structural response is investigated through a detailed structural analysis, and the long-term behavior is assessed through a photogrammetric survey.

Annotation support in interactive systems is often considered a simple task by the CG community, since it entails the apparently easy selection of a region and its connection with some information. The reality appears more complex. The scope of this paper is twofold: first, to review the status of this domain, discussing and characterizing several approaches proposed in literature to manage annotations over geometric models; second, to present in detail an innovative solution proposed and assessed in the framework of Cultural Heritage (CH) applications, called ClippingVolumes. At the annotation definition stage ClippingVolumes uses 3D data to characterize the annotation region; subsequently, annotations are visualized by adopting a two-pass rendering solution which uses stencil buffers, thus without introducing new geometric elements, changing the topology or duplicating geometry elements. It solves most of the issues that afflict the current state of the art, such as fragmentation, annotation transfer to multiple representations, and multi-resolution data encoding. The latter is a mandatory requirement to produce efficient web-based systems. We implemented and we fully tested this approach in the framework of a complex system that supports the documentation of CH restoration projects.

Reef-building coral taxa demonstrate considerable flexibility and diversity in reproduction and growth mechanisms. Corals take advantage of this flexibility to increase or decrease size through clonal expansion and loss of live tissue area (i.e. via reproduction and mortality of constituent polyps). The biological lability of reef-building corals may be expected to map onto varying patterns of demography across environmental contexts which can contribute to geographic variation in population dynamics. Here we explore the patterns of growth of two common coral taxa, corymbose Pocillopora and massive Porites, across seven islands in the central and south Pacific. The islands span a natural gradient of environmental conditions, including a range of pelagic primary production, a metric linked to the relative availability of inorganic nutrients and heterotrophic resources for mixotrophic corals, and sea surface temperature and thermal histories. Over a multi-year sampling interval, most coral colonies experienced positive growth (greater planar area of live tissue in second relative to first time point), though the distributions of growth varied across islands. Island-level median growth did not relate simply to estimated pelagic primary productivity or temperature. However, at locations that experienced an extreme warm-water event during the sampling interval, most Porites colonies experienced net losses of live tissue and nearly all Pocillopora colonies experienced complete mortality. While descriptive statistics of demographics offer valuable insights into trends and variability in colony change through time, simplified models predicting growth patterns based on summarized oceanographic metrics appear inadequate for robust demographic prediction. We propose that the complexity of life history strategies among colonial reef-building corals introduces unique demographic flexibility for colonies to respond to a wide breadth of environmental conditions.

Bending-active structures are able to efficiently produce complex curved shapes from flat panels. The desired deformation of the panels derives from the proper selection of their elastic properties. Optimized panels, called FlexMaps, are designed such that, once they are bent and assembled, the resulting static equilibrium configuration matches a desired input 3D shape. The FlexMaps elastic properties are controlled by locally varying spiraling geometric mesostructures, which are optimized in size and shape to match specific bending requests, namely the global curvature of the target shape. The design pipeline starts from a quad mesh representing the input 3D shape, which defines the edge size and the total amount of spirals: every quad will embed one spiral. Then, an optimization algorithm tunes the geometry of the spirals by using a simplified pre-computed rod model. This rod model is derived from a non-linear regression algorithm which approximates the non-linear behavior of solid FEM spiral models subject to hundreds of load combinations. This innovative pipeline has been applied to the project of a lightweight plywood pavilion named FlexMaps Pavilion, which is a single-layer piecewise twisted arch that fits a bounding box of 3.90x3.96x3.25 meters. This case study serves to test the applicability of this methodology at the architectural scale. The structure is validated via FE analyses and the fabrication of the full scale prototype.

Reflectance transformation imaging (RTI) is a computational photography technique widely used in the cultural heritage and material science domains to characterize relieved surfaces. It basically consists of capturing multiple images from a fixed viewpoint with varying lights. Handling the potentially huge amount of information stored in an RTI acquisition that consists typically of 50–100 RGB values per pixel, allowing data exchange, interactive visualization, and material analysis, is not easy. The solution used in practical applications consists of creating “relightable images” by approximating the pixel information with a function of the light direction, encoded with a small number of parameters. This encoding allows the estimation of images relighted from novel, arbitrary lights, with a quality that, however, is not always satisfactory. In this paper, we present NeuralRTI, a framework for pixel-based encoding and relighting of RTI data. Using a simple autoencoder architecture, we show that it is possible to obtain a highly compressed representation that better preserves the original information and provides increased quality of virtual images relighted from novel directions, especially in the case of challenging glossy materials. We also address the problem of validating the relight quality on different surfaces, proposing a specific benchmark, SynthRTI, including image collections synthetically created with physical-based rendering and featuring objects with different materials and geometric complexity. On this dataset and as well on a collection of real acquisitions performed on heterogeneous surfaces, we demonstrate the advantages of the proposed relightable image encoding.

Reef-building coral taxa demonstrate considerable flexibility and diversity in reproduction and growth mechanisms. Corals take advantage of this flexibility to increase or decrease size through clonal expansion and loss of live tissue area (i.e. via reproduction and mortality of constituent polyps). The biological lability of reef-building corals may be expected to map onto varying patterns of demography across environmental contexts which can contribute to geographic variation in population dynamics. Here we explore the patterns of growth of two common coral taxa, corymbose Pocillopora and massive Porites, across seven islands in the central and south Pacific. The islands span a natural gradient of environmental conditions, including a range of pelagic primary production, a metric linked to the relative availability of inorganic nutrients and heterotrophic resources for mixotrophic corals, and sea surface temperature and thermal histories. Over a multi-year sampling interval, most coral colonies experienced positive growth (greater planar area of live tissue in second relative to first time point), though the distributions of growth varied across islands. Island-level median growth did not relate simply to estimated pelagic primary productivity or temperature. However, at locations that experienced an extreme warm-water event during the sampling interval, most Porites colonies experienced net losses of live tissue and nearly all Pocillopora colonies experienced complete mortality. While descriptive statistics of demographics offer valuable insights into trends and variability in colony change through time, simplified models predicting growth patterns based on summarized oceanographic metrics appear inadequate for robust demographic prediction. We propose that the complexity of life history strategies among colonial reef-building corals introduces unique demographic flexibility for colonies to respond to a wide breadth of environmental conditions.

[EN] Digital technologies are now mature for producing high quality digital replicas of Cultural Heritage (CH) assets. The research results produced in the last decade ignitedan impressive evolution and consolidation of the technologies for acquiring high-quality digital three-dimensional (3D)models, encompassing both geometry and color. What remains still an open problem is how to deliver those data and related knowledge to our society. The web is nowadays the main channel for the dissemination of knowledge. Emerging commercial solutions for web-publishing of 3D data are consolidating and becoming a de-facto standard for many applications(e-commerce, industrial products, education, etc.).In this framework, CH is a very specific domain, requiring highly flexible solutions. Some recent experiences arepresented, aimed at providing a support to the archival of archaeological3Ddata, supporting web-based publishing of very high-resolution digitization results and finally enabling the documentation of complex restoration actions. All those examples have been recently implemented on the open-source 3D Heritage Online Presenter (3DHOP)platform, developed at CNR-ISTI, [ES] Las tecnologías digitales estánahora maduraspara producir réplicas digitales de alta calidad de valores activos del patrimonio cultural (CH). Los resultados de la investigación producidos en la última década han mostrado una evolución impresionante y una consolidación de las tecnologías para la capturade modelos digitales tridimensionales (3D)de alta calidad, que abarcanla geometríay el color.Lo que queda aún por resolver estárelacionado con la forma de distribuirlos datos y el conocimiento relacionado conla sociedad. La web es hoy en día el principal canal utilizado para divulgarel conocimiento. Las soluciones comerciales nuevas relacionadas con la publicación en la red de datos en 3D se están consolidando y convirtiendo en un estándar de facto para muchas aplicaciones(comercio electrónico, productos industriales, educación, etc.). En este escenario, el patrimonio culturales un dominio muy específico, que requiere soluciones muyflexibles.Se presentan algunas experiencias recientes, destinadasa proporcionar un apoyo al archivo de los datos arqueológicos3D, la publicaciónwebde los resultados de digitalización de muy alta resoluciónque permitenfinalmente la documentación de trabajos de restauracióncomplejos. Todos estos ejemplos se han implementado recientemente en la plataforma 3D Heritage Online Presenter(3DHOP)de código abierto, desarrolladaen el CNR-ISTI., The research leading to these results has received funding from the EU 7th Framework Programme (FP7/2007-2013) under grant agreement no. 654119 (EC "PARTHENOS" project) and EU H2020 Programme (“EMOTIVE: EMOTIve Virtual cultural Experiences through personalized storytelling”, H2020-SC6-CULT-COOP-08-2016) under grant agreement no. 727188.

International audience; In this paper, we present an online communication-driven decision support system to align terms from a dataset with terms of another dataset (standardized controlled vocabulary or not). Heterotoki differs from existing proposals in that it takes place at the interface with humans, inviting the experts to commit on their definitions, so as to either agree to validate the mapping or to propose some enrichment to the terminologies. More precisely, differently to most of existing proposals that support terminology alignment, Heterotoki sustains the negotiation of meaning thanks to semantic coordination support within its interface design. This negotiation involves domain experts having produced multiple datasets.

Close-Range Photogrammetry (CRP) and Reflectance Transformation Imaging (RTI) are two of the most used image-based techniques when documenting and analyzing Cultural Heritage (CH) objects. Nevertheless, their potential impact in supporting study and analysis of conservation status of CH assets is reduced as they remain mostly applied and analyzed separately. This is mostly because we miss easy-to-use tools for of a spatial registration of multimodal data and features for joint visualisation gaps. The aim of this paper is to describe a complete framework for an effective data fusion and to present a user friendly viewer enabling the joint visual analysis of 2D/3D data and RTI images. This contribution is framed by the on-going implementation of automatic multimodal registration (3D, 2D RGB and RTI) into a collaborative web platform (AIOLI) enabling the management of hybrid representations through an intuitive visualization framework and also supporting semantic enrichment through spatialized 2D/3D annotations.

In the last years, the development of compression algorithms for image collections (e.g., photo albums) has become very popular due to the enormous diffusion of digital photographs. Typically, current solutions create an image sequence from images of the photo album to make them suitable for compression using a High Performance Video Coding (HEVC) encoder. In this study, we investigated a different approach to compress a collection of similar images. Our main idea is to exploit the inter- and intra- patch redundancy to compress the entire set of images. In practice, our approach is equivalent to compress the image set with Vector Quantization (VQ) using a global codebook. Our tests show that our clusterization algorithm is effective for a large number of images.

Relightable images have been widely used as a valuable tool in Cultural Heritage (CH) artifacts, including coins, bas-reliefs, paintings, and epigraphs. Reflection Transformation Imaging (RTI), a commonly used type of relightable images, consists of a per-pixel function which encodes the reflection behavior, estimated from a set of digital photographs acquired from a fixed view. Web visualisation tools for RTI images currently require to transmit substantial quantities of data in order to achieve high fidelity renderings. We propose a web-friendly compact representation for RTI images based on a joint interpolation-compression scheme that combines a PCA-based data reduction with a Gaussian Radial Basis Function (RBF) interpolation exhibiting superior performance in terms of quality/size ratio. This approach can be adapted also to other data interpolation schemes, and it is not limited to Gaussian RBF. The rendering part is simple to implement and computationally efficient allowing real-time rendering on low-end devices.

We describe the Information System developed for the management of the life cycle of the Fontana del Nettuno in Bologna. This system adopts the 3D digital model as main interface for collecting, recording, archiving and retrieving data related to the monument. The paper describes the system features and reports some early evaluations and feedbacks received from the operators who used it during the ongoing restoration.

Il capitolo tratta della gestione delle informazioni e della comunicazione relativa al progetto di restauro della Fontana del Nettuno di Bologna. Il lavoro è la sintesi di quello svolto da più docenti, ricercatori, professionisti e studenti che, in un processo virtuoso, hanno approfondito tematiche differenti: · Il design di un sistema di comunicazione multimediale, con il fine la valorizzazione del progetto di restauro; · La progettazione e realizzazione del Sistema Informativo che ha accompagnato i lavori nel cantiere del Nettuno gestendo i dati generati dai professionisti coinvolti.​

Relightable images have demonstrated to be a valuable tool for the study and the analysis of coins, bas-relief, paintings, and epigraphy in the Cultural Heritage (CH) field. Reflection Transformation Imaging (RTI) are the most diffuse type of relightable images. An RTI image consists in a per-pixel function which encodes the reflection behavior, estimated from a set of digital photographs acquired from a fixed view. Even if web visualization tools for RTI images are available, high fidelity of the relighted images still requires a high amount of data to be transmitted. To overcome this limit, we propose a web-friendly compact representation for RTI images which allows very high quality of the rendered images with a relatively small amount of data required (in the order of 6-9 standard JPEG color images). The proposed approach is based on a joint interpolation-compression scheme that combines a PCA-based data reduction with a Gaussian Radial Basis Function (RBF) interpolation. We will see that the proposed approach can be adapted also to other data interpolation schemes, and it is not limited to Gaussian RBF. The proposed approach has been compared with several techniques, demonstrating its superior performance in terms of quality/size ratio. Additionally, the rendering part is simple to implement and very efficient in terms of computational cost. This allows real-time rendering also on low-end devices.

Restoration is becoming a quite complex process: a large number of internal and external variables co-exist and may impair it. Among these, the large number of professionals involved and the huge amount of documentation produced can heavily affect the quality of the intervention as well as the possibility to have systemic and informed interventions in the future. In particular, a standardized method for storing restoration data and accessing them is still lacking, and the use of new technologies is still limited and/or not scalable. The paper describes the process of designing and testing an information system (IS) based on three-dimensional (3D) data, aimed to support the restoration of Neptune's Fountain in Bologna. In preparation of the restoration, a major effort was carried out to design and implement a web-based IS able to host all of the data produced, to allow the conservation-restoration specialists to interact on-site with an accurate 3D representation of the elements of the fountain, and to directly reference all information and data produced on the geometry of the model. The paper focuses on the challenges and adopted solutions related to the use of 3D models and the data mapping on 3D surfaces in the context of restoration documentation. Highly detailed visualizations of the models, easy navigation, and usable functionalities to add information directly on the 3D model have been achieved by extending the available solutions and by implementing new mechanisms to overcome the limitations of WebGL and remote rendering. Neptune IS’ development has been extensively experimented in a real context of use. Results and knowledge from the experimentation currently represents the basis for evolving Neptune IS into a possible generic and flexible platform for documentation management in the field of restoration and related methodologies.

Efficient transmission of 3D data to Web clients and mobile applications remains a challenge due to limited bandwidth. Most of the research focus in the context of mesh compression has been on improving compression ratio. However, in this context the use of Javascript on the Web and low power CPUS in mobile applications led to critical computational costs. Progressive decoding improves the user experience by providing a simplified version of the model that refines with time, and it's able to mask latency. Current approaches do so at very poor compression rates or at additional computational cost. The need for better performing algorithms is especially evident with this class of methods where Limper [Limper et al. 2013b] demonstrated how decoding time becomes a limiting factor even at moderately low bandwidths. In this paper we present a novel multi-resolution WebGL based rendering algorithm which combines progressive loading, view-dependent resolution and mesh compression, providing high frame rates and a decoding speed of million of triangles per second in Javascript. This method is parallelizable, robust to non-manifold meshes, and scalable to very large models.

3D Heritage Online Presenter (3DHOP) is a framework for the creation of advanced web-based visual presentations of high-resolution 3D content. 3DHOP has been designed to cope with the specific needs of the Cultural Heritage (CH) field. By using multiresolution encoding, it is able to efficiently stream high-resolution 3D models (such as the sampled models usually employed in CH applications); it provides a series of ready-to-use templates and examples tailored for the presentation of CH artifacts; it interconnects the 3D visualization with the rest of the webpage DOM, making it possible to create integrated presentations schemes (3D + multimedia). In its design and development, we paid particular attention to three factors: easiness of use, smooth learning curve and performances. Thanks to its modular nature and a declarative-like setup, it is easy to learn, configure, and customize at different levels, depending on the programming skills of the user. This allows people with different background to always obtain the required power and flexibility from the framework. 3DHOP is written in JavaScript and it is based on the SpiderGL library, which employs the WebGL subset of HTML5, implementing plugin-free 3D rendering on many web browsers. In this paper we present the capabilities and characteristics of the 3DHOP framework, using different examples based on concrete projects.

This paper presents the mathematical and computational details which provide the bases of a new methodology for production analysis, void of the standard but empirically dubious assumptions of production theory, but able to assess the level and the evolution of intra-industry heterogeneity and to measure industry and firm-level productivity change. In particular, in this work, we show how geometry can be an effective tool to tackle some relevant issues in economics and how, with new computational methods, it is possible to switch from continuous models to discrete ones, the latter requiring a much smaller set of assumptions.