Search

The $S$-gap shifts have a dynamically and combinatorially rich structure. Dynamical properties of the $S$-gap shift can be related to the properties of the set $S$. This interplay is particularly interesting when $S$ is not syndetic such as when $S$ is the set of prime numbers or when $S=\{2^n\}$. It is a well known result that the entropy of the $S$-gap shift is given by $h(X) = \log \lambda$, where $\lambda>0$ is the unique solution to the equation $\sum_{n \in S} \lambda^{-(n+1)}=1$. Fix a point $w$ of the full shift $\{1,2, \dots, k\}^\mathbb{Z}$. We introduce the $(S,w)$-gap shift which is a generalization of the $S$-gap shift consisting of sequences in $\{0,1, \dots, k\}^\mathbb{Z}$ in which any two $0$'s are separated by a word $u$ appearing in $w$ such that $|u|\in S$. We extend the formula for the entropy of the $S$-gap shift to a formula describing the entropy of this new class of shift spaces. Additionally we investigate the dynamical properties including irreducibility and mixing of this generalization of the $S$-gap shift.

The SoccerNet 2024 challenges represent the fourth annual video understanding challenges organized by the SoccerNet team. These challenges aim to advance research across multiple themes in football, including broadcast video understanding, field understanding, and player understanding. This year, the challenges encompass four vision-based tasks. (1) Ball Action Spotting, focusing on precisely localizing when and which soccer actions related to the ball occur, (2) Dense Video Captioning, focusing on describing the broadcast with natural language and anchored timestamps, (3) Multi-View Foul Recognition, a novel task focusing on analyzing multiple viewpoints of a potential foul incident to classify whether a foul occurred and assess its severity, (4) Game State Reconstruction, another novel task focusing on reconstructing the game state from broadcast videos onto a 2D top-view map of the field. Detailed information about the tasks, challenges, and leaderboards can be found at https://www.soccer-net.org, with baselines and development kits available at https://github.com/SoccerNet., Comment: 7 pages, 1 figure

Occluded Person Re-Identification (ReID) is a metric learning task that involves matching occluded individuals based on their appearance. While many studies have tackled occlusions caused by objects, multi-person occlusions remain less explored. In this work, we identify and address a critical challenge overlooked by previous occluded ReID methods: the Multi-Person Ambiguity (MPA) arising when multiple individuals are visible in the same bounding box, making it impossible to determine the intended ReID target among the candidates. Inspired by recent work on prompting in vision, we introduce Keypoint Promptable ReID (KPR), a novel formulation of the ReID problem that explicitly complements the input bounding box with a set of semantic keypoints indicating the intended target. Since promptable re-identification is an unexplored paradigm, existing ReID datasets lack the pixel-level annotations necessary for prompting. To bridge this gap and foster further research on this topic, we introduce Occluded-PoseTrack ReID, a novel ReID dataset with keypoints labels, that features strong inter-person occlusions. Furthermore, we release custom keypoint labels for four popular ReID benchmarks. Experiments on person retrieval, but also on pose tracking, demonstrate that our method systematically surpasses previous state-of-the-art approaches on various occluded scenarios. Our code, dataset and annotations are available at https://github.com/VlSomers/keypoint_promptable_reidentification.

Tracking and identifying athletes on the pitch holds a central role in collecting essential insights from the game, such as estimating the total distance covered by players or understanding team tactics. This tracking and identification process is crucial for reconstructing the game state, defined by the athletes' positions and identities on a 2D top-view of the pitch, (i.e. a minimap). However, reconstructing the game state from videos captured by a single camera is challenging. It requires understanding the position of the athletes and the viewpoint of the camera to localize and identify players within the field. In this work, we formalize the task of Game State Reconstruction and introduce SoccerNet-GSR, a novel Game State Reconstruction dataset focusing on football videos. SoccerNet-GSR is composed of 200 video sequences of 30 seconds, annotated with 9.37 million line points for pitch localization and camera calibration, as well as over 2.36 million athlete positions on the pitch with their respective role, team, and jersey number. Furthermore, we introduce GS-HOTA, a novel metric to evaluate game state reconstruction methods. Finally, we propose and release an end-to-end baseline for game state reconstruction, bootstrapping the research on this task. Our experiments show that GSR is a challenging novel task, which opens the field for future research. Our dataset and codebase are publicly available at https://github.com/SoccerNet/sn-gamestate.

In recent years, machine learning has become crucial in remote sensing analysis, particularly in the domain of Land-use/Land-cover (LULC). The synergy of machine learning and satellite imagery analysis has demonstrated significant productivity in this field, as evidenced by several studies. A notable challenge within this area is the semantic segmentation mapping of land usage over extensive territories, where the accessibility of accurate land-use data and the reliability of ground truth land-use labels pose significant difficulties. For example, providing a detailed and accurate pixel-wise labeled dataset of the Flanders region, a first-level administrative division of Belgium, can be particularly insightful. Yet there is a notable lack of regulated, formalized datasets and workflows for such studies in many regions globally. This paper introduces a comprehensive approach to addressing these gaps. We present a densely labeled ground truth map of Flanders paired with Sentinel-2 satellite imagery. Our methodology includes a formalized dataset division and sampling method, utilizing the topographic map layout 'Kaartbladversnijdingen,' and a detailed semantic segmentation model training pipeline. Preliminary benchmarking results are also provided to demonstrate the efficacy of our approach.

High entropy alloys (HEAs) have attracted substantial interest in recent years. Thus far, most investigations have focused on their applications as structural materials rather than functional materials. In this paper, we show that FeMnNiAlCr HEAs can potentially be applied as both a structural and functional material for high-efficiency concentrated solar thermal power (CSP) systems working at >700 degrees C. The HEA itself would be used in high-temperature tubing to carry working fluids, while its surface oxide would act as a high-efficiency solar thermal absorber. These HEAs have demonstrated yield strengths 2-3x greater than that of stainless steel at 700 degrees C and a creep lifetime >800 h at 700 degrees C under a typical CSP tubing mechanical load of 35 MPa. Their Mn-rich surface oxides maintain a high optical-to-thermal conversion efficiency of ~87% under 1000x solar concentration for 20 simulated day-night thermal cycles between 750 degrees C and environmental temperature. These HEAs have also sustained immersion in unpurified bromide molten salts for 14 days at 750{\deg}C with <2% weight loss, in contrast to 70% weight loss from a 316 stainless steel reference. The simultaneous achievement of promising mechanical, optical, and thermochemical properties in this FeMnNiAlCr system opens the door to new applications of HEAs in solar energy harvesting.

The SoccerNet 2023 challenges were the third annual video understanding challenges organized by the SoccerNet team. For this third edition, the challenges were composed of seven vision-based tasks split into three main themes. The first theme, broadcast video understanding, is composed of three high-level tasks related to describing events occurring in the video broadcasts: (1) action spotting, focusing on retrieving all timestamps related to global actions in soccer, (2) ball action spotting, focusing on retrieving all timestamps related to the soccer ball change of state, and (3) dense video captioning, focusing on describing the broadcast with natural language and anchored timestamps. The second theme, field understanding, relates to the single task of (4) camera calibration, focusing on retrieving the intrinsic and extrinsic camera parameters from images. The third and last theme, player understanding, is composed of three low-level tasks related to extracting information about the players: (5) re-identification, focusing on retrieving the same players across multiple views, (6) multiple object tracking, focusing on tracking players and the ball through unedited video streams, and (7) jersey number recognition, focusing on recognizing the jersey number of players from tracklets. Compared to the previous editions of the SoccerNet challenges, tasks (2-3-7) are novel, including new annotations and data, task (4) was enhanced with more data and annotations, and task (6) now focuses on end-to-end approaches. More information on the tasks, challenges, and leaderboards are available on https://www.soccer-net.org. Baselines and development kits can be found on https://github.com/SoccerNet.

Many multi-agent systems require inter-agent communication to properly achieve their goal. By learning the communication protocol alongside the action protocol using multi-agent reinforcement learning techniques, the agents gain the flexibility to determine which information should be shared. However, when the number of agents increases we need to create an encoding of the information contained in these messages. In this paper, we investigate the effect of increasing the amount of information that should be contained in a message and increasing the number of agents. We evaluate these effects on two different message encoding methods, the mean message encoder and the attention message encoder. We perform our experiments on a matrix environment. Surprisingly, our results show that the mean message encoder consistently outperforms the attention message encoder. Therefore, we analyse the communication protocol used by the agents that use the mean message encoder and can conclude that the agents use a combination of an exponential and a logarithmic function in their communication policy to avoid the loss of important information after applying the mean message encoder., Comment: Paper accepted to the BNAIC/BeNeLearn 2022 conference

Researchers agree that for children who attend early care and education programs, high-quality early learning experiences are critical for promoting academic, social-emotional, and executive function skills, particularly for children of color and children from families with low incomes. Rigorous research testing the effects of interventions to enhance classroom quality has found that providing professional development to teachers, including ongoing training and coaching, can improve classroom quality and teachers' instructional practices as well as children's outcomes. These benefits are particularly noticeable when professional development is focused on a specific curriculum or set of teacher practices. Yet, again, questions remain. When and for which children do quality enhancement efforts have the most impact? When and for which early care and education centers and teachers can quality enhancement efforts be implemented successfully? Answering these questions will help the early care and education field target investments in ways that are more likely to support classroom quality and help all children succeed. The "Variations in Implementation of Quality Interventions (VIQI): Examining the Quality-Child Outcomes Relationship in Child Care and Early Education" project aims to tackle these open questions and build substantial new evidence to inform policies and practices in Head Start and community-based child care centers. The VIQI project is a large-scale, rigorous study that examines the link between classroom quality and preschool children's developmental outcomes. It builds on and extends prior research--including the "Child Care and Early Education Quality Features, Thresholds and Dosage and Child Outcomes (Q-DOT) project." This prior work suggests that when classroom quality is in the higher portion of the quality range, links between quality and children's outcomes are stronger than when classroom quality is in the lower portion of the quality range. This brief describes the VIQI project, its key research questions, and the conceptual framework underlying it.

Whole slide image (WSI) assessment is a challenging and crucial step in cancer diagnosis and treatment planning. WSIs require high magnifications to facilitate sub-cellular analysis. Precise annotations for patch- or even pixel-level classifications in the context of gigapixel WSIs are tedious to acquire and require domain experts. Coarse-grained labels, on the other hand, are easily accessible, which makes WSI classification an ideal use case for multiple instance learning (MIL). In our work, we propose a novel embedding-based Dual-Query MIL pipeline (DQ-MIL). We contribute to both the embedding and aggregation steps. Since all-purpose visual feature representations are not yet available, embedding models are currently limited in terms of generalizability. With our work, we explore the potential of dynamic meta-embedding based on cutting-edge self-supervised pre-trained models in the context of MIL. Moreover, we propose a new MIL architecture capable of combining MIL-attention with correlated self-attention. The Dual-Query Perceiver design of our approach allows us to leverage the concept of self-distillation and to combine the advantages of a small model in the context of a low data regime with the rich feature representation of a larger model. We demonstrate the superior performance of our approach on three histopathological datasets, where we show improvement of up to 10% over state-of-the-art approaches.

The level of maturity reached by robust control theory techniques nowadays contributes to a considerable minimization of the development time of an end-to-end control design of a spacecraft system. The advantage offered by this framework is twofold: all system uncertainties can be included from the very beginning of the design process; the validation and verification (V\&V) process is improved by fast detection of worst-case configurations that could escape to a classical sample-based Monte Carlo simulation campaign. Before proceeding to the control synthesis and analysis, a proper uncertain plant model has to be available in order to push these techniques to their limits of performance. In this spirit, the Satellite Dynamics Toolbox Library (SDTlib) offers many features to model a spacecraft system in a multi-body fashion on SIMULINK. Parametric models can be easily built in a Linear Fractional Transformation (LFT) form by including uncertainties and varying parameters with minimal number of repetitions. Uncertain Linear Time Invariant (LTI) and uncertain Linear Parameter-Varying (LPV) controllers can then be synthesized and analyzed in a straightforward way. The authors present in this article a tutorial, that can be downloaded at https://nextcloud.isae.fr/index.php/s/XDfRfHntejHTmmp, to show how to deal with an end-to-end robust design of a spacecraft mission and to provide to researchers a benchmark to test their own algorithms.

Spreading processes, e.g. epidemics, wildfires and rumors, are often modeled on static networks. However, their underlying network structures, e.g. changing contacts in social networks, different weather forecasts for wildfires, are due to ever-changing circumstances inherently time-varying in nature. In this paper, we therefore, propose an optimization framework for sparse resource allocation for control of spreading processes over temporal networks with known connectivity patterns. We use convex optimization, in particular exponential cone programming, and dynamic programming techniques to bound and minimize the risk of an undetected outbreak by allocating budgeted resources each time step. We demonstrate with misinformation, epidemic and wildfire examples how the method can provide targeted allocation of resources., Comment: Conference submission, 8 pages. arXiv admin note: text overlap with arXiv:2110.07755

The 1$^{\text{st}}$ Workshop on Maritime Computer Vision (MaCVi) 2023 focused on maritime computer vision for Unmanned Aerial Vehicles (UAV) and Unmanned Surface Vehicle (USV), and organized several subchallenges in this domain: (i) UAV-based Maritime Object Detection, (ii) UAV-based Maritime Object Tracking, (iii) USV-based Maritime Obstacle Segmentation and (iv) USV-based Maritime Obstacle Detection. The subchallenges were based on the SeaDronesSee and MODS benchmarks. This report summarizes the main findings of the individual subchallenges and introduces a new benchmark, called SeaDronesSee Object Detection v2, which extends the previous benchmark by including more classes and footage. We provide statistical and qualitative analyses, and assess trends in the best-performing methodologies of over 130 submissions. The methods are summarized in the appendix. The datasets, evaluation code and the leaderboard are publicly available at https://seadronessee.cs.uni-tuebingen.de/macvi., Comment: MaCVi 2023 was part of WACV 2023. This report (38 pages) discusses the competition as part of MaCVi

Occluded person re-identification (ReID) is a person retrieval task which aims at matching occluded person images with holistic ones. For addressing occluded ReID, part-based methods have been shown beneficial as they offer fine-grained information and are well suited to represent partially visible human bodies. However, training a part-based model is a challenging task for two reasons. Firstly, individual body part appearance is not as discriminative as global appearance (two distinct IDs might have the same local appearance), this means standard ReID training objectives using identity labels are not adapted to local feature learning. Secondly, ReID datasets are not provided with human topographical annotations. In this work, we propose BPBreID, a body part-based ReID model for solving the above issues. We first design two modules for predicting body part attention maps and producing body part-based features of the ReID target. We then propose GiLt, a novel training scheme for learning part-based representations that is robust to occlusions and non-discriminative local appearance. Extensive experiments on popular holistic and occluded datasets show the effectiveness of our proposed method, which outperforms state-of-the-art methods by 0.7% mAP and 5.6% rank-1 accuracy on the challenging Occluded-Duke dataset. Our code is available at https://github.com/VlSomers/bpbreid.

The SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team. In 2022, the challenges were composed of 6 vision-based tasks: (1) action spotting, focusing on retrieving action timestamps in long untrimmed videos, (2) replay grounding, focusing on retrieving the live moment of an action shown in a replay, (3) pitch localization, focusing on detecting line and goal part elements, (4) camera calibration, dedicated to retrieving the intrinsic and extrinsic camera parameters, (5) player re-identification, focusing on retrieving the same players across multiple views, and (6) multiple object tracking, focusing on tracking players and the ball through unedited video streams. Compared to last year's challenges, tasks (1-2) had their evaluation metrics redefined to consider tighter temporal accuracies, and tasks (3-6) were novel, including their underlying data and annotations. More information on the tasks, challenges and leaderboards are available on https://www.soccer-net.org. Baselines and development kits are available on https://github.com/SoccerNet., Comment: Accepted at ACM MMSports 2022

With the recent development of Deep Learning applied to Computer Vision, sport video understanding has gained a lot of attention, providing much richer information for both sport consumers and leagues. This paper introduces DeepSportradar-v1, a suite of computer vision tasks, datasets and benchmarks for automated sport understanding. The main purpose of this framework is to close the gap between academic research and real world settings. To this end, the datasets provide high-resolution raw images, camera parameters and high quality annotations. DeepSportradar currently supports four challenging tasks related to basketball: ball 3D localization, camera calibration, player instance segmentation and player re-identification. For each of the four tasks, a detailed description of the dataset, objective, performance metrics, and the proposed baseline method are provided. To encourage further research on advanced methods for sport understanding, a competition is organized as part of the MMSports workshop from the ACM Multimedia 2022 conference, where participants have to develop state-of-the-art methods to solve the above tasks. The four datasets, development kits and baselines are publicly available.

Technical debt denotes shortcuts taken during software development, mostly for the sake of expedience. When such shortcuts are admitted explicitly by developers (e.g., writing a TODO/Fixme comment), they are termed as Self-Admitted Technical Debt or SATD. There has been a fair amount of work studying SATD management in Open Source projects, but SATD in industry is relatively unexplored. At the same time, there is no work focusing on developers' perspectives towards SATD and its management. To address this, we conducted an exploratory case study in cooperation with an industrial partner to study how they think of SATD and how they manage it. Specifically, we collected data by identifying and characterizing SATD in different sources (issues, source code comments, and commits) and carried out a series of interviews with 12 software practitioners. The results show: 1) the core characteristics of SATD in industrial projects; 2) developers' attitudes towards identified SATD and statistics; 3) triggers for practitioners to introduce and repay SATD; 4) relations between SATD in different sources; 5) practices used to manage SATD; 6) challenges and tooling ideas for SATD management.

In 2010, Congress authorized the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) Program by enacting section 511 of the Social Security Act, 42 U.S.C. § 711, which also appropriated funding for fiscal years 2010 through 2014. Subsequently enacted laws extended funding for the program through fiscal year 2022. The program is administered by the Health Resources and Services Administration (HRSA) in collaboration with the Administration for Children and Families (ACF) within the U.S. Department of Health and Human Services (HHS). The initiation of the MIECHV Program began a major expansion of evidence-based home visiting programs for families living in at-risk communities. The legislation authorizing MIECHV recognized that there was considerable evidence about the effectiveness of home visiting, but also required an evaluation of MIECHV in its early years, which became the Mother and Infant Home Visiting Program Evaluation (MIHOPE). The overarching goal of MIHOPE is to learn whether families and children benefit from MIECHV-funded early childhood home visiting programs, and if so, how. ACF and HRSA were interested in ensuring that any additional follow-ups build on information from the earlier waves of data collection to the greatest extent possible, and that any proposed follow-up points build on one another. This long-term follow-up phase is called MIHOPE-LT. Following the introduction in Chapter 1, Chapter 2 presents results from the first follow-up with MIHOPE families, which occurred around the time children were 15 months of age. Chapter 3 summarizes evidence from existing long-term studies of the four MIHOPE home visiting models, on the effects of home visiting and benefit-cost analyses. Chapter 4 presents the research questions that MIHOPE-LT is designed to answer, the proposed timing of potential follow-up points, the sampling the study may use, and the data sources and outcome areas that may be examined. Chapter 5 describes the first MIHOPE-LT data collection effort, which began in January 2019 and is occurring approximately five years after women enrolled in MIHOPE, when their children are kindergarten age. This chapter describes plans for the kindergarten data collection effort, focusing on the constructs to be examined. The report concludes with Chapter 6, which highlights the contributions that MIHOPE-LT is expected to make to the research evidence on home visiting and discusses challenges the study could face in collecting data over many years as well as ways these challenges can be addressed. [This report was produced in partnership with Columbia University.]