Search

Existing Large Multimodal Models (LMMs) generally focus on only a few regions and languages. As LMMs continue to improve, it is increasingly important to ensure they understand cultural contexts, respect local sensitivities, and support low-resource languages, all while effectively integrating corresponding visual cues. In pursuit of culturally diverse global multimodal models, our proposed All Languages Matter Benchmark (ALM-bench) represents the largest and most comprehensive effort to date for evaluating LMMs across 100 languages. ALM-bench challenges existing models by testing their ability to understand and reason about culturally diverse images paired with text in various languages, including many low-resource languages traditionally underrepresented in LMM research. The benchmark offers a robust and nuanced evaluation framework featuring various question formats, including true/false, multiple choice, and open-ended questions, which are further divided into short and long-answer categories. ALM-bench design ensures a comprehensive assessment of a model's ability to handle varied levels of difficulty in visual and linguistic reasoning. To capture the rich tapestry of global cultures, ALM-bench carefully curates content from 13 distinct cultural aspects, ranging from traditions and rituals to famous personalities and celebrations. Through this, ALM-bench not only provides a rigorous testing ground for state-of-the-art open and closed-source LMMs but also highlights the importance of cultural and linguistic inclusivity, encouraging the development of models that can serve diverse global populations effectively. Our benchmark is publicly available., Comment: A Multilingual Multimodal cultural benchmark for 100 languages

We report on the onset of a coronal mass ejection (CME) using spectroscopic observations in 5303 {\AA} coronal emission line with the Visible Emission Line Coronagraph (VELC) onboard ADITYA-L1, the recently launched first Indian space solar mission. The CME was observed on 16 July 2024 in association with a X1.9 class soft X-ray flare from heliographic location S05W85. The VELC observations were near the west limb of Sun during the CME. The results obtained helped to constrain the onset time of the CME. In addition, they indicate ${\approx}$50% decrease in the coronal intensity near the source region of the CME due to mass depletion, ${\approx}$15% enhancement in the emission line width, and redshifted Doppler velocity of about ${\approx}10$ km/s. The non-thermal velocity associated with the line broadening is ${\approx}24.87$ km/s.

Enhancing and preserving the readability of document images, particularly historical ones, is crucial for effective document image analysis. Numerous models have been proposed for this task, including convolutional-based, transformer-based, and hybrid convolutional-transformer architectures. While hybrid models address the limitations of purely convolutional or transformer-based methods, they often suffer from issues like quadratic time complexity. In this work, we propose a Mamba-based architecture for document binarisation, which efficiently handles long sequences by scaling linearly and optimizing memory usage. Additionally, we introduce novel modifications to the skip connections by incorporating Difference of Gaussians (DoG) features, inspired by conventional signal processing techniques. These multiscale high-frequency features enable the model to produce high-quality, detailed outputs.

Affect and cognitive load influence many user behaviors. In this paper, we propose Motion as Emotion, a novel method that utilizes fine differences in hand motion to recognise affect and cognitive load in virtual reality (VR). We conducted a study with 22 participants who used common free-hand gesture interactions to carry out tasks of varying difficulty in VR environments. We find that the affect and cognitive load induced by tasks are associated with significant differences in gesture features such as speed, distance and hand tension. Standard support vector classification (SVC) models could accurately predict two levels (low, high) of valence, arousal and cognitive load from these features. Our results demonstrate the potential of Motion as Emotion as an accurate and reliable method of inferring user affect and cognitive load from free-hand gestures, without needing any additional wearable sensors or modifications to a standard VR headset.

The magnetic field strength and its topology play an important role in understanding the formation, evolution, and dynamics of the solar corona. Also, it plays a significant role in addressing long-standing mysteries such as coronal heating problem, origin and propagation of coronal mass ejections, drivers of space weather, origin and acceleration of solar wind, and so on. Despite having photospheric magnetograms for decades, we do not have reliable observations of coronal magnetic field strengths today. To measure the coronal magnetic field precisely, the spectropolarimetry channel of the Visible Emission Line Coronagraph (VELC) on board the Aditya-L1 mission is designed. Using the observations of coronal emission line Fe XIII [10747{\AA~}], it is possible to generate full Stokes maps (I, Q, U, and V) that help in estimating the Line-of-Sight (LOS) magnetic field strength and to derive the magnetic field topology maps of solar corona in the Field of View (FOV) (1.05 -- 1.5~R$_{\odot}$). In this article, we summarize the instrumental details of the spectropolarimetry channel and detailed calibration procedures adopted to derive the modulation and demodulation matrices. Furthermore, we have applied the derived demodulation matrices to the observed data in the laboratory and studied their performance., Comment: 12 pages, 5 Figures, Published in Journal of Experimental Astronomy

Emotion-Cause analysis has attracted the attention of researchers in recent years. However, most existing datasets are limited in size and number of emotion categories. They often focus on extracting parts of the document that contain the emotion cause and fail to provide more abstractive, generalizable root cause. To bridge this gap, we introduce a large-scale dataset of emotion causes, derived from 9.8 million cleaned tweets over 15 years. We describe our curation process, which includes a comprehensive pipeline for data gathering, cleaning, labeling, and validation, ensuring the dataset's reliability and richness. We extract emotion labels and provide abstractive summarization of the events causing emotions. The final dataset comprises over 700,000 tweets with corresponding emotion-cause pairs spanning 48 emotion classes, validated by human evaluators. The novelty of our dataset stems from its broad spectrum of emotion classes and the abstractive emotion cause that facilitates the development of an emotion-cause knowledge graph for nuanced reasoning. Our dataset will enable the design of emotion-aware systems that account for the diverse emotional responses of different people for the same event., Comment: Accepted to Findings of EMNLP 2023

Although the principal physical behaviour of a material is inherently connected to its fundamental crystal structure, the behaviours observed in the real-world are often driven by the microstructure, which for many polycrystalline materials, equates to the size and shape of the constituent crystal grains. Here we highlight a cutting edge synthesis route to the controlled engineering of grain structures in thin films and the simplification of associated 3-dimensional problems to less complex 2D ones. This has been applied to the actinide ceramic, uranium dioxide, to replicate structures typical in nuclear fission fuel pellets, in order to investigate the oxidation and subsequent transformation of cubic UO$_{2}$ to orthorhombic U$_{3}$O$_{8}$. This article shows how this synthesis approach could be utilised to investigate a range of phenomena, affected by grain morphology, and highlights some unusual results in the oxidation behaviour of UO$_{2}$, regarding the phase transition to U$_{3}$O$_{8}$., Comment: 21 pages, 3 figures

Aditya-L1 is the first Indian space mission to explore the Sun and solar atmosphere with seven multi-wavelength payloads, with Visible Emission Line Coronagraph (VELC) being the prime payload. It is an internally occulted coronagraph with four channels to image the Sun at 5000 \AA~ in the field of view 1.05 - 3 \rsun, and to pursue spectroscopy at 5303 \AA, 7892 \AA~ and 10747 \AA~ channels in the FOV (1.05 - 1.5 \rsun). In addition, spectropolarimetry is planned at 10747 \AA~ channel. Therefore, VELC has three sCMOS detectors and one InGaAs detector. In this article, we aim to describe the technical details and specifications of the detectors achieved by way of thermo-vacuum calibration at the CREST campus of the Indian Institute of Astrophysics, Bangalore, India. Furthermore, we report the estimated conversion gain, full-well capacity, and readout noise at different temperatures. Based on the numbers, it is thus concluded that it is essential to operate the sCMOS detectors and InGaAs detectors at $-5^{\circ}$ and $-17^{\circ}$ C, respectively, at the spacecraft level., Comment: Accepted for publication in Experimental Astronomy; 13 Pages, 5 Figures and 8 Tables

We present new 1.5-8.5 GHz Very Long Baseline Array (VLBA) observations and 0.32-1.26 GHz Giant Meterwave Radio Telescope (GMRT) observations of J0354-1340, which is the only known radio-quiet (RQ) or radio-intermediate (RI) narrow-line Seyfert 1 galaxy with a 100-kpc two-sided radio jet. A pc-scale one-sided jet in the southeast direction from the core emission is found in the VLBA observations, while the kpc-scale jet observed with Karl G. Jansky Very Large Array (VLA) and GMRT is in the south-north direction. The core spectra on pc and kpc scales are presented in combination with the archival VLASS observations at 3.0 GHz and the VLA C configuration observations at 5.5 GHz. The pc-scale emission dominates the kpc-scale emission above ~ 5 GHz, and the spectrum is inverted due to synchrotron self-absorption. This indicates a compact synchrotron source with a size of ~ 0.04 pc, which is associated with either the jet base or the corona. A sub-kpc scale jet, which is unresolved on scales of ~ 3 arcsec, probably dominates the emission below ~ 5 GHz. Future radio observations can explore the jet structure between the pc and 100 kpc scales, the origin of their direction mismatch, and the pc-scale jet proper motion. It remains to be explored how common such large-scale jets are in RQ or RI AGN., Comment: Accepted for publication in ApJ

Detector studies for future experiments rely on advanced software tools to estimate performance and optimize their design and technology choices. The Key4hep project provides a flexible turnkey solution for the full experiment life-cycle based on established community tools such as ROOT, Geant4, DD4hep, Gaudi, podio and spack. Members of the CEPC, CLIC, EIC, FCC, and ILC communities have joined to develop this framework and have merged, or are in the progress of merging, their respective software environments into the Key4hep stack. These proceedings will give an overview over the recent progress in the Key4hep project: covering the developments towards adaptation of state-of-the-art tools for simulation (DD4hep, Gaussino), track and calorimeter reconstruction (ACTS, CLUE), particle flow (PandoraPFA), analysis via RDataFrame, and visualization with Phoenix, as well as tools for testing and validation., Comment: Proceedings of CHEP 2023

This research introduces a sophisticated transfer learning model based on Google's MobileNetV2 for breast cancer tumor classification into normal, benign, and malignant categories, utilizing a dataset of 1576 ultrasound images (265 normal, 891 benign, 420 malignant). The model achieves an accuracy of 0.82, precision of 0.83, recall of 0.81, ROC-AUC of 0.94, PR-AUC of 0.88, and MCC of 0.74. It examines image intensity distributions and misclassification errors, offering improvements for future applications. Addressing dataset imbalances, the study ensures a generalizable model. This work, using a dataset from Baheya Hospital, Cairo, Egypt, compiled by Walid Al-Dhabyani et al., emphasizes MobileNetV2's potential in medical imaging, aiming to improve diagnostic precision in oncology. Additionally, the paper explores Streamlit-based deployment for real-time tumor classification, demonstrating MobileNetV2's applicability in medical imaging and setting a benchmark for future research in oncology diagnostics.

Sentiment analysis of social media data is an emerging field with vast applications in various domains. In this study, we developed a sentiment analysis model to analyze social media sentiment, especially tweets, during global conflicting scenarios. To establish our research experiment, we identified a recent global dispute incident on Twitter and collected around 31,000 filtered Tweets for several months to analyze human sentiment worldwide., Comment: 6 pages

Our work aims to investigate the polarisation convention of the Giant Metrewave Radio Telescope (GMRT) radio telescope and understand whether the telescope follows the standard IAU/IEEE convention. The GMRT antennas are prime focus antennas, i.e. the radiation falling on the antenna feed reverses its circular polarisation. If this reflection is not taken into account, it will result in a reversal of circular polarisation. We carried out several tests to understand the GMRT polarisation convention. The observations were carried out on several strong and highly polarised pulsars with known polarisation properties at GMRT wavelengths, mainly covering frequency bands 2, 3 and 4. In addition, we tracked the signal from the feed to the fibre optic system, and fibre optic system to the user end. We also tracked satellites of known polarisations as well as utilised right and left circularly polarised helical antennas to study the polarisation convention. Our study shows that the GMRT channels 1 and 2 are true R and L, however, GMRT being a prime focus instrument, the reflection due to the dish reverses the sense of polarisation and converts the right circular polarisation (RCP) into left circular polarisation (LCP) and vice versa. This has not been taken into account and thus the GMRT Stokes V and U signs need to be reversed to make them consistent with the IAU/IEEE convention. This objective can be achieved by reassigning channel 1 to L and channel 2 to R for all circular feeds, i.e. bands 2, 3, and 4. The study remains inconclusive for the GMRT band 5, which has linear feeds., Comment: NCRA-TIFR Internal Technical Report