Search

Divide and conquer algorithm is a common strategy applied in big data. Model averaging has the natural divide-and-conquer feature, but its theory has not been developed in big data scenarios. The goal of this paper is to fill this gap. We propose two divide-and-conquer- type model averaging estimators for linear models with distributed data. Under some regularity conditions, we show that the weights from Mallows model averaging criterion converge in L2 to the theoretically optimal weights minimizing the risk of the model averaging estimator. We also give the bounds of the in-sample and out-of-sample mean squared errors and prove the asymptotic optimality for the proposed model averaging estimators. Our conclusions hold even when the dimensions and the number of candidate models are divergent. Simulation results and a real airline data analysis illustrate that the proposed model averaging methods perform better than the commonly used model selection and model averaging methods in distributed data cases. Our approaches contribute to model averaging theory in distributed data and parallel computations, and can be applied in big data analysis to save time and reduce the computational burden. [ABSTRACT FROM AUTHOR]

This paper reflects on a number of trends towards a more open and reproducible approach to geographic and spatial data science over recent years. In particular, it considers trends towards Big Data, and the impacts this is having on spatial data analysis and modelling. It identifies a turn in academia towards coding as a core analytic tool, and away from proprietary software tools offering 'black boxes' where the internal workings of the analysis are not revealed. It is argued that this closed form software is problematic and considers a number of ways in which issues identified in spatial data analysis (such as the MAUP) could be overlooked when working with closed tools, leading to problems of interpretation and possibly inappropriate actions and policies based on these. In addition, this paper considers the role that reproducible and open spatial science may play in such an approach, taking into account the issues raised. It highlights the dangers of failing to account for the geographical properties of data, now that all data are spatial (they are collected somewhere), the problems of a desire for n = all observations in data science and it identifies the need for a critical approach. This is one in which openness, transparency, sharing and reproducibility provide a mantra for defensible and robust spatial data science. [ABSTRACT FROM AUTHOR]

With the implementation of national strategies such as sports power and national fitness, the sports economy has become an important element of high-quality national development, and the demand for sports economy and management talents is greatly increased. Particularly in the new area with big data as the typical feature, the teaching content, teaching method, and teaching mode of sports economics and management majors have put forward new requirements. The continuous progress of storage and network technology has prompted the generation of massive multisource spatiotemporal data in various fields. The advantage of association analysis algorithms is that they are easy to code and implement. The relationships found by association analysis can take two forms: frequent itemsets or association rules. We use correlation analysis methods to perform correlation learning between sports economy and related big data and thus improve the development of sports economy. Mining and analyzing the relevant big data can precisely reveal the problems of sports economic development and can realize the fine management of sports, thus contributing to the healthy development of sports. Mastering the skills of acquiring, analyzing, and applying big data is the core content of sports economic analysis. The sports economy has refined and intelligent management means, and its adoption of virtual reality reflects the current situation and development trend of the sports business, which further highlights the status and role of multisource big data in the sports economy. Based on these, this paper proposed a sports economy mining algorithm in view of the correlation analysis and big data model. Then, we verified the effectiveness of the model through experiments, which laid the foundation for the development of the sports economy. [ABSTRACT FROM AUTHOR]

This paper provides an in-depth analysis and study of the interactive flipped classroom model for a digital micro-video for a big data English course. To improve the learning efficiency of English courses and reduce the learning pressure of students, the thesis also uses certain techniques to apply audiovisual language to the production of specific micro-class videos, broadcast the successfully recorded micro-class courses to students, and then use the questionnaire to randomly distribute the designed audiovisual language use questionnaire. Micro-classes earnestly perform data statistics for students and finally conduct data analysis to summarize and verify the effects of micro-class audiovisual language use. The improved algorithm can effectively reduce the fluctuation of the consumption of various resources in the cluster and make the services in the cluster more stable. The new distributed interprocess communication based on protocol and serialization technology is more efficient than traditional communication based on protocol standards, reduces bandwidth consumption in the cluster, and improves the throughput of each node in the cluster. The content design and scripting of micro-video teaching resources are based on this. Then, the production process of micro-video teaching resources is explained, according to the selection of tools, the preparation, recording, editing, and generation of materials. [ABSTRACT FROM AUTHOR]