Search

Many studies demonstrate that peer reviewing provides pedagogical benefits such as inspiration and developing expert vision, and changes classroom culture by encouraging reciprocity. However, much large-scale research in peer assessment has focused on MOOCs, where students have short tenures, and is unable to describe how reciprocity-oriented classroom cultures evolve over time. This short paper presents the first long-term analysis of peer reviewing with 304 students, conducted in three large physical classes in a year-long undergraduate series. Surprisingly, this analysis reveals that when students receive better reviews on their work, they write worse reviews in the future. This suggests that while students believe in the reciprocal nature of peer review, they act anti-reciprocally. Therefore, battling the emergent norm of anti-reciprocity is crucial both for system designers and practitioners who use peer assessment.

This paper explores whether shopping tourism in the context of cross-border regions may trigger more viable, and long-term, tourism despite persistent border asymmetries (e.g., price and tax differences) which are typically key to luring tourists to short-term shopping visits. While tourism development is often an explicit goal of cross-border policy initiatives, this paper is devoted to the market-driven processes that might drive tourism beyond short-term shopping in borderlands. Based upon a case study from the Norwegian-Swedish border region of Østfold-Fyrbodal, it finds that asymmetric cross-border shopping tourism supports the development of a diversified tourism sector with a variety of tourist attractions and services organised around shopping, longer overnight stays and second-home tourism. Despite persistent border asymmetries, market processes may balance off the short-term shopping visits towards supporting long-term tourism, which provides economic value to the cross-border region.

Replicability tests of scientific papers show that the majority of papers fail replication. Moreover, failed papers circulate through the literature as quickly as replicating papers. This dynamic weakens the literature, raises research costs, and demonstrates the need for new approaches for estimating a study’s replicability. Here, we trained an artificial intelligence model to estimate a paper’s replicability using ground truth data on studies that had passed or failed manual replication tests, and then tested the model’s generalizability on an extensive set of out-of-sample studies. The model predicts replicability better than the base rate of reviewers and comparably as well as prediction markets, the best present-day method for predicting replicability. In out-of-sample tests on manually replicated papers from diverse disciplines and methods, the model had strong accuracy levels of 0.65 to 0.78. Exploring the reasons behind the model’s predictions, we found no evidence for bias based on topics, journals, disciplines, base rates of failure, persuasion words, or novelty words like “remarkable” or “unexpected.” We did find that the model’s accuracy is higher when trained on a paper’s text rather than its reported statistics and that n-grams, higher order word combinations that humans have difficulty processing, correlate with replication. We discuss how combining human and machine intelligence can raise confidence in research, provide research self-assessment techniques, and create methods that are scalable and efficient enough to review the ever-growing numbers of publications—a task that entails extensive human resources to accomplish with prediction markets and manual replication alone.

This paper investigates the possible benefits as well as the overall impact on the behaviour of students within a learning environment, which is based on double-blinding reviewing of freely selected peer works. Fifty-six sophomore students majoring in Informatics and Telecommunications Engi-neering volunteered to participate in the study. The experiment was conducted in a controlled environment, according to which students were divided into three groups of different conditions: control, usage data, usage and ranking data. No additional information was made available to students in the control condition. The students that participated in the other two conditions were provided with their usage information (logins, peer work viewed/reviewed, etc.), while members of the last group could also have access to ranking information about their positioning in their group, based on their usage data. According to our findings, students’ performance between the groups were comparable, however, the Ranking group revealed differences in the resulted behavior among its members. Specifically, awareness of ranking information mostly benefited students which were relatively in favor of ranking, motivating them to further engage and perform better than the rest of the group members.

This paper explores the interplay between social and physical aspects of food retail in disaster and post-disaster contexts and discusses how it can inform better market support interventions and food retail modernization agendas. To this end, this paper draws on a case study analysis of three distinct marketplaces in metropolitan Port-au-Prince to explore aspects of food provision and access. The findings demonstrate the pertinence of beneficial reciprocal relationships among traders and between traders and customers, as well as the physical preconditions for the existence and maintenance of these relationships over time. The study also reviews the impacts of destroyed and changing physical infrastructure in disaster and post-disaster contexts on these social relationships. It concludes by calling for an acknowledgement of the interrelated attributes of solidarity, proximity and stability of existing marketplaces in urban planning and humanitarian practices in the efforts to improve urban food security and disaster recovery.

While innovation should be about socioeconomic transformation of society, concerns have been raised about its negative externalities including growing disparities within and between regions. Arguably, Responsible Research and Innovation (RRI) offers a potential solution to address these concerns. However, in theory, its conceptualization and operationalization remain ambiguous. Further, in practice, this makes its application to regional development difficult. Accordingly, this study first conducts a systematic literature review of conceptual papers on RRI. It identifies themes and categorizes them into four domains: drivers, tools, outcomes and barriers. Second, these domains are applied to regional innovation studies. The paper contributes to an increased understanding of RRI and its applications to sustainable regional development as well as how RRI and regional innovation studies can benefit from each other.

Computer Science researchers rely on peer-reviewed conferences to publish their work and to receive feedback. The impact of these peer-reviewed papers on researchers’ careers can hardly be overstated. Yet conference organizers can make inconsistent choices for their review process, even in the same subfield. These choices are rarely reviewed critically, and when they are, the emphasis centers on the effects on the technical program, not the authors. In particular, the effects of conference policies on author experience and diversity are still not well understood. To help address this knowledge gap, this paper presents a cross-sectional study of 56 conferences from one large subfield of computer science, namely computer systems. We introduce a large author survey (n = 918), representing 809 unique papers. The goal of this paper is to expose this data and present an initial analysis of its findings. We primarily focus on quantitative comparisons between different survey questions and comparisons to external information we collected on author demographics, conference policies, and paper statistics. Another focal point of this study is author diversity. We found poor balance in the gender and geographical distributions of authors, but a more balanced spread across sector, experience, and English proficiency. For the most part, women and nonnative English speakers exhibit no differences in their experience of the peer-review process, suggesting no specific evidence of bias against these accepted authors. We also found strong support for author rebuttal to reviewers’ comments, especially among students and less experienced researchers.

This paper is an extensive review of 229 papers addressing HSE (Health, Safety and Environment) and culture published between 1992 and 2013. The review has been conducted in order to analyse how “culture” has been conceptualised, and whether there is a relation between these conceptualisations and the authors' experience base. The review of the papers has been supported by a statistical analysis of data obtained by a structured and systematic registration of information from papers addressing “culture” and “HSE”. Bivariate correspondence analysis has been used as the statistical method in order to explore possible associations between the constructed categorical variables. The statistical analysis reveals that different cultural perspectives are associated with the professional background of the authors and the research designs that have been applied. Our findings confirm much of the critique that has been addressed regarding the use of culture as a concept. The review shows that the literature first and foremost addresses safety. An overwhelming majority of the published research has been conducted in North America, Europe and Australia. We argue that this represents a bias in the research that contributes to inaccurate generalisations and conclusions, especially related to discussions regarding “bad” or “sound” cultures. Some perspectives on culture are dominant, such as the conceptualisation of culture as: 1) shared and aligned perceptions and attitudes, 2) culture as an ideational entity, and 3) culture as one factor among several factors that influence Health, Safety and/or Environment. Relatively few papers conceptualise culture as: 4) holistic metaphor, used in order to denote the systemic relations that influence HSE or as, 5) something that develops in the interaction between people within a particular organisational context. Finally, interpretative approaches, taking the perspective of the actors, are marginal.

Scientific papers are complex and understanding the usefulness of these papers requires prior knowledge. Peer reviews are comments on a paper provided by designated experts on that field and hold a substantial amount of information, not only for the editors and chairs to make the final decision, but also to judge the potential impact of the paper. In this paper, we propose to use aspect-based sentiment analysis of scientific reviews to be able to extract useful information, which correlates well with the accept/reject decision. While working on a dataset of close to 8k reviews from ICLR, one of the top conferences in the field of machine learning, we use an active learning framework to build a training dataset for aspect prediction, which is further used to obtain the aspects and sentiments for the entire dataset. We show that the distribution of aspect-based sentiments obtained from a review is significantly different for accepted and rejected papers. We use the aspect sentiments from these reviews to make an intriguing observation, certain aspects present in a paper and discussed in the review strongly determine the final recommendation. As a second objective, we quantify the extent of disagreement among the reviewers refereeing a paper. We also investigate the extent of disagreement between the reviewers and the chair and find that the inter-reviewer disagreement may have a link to the disagreement with the chair. One of the most interesting observations from this study is that reviews, where the reviewer score and the aspect sentiments extracted from the review text written by the reviewer are consistent, are also more likely to be concurrent with the chair's decision., Comment: Accepted in JCDL'20

Advances in technologies (e.g. smartphones, wearables) have resulted in the concept of ‘self-tracking’, and the use of self-tracking technologies in physical activity (i.e. fitness tracking) is on the rise. For example, many people track and monitor their fitness-related metrics (e.g. steps walked, distance ran, and calories burned) to change their behaviours or keep themselves active. Despite the widespread application of self-tracking in fitness, relatively little is known about its drivers and outcomes. To address this gap, the current paper provides an overview of the literature (empirical papers) on self-tracking with a focus on the drivers and outcomes of fitness tracking behaviour and offers four important contributions. First, it identifies 19 drivers of fitness tracking technology usage. Second, it discusses four main outcomes of fitness tracking behaviour. Third, by drawing on the existing studies conducted across various fitness tracking technologies (e.g. fitness trackers, apps) and user groups (e.g. patients, seniors, and females), it provides valuable insights that can be generalisable to other settings (e.g. other types of users and fitness tracking products). Finally, the current paper provides important practical implications and addresses avenues for future research.

Since Hoggart and Mendoza's paper on ‘African immigrant workers in Spanish agriculture' in Sociologia Ruralis in 1999 there has been a proliferation of interest in labour migration to/ in rural Europe. It is now clear that the rural realm has been, and is being, transformed by immigration, and that low-wage migrant workers in the food production industry are playing a particularly prominent role in this transformation. This paper takes stock of the literature and identifies seven key issues associated with low-wage labour migration, contemporary food production, and rural change. Most notably, since the 1990s, there has been growing demand for migrants in the segmented, and sometimes exploitative, labour markets of the European food production industries. This demand has been met across a variety of contexts, with states and labour market intermediaries playing a largely supportive role. However, migrants' integration into rural communities has often been problematic, with the emphasis being on the need for, rather than needs of, low-wage migrant workers.

Using peer assessment in the classroom to increase student engagement by actively involving the pupils in the assessment process has been practiced and researched for decades. In general, the literature suggests using peer review for project-based exercises. This paper analyzes the applicability of peer assessment to smaller exercises at secondary school level and makes recommendations for its use in computer science courses. Furthermore, a school pilot project introducing student-centered classrooms, called “learning office”, is described. Additionally, a concept for the implementation of peer assessment in such student-centered classrooms is outlined. We introduced two traditional secondary school classes consisting of a total of 57 students to the peer assessment method within the scope of the same software engineering course. The peer students assessed two of 13 exercises using the Moodle workshop activity. The students evaluated these two exercises using an anonymous online questionnaire. At the end of the course, they rated each of the 13 exercises regarding their learning motivation. Overall, the anonymous feedback on the peer review exercises was very positive. The students not only obtained more feedback, but also received it in a timelier manner compared to regular teacher assessment. The results of the overall rating of all 13 exercises revealed that the two peer reviewed exercises have been rated significantly better than the other eleven exercises assessed by the teacher. Evidence therefore suggests that peer review is a viable option for small- and medium-sized exercises in the context of computer science education at secondary school level under certain conditions, which we discuss in this paper.

Despite compelling evidence of its potential effectiveness, uptake of self and peer assessment in higher education has been slower than expected. As with other assessment practices, self and peer assessment is ultimately enabled, or inhibited, by the actions of individual academics. This paper explores what academics see as the benefits and challenges of implementing self and peer assessment, through the analysis of interviews with 13 Australian academics. Thematic analysis of our qualitative data identified seven themes of benefits and five challenges. Our academics showed strong belief in the power of self and peer assessment as formative assessment, contrary to past literature which has focussed on the accuracy of students’ marking. This paper therefore brings insights as to not only what academics value about self and peer assessment but also identifies potential inhibitors in practice. Recommendations are made about improving the design and implementation of self and peer assessment in higher...

Writing in these pages, Noland and colleagues recently proposed a methodology for cost-benefit analysis of ‘Road Diets’ (re-design of the cross-section of a four-lane arterial). On the basis of the proposed procedures, the authors conclude that a Road Diet of an empirical case study (in New Brunswick, New Jersey, USA) would provide ‘overwhelming’ benefits. The study team has employed similarly unambiguous language in statements in other public fora. In this paper, I do not take a view of whether Road Diets are in general desirable or not (which will depend heavily on local context). Rather, I demonstrate here that the specification of benefits and costs in the proposed methodology is systematically biased (upwards in the case of ‘benefits’ and downwards in the case of ‘costs’). I also show that the authors mis-interpret public opinion regarding the proposed Road Diet; general public opinion cannot be known on the basis of the evidence that is presented to readers. Finally, it has been previously shown that transportation planners tend to, on average, systematically under-estimate costs and over-estimate benefits. While the authors’ motivations during the study at issue cannot be known, the systematic bias in specifying costs and benefits is consistent with Flyvbjerg’s ‘political-economic hypothesis’, in which it is theorized that planners strategically misrepresent costs and benefits in order to increase the likelihood of a politically-preferred project being advanced. Flyvbjerg suggests making independent peer reviews publicly available as part of a strategy to encourage accountability through transparency; this is the spirit in which the present paper is disseminated.

With a tremendous growth in the number of scientific papers, researchers have to spend too much time and struggle to find the appropriate papers they are looking for. Local citation recommendation that provides a list of references based on a text segment could alleviate the problem. Most existing local citation recommendation approaches concentrate on how to narrow the semantic difference between the scientific papers’ and citation context’s text content, completely neglecting other information. Inspired by the successful use of the encoder-decoder framework in machine translation, we develop an attention-based encoder-decoder (AED) model for local citation recommendation. The proposed AED model integrates venue information and author information in attention mechanism and learns relations between variable-length texts of the two text objects, i.e., citation contexts and scientific papers. Specifically, we first construct an encoder to represent a citation context as a vector in a low-dimensional space; after that, we construct an attention mechanism integrating venue information and author information and use RNN to construct a decoder, then we map the decoder’s output into a softmax layer, and score the scientific papers. Finally, we select papers which have high scores and generate a recommended reference paper list. We conduct experiments on the DBLP and ACL Anthology Network (AAN) datasets, and the results illustrate that the performance of the proposed approach is better than the other three state-of-the-art approaches.

Carnivores-livestock interactions cause human-wildlife conflicts worldwide. These interactions are present under a wide range of ecological and economic circumstances. This paper studies the relationship between predation mortality and natural mortality, when food availability affects natural mortality of the livestock. Semi-domestic Saami reindeer (Rangifer t. tarandus) herding in Norway is used as a case study. When predation affects reindeer density, food competition among reindeer changes, which changes weights and natural mortality in the reindeer population. An age-structured bio-economic model is presented, where this relationship is taken into account. While predation mortality may be additional to natural mortality in absence of food limitation, it can compensate for natural mortality in situations of food scarcity. Furthermore, due to density dependency in livestock weights, predation may increase the meat value of livestock. The paper analyzes how predation affects livestock production and economic performance under an optimized management scheme. One main result is that predation shifts the optimal harvesting composition towards calf harvesting and, therefore, the optimal stock composition among the different categories of animals. This contrasts findings in the existing bioeconomic literature. Furthermore, a changing harvesting pattern towards calf harvest is an important adjustment that highly limits the negative impact on profit of predation.

The purpose of this paper is to review extant research on knowledge risk management (KRM) to establish our body of knowledge and to identify gaps justifying further research activities. The study is based on a systematic review of peer reviewed empirical and conceptual articles on the management of knowledge risks. This proceeding proves evidence that there are a small number of papers addressing knowledge risks and its management. The recommendations derived from the findings can assist researchers, managers and consultants to better understand the critical importance of integrating KRM in the firms' enterprise risk management. This increased understanding can particularly be useful for managers as better decisions will be possible.

Publication and researcher bias is common in software engineering experiments.Our model shows how these biases lead to a high proportion of incorrect results.Increased statistical power is a key factor to improve the trustworthiness. ContextThe trustworthiness of research results is a growing concern in many empirical disciplines. AimThe goals of this paper are to assess how much the trustworthiness of results reported in software engineering experiments is affected by researcher and publication bias, given typical statistical power and significance levels, and to suggest improved research practices. MethodFirst, we conducted a small-scale survey to document the presence of researcher and publication biases in software engineering experiments. Then, we built a model that estimates the proportion of correct results for different levels of researcher and publication bias. A review of 150 randomly selected software engineering experiments published in the period 20022013 was conducted to provide input to the model. ResultsThe survey indicates that researcher and publication bias is quite common. This finding is supported by the observation that the actual proportion of statistically significant results reported in the reviewed papers was about twice as high as the one expected assuming no researcher and publication bias. Our models suggest a high proportion of incorrect results even with quite conservative assumptions. ConclusionResearch practices must improve to increase the trustworthiness of software engineering experiments. A key to this improvement is to avoid conducting studies with unsatisfactory low statistical power.

Project owners are important. They shall support the project manager and provide senior backing to a project. However, there are some different aspects of project ownership, which are discussed in this paper. The main research questions addressed in the paper are; how is the project owner role described in the literature, and how is the role in practice? The paper is mainly a theory review of the topic project ownership. We present a simple model for the relation between project owner, project manager and operation of the project delivery. The basis for the model and discussion is a theoretical review, but we also test the proposed model on a sample of projects. As we will see, this testing creates the need for a distinction between two types of project owners; one that is mainly concerned with supporting the project manager and enabling project delivery, the other being focused on the business case and having responsibility for both project delivery and benefit realization. There has been a development where the importance of the role as project owner has been highlighted. It is our impression that this development has had two ambitions. One is to strengthen project execution. The other ambition is to emphasize the business case perspective. These two perspectives call for different organizational positions of the persons called project owners. We urge future researchers and practitioners to clarify what type of project owner role that is referred to in different contexts. We also call for an awareness of the fact that different project owners will have different set of incentives and priorities. © 2016 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license.

The classical view of peer review is that it is our primary process for assessing and judging whether research results should be published in a scholarly journal. However, the increased pressure to publish and technological developments are transforming peer review such that it is becoming a system that judges where work is published rather than whether the research is publishable (a ‘where rather than if’ process). Ecology is a field in which publication numbers puts a particular pressure on the review system. In this forum piece, I summarize the issues with the current publication system and discuss how technology is changing it, while suggesting solutions for important prior and ongoing issues with the peer review system. The view explored here is that technological developments (e.g. ease of creating journals, internet sites, storage, data generation, sharing of data and analytical code) will not eliminate peer review per se but will allow for a new set of parameters in which ethics and the optimal use of public funding will play a vital role in the evolution of the review process. Synthesis The number of papers and journals in Ecology has increased dramatically in the past decade. I present a critical overview of our review system and proposes that pressure to publish and technological developments have transformed peer review into a system that decides “where rather than if” papers are publishable. While reviewing the current pressures and factors playing a vital role in the evolution of the review and publication systems, I propose potential solutions to deal with current and future challenges to the peer review and publication systems.

Initial internet-based cognitive behavioral therapy (iCBT) programs for anxiety disorders in children and young people (CYP) have been developed and evaluated, however these have not yet been widely adopted in routine practice. The lack of guidance and formalized approaches to the development and dissemination of iCBT has arguably contributed to the difficulty in developing iCBT that is scalable and sustainable beyond academic evaluation and that can ultimately be adopted by healthcare providers. This paper presents a consensus statement and recommendations from a workshop of international experts in CYP anxiety and iCBT (#iCBTLorentz Workshop Group) on the development, evaluation, engagement and dissemination of iCBT for anxiety in CYP., Highlights • This paper gives a consensus statement and recommendations for research on iCBT for anxiety in youth • We discuss considerations regarding the development, evaluation, engagement and dissemination of iCBT for anxiety in youth • ICBT for youth anxiety should be initially evaluated with a RCT, while further iterations could use other research designs • Consistent measures relating to youth anxiety and iCBT usage should be employed, as well as precise reporting of iCBT programs • Dissemination of iCBT for youth anxiety into routine clinical practice should be considered from the start of development

Alignment has been identified as an important criteria for successful project teams. However, we need more knowledge on how alignment is achieved in project teams and also about potential negative effects of focusing alignment. This paper responds to a call for more in-depth empirical accounts of what goes on in projects and project management. More specifically, it provides insight into practices of achieving alignment in an inter-organizational project collaboration. The paper addresses potential negative effects of alignment, as findings show how these practices reduce the potential for diverse discussions over ideas, risks and solutions leaving project teams as an untapped resource. The empirical material originates from a PhD project studying the appeal, use and effect of the risk matrix in an inter-organizational project within the petroleum sector in Norway using a qualitative approach.

In this paper we address the institutional context of the police response during the 22 July terror attacks in Norway. Our analysis shows how institutionalized informal practices, established over time, influenced the police response during the attacks. The response presented challenges in terms of management of actor complexity (the number of actors involved and the need for coordination) and uncertainty. The importance of these dimensions is discussed based on the police's response during the terror attack in Oslo in 2011. Our analysis of the course of events shows that the resources dedicated to strategic management were marginalized during the event and that insufficient attention was directed towards intelligence and investigation. This contributed to an ineffective police effort to track and capture the perpetrator and prevent or respond to the secondary attack. This is similar to what is often found in hindsight investigations of crises. The aim of this paper is to contextualize and analyze these findings in light of the institutional context of the Norwegian police. Reports from exercises before and after the terror attack indicate that the marginalization of strategic work, intelligence and investigation has been and remains a persistent problem in the Norwegian police. Interviews indicate that there are informal aspects of the police organization regarding status and established conventions of what “proper police work” is about that explain how the observed inadequacies are deeply embedded in the organization. As such, the paper is not a study of a failure in crisis management, but rather the institutional patterns of action that make actions and decisions stand out as meaningful for the actors involved in dealing with situations of high complexity and uncertainty.

Industry 4.0 is the first industrial revolution to be announced a priori, and there is thus a significant ambiguity surrounding the term and what it actually entails. This paper aims to clearly define digitalization, a key enabler of Industry 4.0, and illustrate how it can be used for improvement through proposing an improvement cycle and an associated digitalization typology. These tools can be used by organizations to guide improvement processes, focusing on the new possibilities introduced by the enormous amounts of data currently available. The usage of the tools is illustrated by presenting four scenarios from Kanban control, where each scenario is mapped according to their digitalization level. © 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd.

Purpose The purpose of this paper is to provide a supply-side review of policies and practices that impact on the shortage of supply in the contemporary specialist housing market for older people in the UK. Design/methodology/approach The review is based on a review of academic literature, policy documents, reports and other sources. Findings There is a critical conflict between the key social purpose of specialist housing (i.e. living independent of socially provided care) and the values that underpin and ultimately limit the quantity of units in both the social and private sector. In the social sector, government policies prohibit rather than encourage local authorities and housing associations from increasing specialist housing stock. The nature of leasehold tenures in the private sector tends to commodify not only housing stock but also those who use it and therefore acts to instrumentalise housing supply in favour of the profit motive and the focus on the person and her or his needs is largely ignored. Originality/value While the shortage of specialist housing is well known, this paper is unique in that it provides a comprehensive and critical supply-side review of the factors that have created such conditions.

It is a non‐trivial task for research‐centric courses in the software engineering curriculum to compete and engage students on the same level as the practical, software development courses. Practical software development courses and projects are inherently motivating to students, as they provide necessary elements such as agency, relatedness, and the strong sense of competence upon completing software engineering tasks. In contrast, reading research articles and technical white papers feels dry and non‐engaging. Nevertheless, a well‐balanced MSc programme curriculum covers both, learning through construction and practical courses as well as research courses. The main motivation for the development of game‐centric approaches to the research aspects of curriculum is to improve students’ interest and engagement with those courses. In this paper, we present the methodology and initial evaluations from three gamification strategies used in the Master's degree programme. These are: the game of reading and discussing research articles (GoRaD), the game of arguing and counter‐arguing, and combining research and practice. The paper presents our experimentation and initial evaluations of the use of those strategies, as well as plans for future development and enhancements. © 2018 The Authors. Computer Applications in Engineering Education Published by Wiley Periodicals Inc. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Software startups have long been a significant driver in economic growth and innovation. The on-going failure of the major number of startups calls for a better understanding of state-of-the-practice of startup activities. Objective With a focus on engineering perspective, this study aims at identifying the change in focus of research area and thematic concepts operating startup research. A systematic mapping study on 74 primary papers (in which 27 papers are newly selected) from 1994 to 2017 was conducted with a comparison with findings from previous mapping studies. A classification schema was developed, and the primary studies were ranked according to their rigour. We discovered that most research has been conducted within the SWEBOK knowledge areas software engineering process, management, construction, design, and requirements, with the shift of focus towards process and management areas. We also provide an alternative classification for future startup research. We find that the rigour of the primary papers was assessed to be higher between 2013–2017 than that of 1994–2013. We also find an inconsistency of characterizing startups. Future work can focus on certain research themes, such as startup evolution models and human aspects, and consolidate the thematic concepts describing software startups. © 2018. This is the authors’ accepted and refereed manuscript to the article. Locked until 19.6.2020 due to copyright restrictions. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/

Knowledge management plays a significant role in organizations; supporting organizations to deal effectively with changes, increasing their productivity and paving the way to development and innovation. Several scientific studies have addressed the relevance of applying knowledge management initiatives to improve projects as well as organizations that conduct projects. This paper will look at the interaction between knowledge management and big data within the context of projects. In this regard, this paper will discuss, among other things, (1) how big data can contribute to enhance knowledge management in projects and project-based organizations (2) what kind of pitfalls, challenges and opportunities that are associated with the interplay between knowledge management and big data (3) how this interplay can improve projects so that the projects can be carried out effectively and efficiently. These three questions are addressed by taking into consideration some of the important, underlying issues that are essential for ensuring improved decision making and performance in projects and project-based organizations. © 2018 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)

The peer review process is central to the scientific method, the advancement and spread of research, as well as crucial for individual careers. However, the single-blind review mode currently used in most Software Engineering (SE) venues is susceptible to apparent and hidden biases, since reviewers know the identity of authors. We perform a study on the benefits and costs that are associated with introducing double- blind review in SE venues. We surveyed the SE community’s opinion and interviewed experts on double-blind reviewing. Our results indicate that the costs, mostly logistic challenges and side effects, outnumber its benefits and mostly regard difficulty for authors in blinding papers, for reviewers in understanding the increment with respect to previous work from the same authors, and for organizers to manage a complex transition. While the surveyed community largely consents on the costs of DBR, only less than one-third disagree with a switch to DBR for SE journals, all SE conferences, and, in particular, ICSE; the analysis of a survey with authors of submitted papers at ICSE 2016 run by the program chairs of that edition corroborates our result.

© American Psychological Association, 2018. This paper is not the copy of record and may not exactly replicate the authoritative document published in the APA journal. Please do not copy or cite without author's permission. The final article is available, upon publication, at: http://doi.org/10.1037/mil0000192 The Norwegian Armed Forces have made major changes to the enlistment and selection system for conscripts in recent years. In this paper, the predictive validity of various selection criteria for Military Performance is examined. The sample consisted of 3,276 conscripts, of whom 18 percent were female. The predictors in the analysis were General Mental Ability, Self-Perceived Physical Fitness, Social and Life Skills, Self-Perceived Military Fit, Tested Physical Fitness and Officer-Rated Suitability. Military Performance was assessed by an officer towards the end of the basic one-year military service. Bivariate correlations between the predictors and Military Performance were studied for men and women separately. The best predictors were Tested Physical Fitness for men and Officer-Rated Suitability for women. A step-wise hierarchical moderated multiple regression analysis was conducted. A small, but significant part of the variance was explained by the model. Both self-reported variables and other predictors made a small, but significant contribution to improving the model. The results indicated that the two-step selection process was valid for predicting military performance for both men and women.

In this paper, we analyse processes of domestication as collective enactments, using online game playing of World of Warcraft as a case. We study how groups of players – guilds – develop practices and sense-making with respect to the technologies they use in their shared endeavours in raids to battle monsters. Previous studies of domestication have mainly focused on single-actor strategies and relatively little attention have been given to the impact of concerns for particular domestication outcomes, for example in competitive situations or with goals related to efficiency. This paper contributes to domestication theory by analysing what we call collective domestication in a performance-oriented setting, to see how domestication may produce compatible outcomes for individuals that need to act together. The paper is based on a one-year participant observation and qualitative interviews with players. Three types of players were identified – hardcore, casual and moderate – representing three rationales of play: a high level of performance, social benefits, or a combination of the first two. In the analysis, we compare how these three types of player groups’ domesticated the game. A main finding is that collective enactments of technology need extensive managerial efforts unless the group share a coherent and uncontested rationale for playing, thus being a moral community. This is an Accepted Manuscript of an article published by Taylor & Francis in Information, Communication and Society on 26 July 2017 , available online: http://www.tandfonline.com/doi/full/10.1080/1369118X.2017.1355008 . Locked until 26 January 2019 due to copyright restrictions.

This paper explores the application of learning designs featuring formalised and structured technology enhanced peer learning. These include student produced learning elements, peer review discussions and peer assessment in the BSc/MSc level summer course Restoration of European Ecosystems and Freshwaters (REEF), the Master thesis preparation seminars for the Master of Public Health (MPH) and the MOOC course Global Environmental Management (GEM). The application of student produced learning elements and peer review discussions is investigated by analyzing quotes from course evaluations and performing focus group interviews. The application of peer assessment is investigated by analyzing the agreement of peer assessment between students assessing the same assignment. Our analyses confirm previous research on the value of peer learning and peer assessment and we argue that there could also be a huge benefit from developing learning design patterns that facilitate informal peer learning and reinforce knowledge sharing practices. This paper explores the application of learning designs featuring formalised and structured technology enhanced peer learning. These include student produced learning elements, peer review discussions and peer assessment in the BSc/MSc level summer course Restoration of European Ecosystems and Freshwaters (REEF), the Master thesis preparation seminars for the Master of Public Health (MPH) and the MOOC course Global Environmental Management (GEM). The application of student produced learning elements and peer review discussions is investigated by analyzing quotes from course evaluations and performing focus group interviews. The application of peer assessment is investigated by analyzing the agreement of peer assessment between students assessing the same assignment. Our analyses confirm previous research on the value of peer learning and peer assessment and we argue that there could also be a huge benefit from developing learning design patterns that facilitate informal peer learning and reinforce knowledge sharing practices.

In the 10 years since the term was coined 'design fiction' has become an increasingly common approach in HCI research. The practice involves working with 'diegetic prototypes', that is prototypes that need not exist in reality, but instead exist from within a 'story world'. Although fictional aspects are not unusual in HCI prototyping methods (e.g. storyboards, personas, Wizard-of-Oz), the breadth and flexibility of design fiction poses new challenges. This paper originally featured quotes from peer reviews of design fiction orientated papers that have previously been submitted to ACM SIGCHI conferences in order to highlight inherent challenges when reviewing research that may be based upon or include elements of fiction. In response to the SIGCHI Executive Committee's request to not directly quote reviewers the quotes have now been redacted. This somewhat changes the paper's tone and also makes very clear that publishing discussions relating to peer reviews (or the reviews themselves) is extremely challenging.

A systematic review of studies providing evidence of the linkage between human factors (HF) in the design and management of operations to production quality performance was conducted. 71 peer reviewed research papers were found to provide evidence of the HF-Quality relationship. These studies identified 178 design factors relating to quality. These included 1) Product Design (54), 2) Production Process Design (75), and 3) Workstation Design aspects (49). In addition 26 Individual quality risk factors were identified. Of the studies identified, about half studied the effects on the human finding associations with the operator workload and fatigue indicators and quality performance. These intermediary variables may provide insight into the mechanism by which HF flaws in the design of production lead to quality deficits in running manufacturing. These results provide useful information for operations managers and production system design teams to secure higher quality performance in their systems by applying human factors.

While in many regions the conventional bicycle has already been regarded as an environmentally friendly and healthy alternative to the car for daily commuting, societal and policy agendas are also increasingly promoting e-bike adoption. Adding to recent research on e-bike safety, satisfaction with travel and behavioral change, this paper reports on the impact of weather circumstances on the use of the e-bike in daily commuting in an e-cycling incentive program in the province of Noord-Brabant, the Netherlands. The impact of this incentive program was analyzed using a longitudinal design, and it combined travel patterns that were derived from individuals’ GPS data over nine months, hourly observed meteorological data, and questionnaires on intended behavior and sociodemographic characteristics. The findings suggest that the presence of snow and ice, total precipitation, and high windspeed negatively affected the choice of commuting to work by e-bike, in this decreasing order of impact. Although the overall impact of air temperature on e-cycling was positive, the likeliness to commute by e-bike decreased at higher air temperatures. E-cycling under specific weather conditions was more likely if participants’ intention to e-cycle under such weather conditions was stronger. Our study indicates that the benefits of the e-bike in daily commuting are underestimated in relation to adverse weather conditions. Respondents from households with one car only, therefore, have fewer alternatives in poor weather conditions: for these individuals, only total precipitation and the presence of relatively low air temperature impact e-cycling. In addition, reported gender and high wind speeds might have been expected to influence participation in e-cycling.

Streaming services have emerged as increasingly important access points for cultural content, often promising, as Netflix does, ‘unlimited entertainment’. However, the actual conditions of availability remain under-examined. While streaming services typically contain a vast selection of objects, they certainly do not hold the total amount of all possible items. Streaming services thus pose new challenges for policy makers who wish to ensure access to, and availability of culture. In this paper, we build on previous research (Tallerås, Colbjørnsen, & Øfsti, 2019) to develop the term ‘contingent availability’ and discuss how cultural items are made available in streaming contexts. Departing from a pyramid model of availability, we investigate these levels empirically through a case-based approach. Nine Norwegian award-winning or critically acclaimed books, movies and TV series were strategically selected to highlight how availability in streaming services is contingent upon multiple conditions. For each case, we assess the ways in which Norwegian cultural policy influences production, distribution and availability of culture. We discuss how cultural policy measures do secure availability for most of the cases, but is unable to effectively combat fragmentation of availability. This work was supported by the Norges Forskningsråd [263076]

PurposePeer reviewer evaluations of academic papers are known to be variable in content and overall judgements but are important academic publishing safeguards. This article introduces a sentiment analysis program, PeerJudge, to detect praise and criticism in peer evaluations. It is designed to support editorial management decisions and reviewers in the scholarly publishing process and for grant funding decision workflows. The initial version of PeerJudge is tailored for reviews from F1000Research's open peer review publishing platform.Design/methodology/approachPeerJudge uses a lexical sentiment analysis approach with a human-coded initial sentiment lexicon and machine learning adjustments and additions. It was built with an F1000Research development corpus and evaluated on a different F1000Research test corpus using reviewer ratings.FindingsPeerJudge can predict F1000Research judgements from negative evaluations in reviewers' comments more accurately than baseline approaches, although not from positive reviewer comments, which seem to be largely unrelated to reviewer decisions. Within the F1000Research mode of post-publication peer review, the absence of any detected negative comments is a reliable indicator that an article will be ‘approved’, but the presence of moderately negative comments could lead to either an approved or approved with reservations decision.Originality/valuePeerJudge is the first transparent AI approach to peer review sentiment detection. It may be used to identify anomalous reviews with text potentially not matching judgements for individual checks or systematic bias assessments.

This paper examines the careers of artists and cultural workers who completed a one-year arts management graduate program. After the program, almost half of the participants were in positions with managerial responsibility, of which the majority combined artistic and administrative responsibility. The aim of the study was to fill a knowledge gap with regard to differences between managers and non-managers among graduated arts management students in terms of self-perceived working conditions and professional identity. The study was based on a survey of graduates (N = 73) from the six-year period 2012-2017. The results show that graduates with managerial responsibility view their working conditions significantly better than those without such responsibility. Managers experience more creative and interesting jobs and score higher on extrinsic conditions such as employment security and income level. They also experience higher career satisfaction and express a stronger leader identity, and notably, they retain an artistic identity to the same degree level as non-managers. Finally, leader identity is positively related to career satisfaction, whereas artistic identity implies a precarious working situation and lower career satisfaction.

Purpose Online reviews are increasingly available for a wide range of products and services in e-commerce. Most consumers rely heavily on online reviews when making purchase decisions, so an important topic is that of understanding what makes some online reviews helpful in the eyes of consumers. Researchers have demonstrated the benefits of the presence of customer reviews to an online retailer, however, few studies have investigated how images in review content and the facial expressions of reviewers’ avatars influence the judgment of online review helpfulness. This study draws on self-construal theory, attribution theory and affect-as-information theory to empirically test a model of the interaction effects of images in review content and the facial expressions of reviewers’ avatars on online review helpfulness. Furthermore, the purpose of this paper is to identify an underlying mechanism of causal attribution toward store performance on the above effects. Design/methodology/approach This study conducted two online experiments. Study 1 is a 2 (images in review content: one person with a product vs a group of people with a product) ×2 (facial expression of the reviewer’s avatar: happy vs angry) between-subjects design. Study 2 is a 3 (image: product alone vs one person with a product vs a group of people with a product) ×2 (facial expression of the reviewer’s avatar: happy vs angry) ×3 (valence of the review: positive vs negative vs neutral) between-subjects design. Findings The results indicate that when consumers were exposed to a happy-looking avatar, they were likely to express higher perceptions of online review helpfulness in response to an image showing a group of people in a restaurant than they would for an image of one person in the same situation. In contrast, when consumers were exposed to an angry-looking avatar, their perceptions of online review helpfulness did not differ in response to images of either a group of people or of one person. Furthermore, cause attribution toward store performance mediated the interaction between images in content of reviews and the facial expression of a reviewer’s avatar on the perceptions of online review helpfulness. Practical implications The authors provide insights into how to develop guidelines on how online reviews should be written so that readers perceive them to be helpful, and how to design effective reward mechanisms for customer feedback. Originality/value Compared with previous studies, this study provides further contributions in three ways. First, it contributes to the literature on review content by showing which images in reviews are deemed to be helpful. Second, it extends previous findings from the literature relating to online peer reviews by demonstrating the importance of facial expressions in reviewers’ avatars (i.e. happy vs angry) when explaining helpfulness, rather than the strength of purchase intent. Third, this study contributes by further highlighting a novel mechanism which shows that a causal attribution toward store performance motivates the perceptions of online review helpfulness.

In this paper, we investigated how internationally mobile students from Norway diverge from students in Norway regarding social background, grades obtained at upper secondary school, and motivation to study. Data from two comparable surveys were used, one relating to students abroad and one relating to domestic students. Results showed that, on average, mobile students were of higher social origin than domestic students, but this did not apply across all fields. In some subject fields, mobile students had higher grades than domestic students, while they were lower in others. Mobile students clearly demonstrated higher motivation than domestic students, even when controlling for subject field and background variables. In sum, we found that mobile students constitute a select group in several ways, most prominently regarding study motivation. This suggests that mobile students potentially represent a positive contribution to the learning environment in more ways than bringing diversity in cultural background.

This paper explores the relationship between the concept of quality of life (QoL) and housing circumstances among the immigrant and local population of two neighbourhoods in Norway: Storhaug in Stavanger and Grünerløkka in Oslo. Objective data regarding housing circumstances, e.g., type of residence, dimension or overcrowding, is collected through spatial analysis and desktop-research. Inhabitants of these neighbourhoods are interviewed with the help of map-based questionnaires to collect both objective data regarding these housing circumstances as well as subjective data, e.g. reason of location and personal satisfaction with housing and QoL. The objective and subjective data is analysed geographically and statistically. This study finds that the immigrant group has less favourable housing circumstances than the local population. Circumstances such as type of residence, the reason of location and satisfaction with the residence are predictors for satisfaction with QoL between both groups. Being local or immigrant, as well as the study area, Storhaug and Grünerløkka, or the type of ownership were not significant predictors of satisfaction with QoL in this specific study. These findings provide a base for understanding the importance of housing circumstances for QoL. Due to the high percentage of the immigrant population and its projection in Norway, these investigations are expected to help practitioners identify housing features and design aspects that can impact on the overall satisfaction with QoL of both host and immigrant society.

Increasing public investments in distributed platform infrastructures created new opportunities for economic growth and social welfare but simultaneously were associated with growing societal distrust in science’s power to solve societal problems. The concept of Responsible Research and Innovation was advanced as providing mechanisms to recouple science and society ensuring that research and innovation continues to uphold its societal duties. In this paper, we explore the extent to which it is possible to identify repertoires of responsible innovation behaviour within extant regional research and innovation networks through the way that these innovation networks draw on informal regional innovation resources. We distinguish two kinds of regional innovation network, those based on primarily synthetic knowledge bases, and those based on primarily analytic knowledge bases, in the eHealth sector where there are substantive societal concerns regarding responsibility and innovation. We contend it appears that the coupling of patients to innovation networks through their prior association with innovators (e.g. as patients) affects the scope for responsibility. We therefore contend that more attention is required for understanding the dynamics of citizen-innovator coupling in regional innovation networks if responsibility is to become a more common systemic property.

This paper investigates what makes developers and municipal planning authorities more (or less) likely to cooperate. It borrows methods from behavioural economics for eliciting the propensi...

A simulation model based on parallel systems is established, aiming to explore the relation between the number of submissions and the overall standard of academic journals within a similar discipline under peer review. The model can effectively simulate the submission, review, and acceptance behaviors of academic journals in a distributed manner. According to the simulation experiments, it could possibly happen that the overall standard of academic journals deteriorates due to excessive submissions., Comment: This paper is already published in the journal IEEE Access and its copyright is fully open. The title was adjusted according to the review comments

It is commonly argued in the literature on regional innovation that regions must continuously develop new economic activities to compensate for economic decline. If a region manages to diversify from an existing path, it can sustain long-term economic development. One of the measures taken to increase these types of opportunities and to avoid lock-in is to stimulate a closer relationship and collaboration between universities and industry partners. However, we know little about the formation and investigation of successful university-industry relationships in regions outside metropolitan areas. This paper seeks to fill this research gap by investigating how different dimensions of cognitive, organizational, social and geographical proximity facilitate or hinder innovation processes in collaborations between industry and universities in peripheral regions. We find that social proximity, combined with high organizational proximity, overcomes the barriers presented by low geographical proximity. Social proximity compensates for thin regional structures with few high-tech firms, a lack of knowledge producers and a weak support system. An important policy implication is that stimulating collaboration within areas of expertise possessed by university and industry partners create potential for innovation.

Loss of specific human capital is often identified as a mechanism through which displaced workers might experience permanent drops in earnings after job loss. Research has shown that displaced workers who migrate out of their region of origin have lower earnings than those who do not. This paper extends the discussion on returns to migration by accounting for the type of jobs people get and how related they are to their skills. Using an endogenous treatment model to control for selection bias in migration and career change, we compare displaced stayers with displaced movers in Sweden. Results show that migrants who get a job that matches their occupation- and industry-specific skills display the highest earnings among all displaced workers. If migration is combined with a job mismatch, earning losses are instead observed. This group experiences the lowest earnings among all displaced workers.

The emergence of autonomous ship technologies has attracted a growing body of academic studies, regulatory discussions and exploration endeavours in recent years. With the introduction of new technology comes the need for the seafarers to be trained in its use. The purpose of this paper is 1) to examine the suitability of the International Convention on Standards of Training, Certification and Watchkeeping for Seafarers (STCW) Table A-II/1 competence framework for navigators under Maritime Autonomous Surface Ship (MASS) operations, and 2) to propose future technical and non-technical competencies that will be needed in autonomous shipping era. A mixed method approach was adopted with collection of both quantitative and qualitative data through a survey instrument developed on the basis of the literature and current STCW Table A-II/1, in which the 66 Knowledge, Understanding & Proficiency (KUP) requirements for navigators were converted into measurement items. Statistical analysis of the data has aided in identifying a list of key technical and non-technical competence requirements for the navigators under MASS operations. The results can be used as an input for revision of the STCW competence requirements and to facilitate the preparation and implementation of novel training frameworks for autonomous shipping.

The objective of exposing girls to Computer Science as a career option has led to research directed towards gaming activities for girls. These activities include both game play and game design. Research about gaming activities for increasing girls’ interest in computer science has gained much attention over the past few years and has resulted in a number of contributions. We follow up with an overview of the status of research through a Systematic Literature Review. We investigate the relation between the various game playing or designing activities and their impact on girls’ perception of Computer Science as a career choice. We further present the design consideration for the games and related activities to potentially improve the perception of girls towards a Computer Science career. The applied method is a Systematic Literature Review through which we investigate which contributions were made, which knowledge areas were most explored, and which research facets have been used. We identify 25 papers to distill a common understanding of the state-of-the-art. Specifically, we investigate the effects that the game play/design activities had on girls’ perception about Computer Science; and what are the key design factors to be kept in mind while designing a serious game to improve girls’ perception about Computer Science. The results of this systematic literature review show that game playing or designing could indeed improve how girls perceive having a career in CS. The key aspects that such activities require are personalizing, opportunity for collaboration and the presence of a female lead character, This work has been done during the tenure of an ERCIM Alain Bensoussan fellowship

PurposeThe purpose of this paper is to identify the need for and develop a framework for research on the effects UN peace operation infrastructure has on a host nation. Mission infrastructure serves primarily to sustain a mission. As the mission terminates, infrastructure is often transferred to the host nation. The mission infrastructures could have both positive and negative implications for the host nation and for local communities.Design/methodology/approachExploratory approach to develop a foundation for a research agenda in an area with little existing research. Identify theoretical contributions related to infrastructures, combine with primary data from one peace operation, secondary data from five other peace operations and from the UN repositories.FindingsThis study proposes a research agenda. As such our findings relate to the identification and classification of different infrastructures and their interdependencies.Research limitations/implicationsThis framework would contribute to new ways of exploring and analysing both the effectiveness of peace operations and the impact a mission has on the development in the host nation.Practical implicationsThis study proposes a framework for research. As such, it will have implications primarily for researchers.Social implicationsUnderstanding the interdependencies between mission infrastructures and the material and social infrastructures of a host nation would help understanding what value mission infrastructure brings to a host nation and the local communities.Originality/valueAnalysing the logistics in peace support operations as networks of infrastructures bring new perspectives into humanitarian logistics.