2,174 results on '"development of methods"'
Search Results
2. Assessing the use of back translation: the shortcomings of back translation as a quality testing method
- Author
-
Behr, Dorothée and Behr, Dorothée
- Abstract
Back translation - the 're-translation' of a translated questionnaire back into the original language and the subsequent comparison of the original version and the back translation - is a controversial assessment method for questionnaire translations. Recently, cross-cultural survey methodologists have followed the call for more empirical research on this method. This article adds to the small body of research by drawing on the back translation documentation from the 2012 European Quality of Life Survey (EQLS). First, results from the official EQLS back translation step are contrasted with results when additional persons perform the same comparison step between back translation and original. We note inconsistency in the detection of presumed flaws. Second, the back translation outcome is contrasted with additional native speaker checks of the actual translation. While back translation can uncover problems, it causes quite a number of false alarms, and even more importantly, many problems remain hidden.
- Published
- 2021
3. СОВРЕМЕННЫЕ ТЕНДЕНЦИИ БУХГАЛТЕРСКОГО УЧЕТА В СЕЛЬСКОХОЗЯЙСТВЕННЫХ ОРГАНИЗАЦИЯХ САДОВОДСТВА
- Subjects
развитие системы сельскохозяйственных предприятий ,development of the system of agricultural enterprises ,evaluation ,research ,рекомендаций ,структура обособленных подразделений ,расчетов между предприятиями ,economic transformation ,modern trends ,разработка методик ,а именно филиалов и представительств ,современные тенденции ,development of accounting policy ,разработка учетной политики ,structure of separate divisions ,принципы формирования системы ,трансформация экономики ,development of methods ,calculations between enterprises ,recommendations ,оценка ,исследования ,principles of system formation ,namely branches and representative offices - Abstract
Совершенствование бухгалтерского учета в сельском хозяйстве как одного из инструментов управления находится во взаимосвязи с развитием отрасли экономических отношений. Сельскохозяйственные предприятия развиваются в настоящее время в направлении диверсификации и уставной деятельности в рамках правового поля, на основании Федерального закона «О развитии сельского хозяйства» и регионального законодательства о развитии сельского хозяйства каждого региона РФ. Основной целью ведения бухгалтерского учета при расчетах сельскохозяйственного предприятия с обособленными подразделениями является своевременное и достоверное отражение финансовых и материальных затрат на счетах бухгалтерского учета и в отчетности, формирование внутренней управленческой информации, а также контроль за соблюдением правил расчетных отношений установленных и основных принципов предприятия. Действующий закон по ведению бухгалтерского учета регламентирует, что регулированию деятельности филиалов и представительств и их отношениям с их головным предприятием уделяется недостаточное внимание, нет самостоятельности. Учетно-финансовой и аналитической основой деятельности сельскохозяйственных предприятий и их обособленных подразделений является наличие определенного состава и структуры ресурсов и имущества. В современных условиях процесса учета в статье представляется развитие бухгалтерского учета как одного из инструментов управления сельскохозяйственными предприятиями и организациями. Очень важной для развития и совершенствования деятельности сельскохозяйственных предприятий как одного из инструментов управления является непосредственная связь с развитием экономических отношений, а также рассмотрение учетных аспектов их создания. В статье рассматриваются учетные процессы сельскохозяйственных предприятий, вопросы регулирования их деятельности, которые будут находиться в ведении бухгалтерского учета головного предприятия. Это означает, что учетная сторона этих отношений в организационном и методическом аспектах должна регламентироваться нормами разработанной учетной политики сельскохозяйственного предприятия. Также рассмотрены формы диверсификации создания обособленных подразделений — филиалов и представительств в сельскохозяйственных предприятиях., The improvement of accounting in agriculture, as one of the management tools, is interrelated with the development of the branch of economic relations. Agricultural enterprises are currently developing in the direction of diversification and statutory activities within the legal framework, on the basis of the Federal Law “On the Development of Agriculture” and regional legislation on the development of agriculture in each region of the Russian Federation. The main purpose of accounting in the calculations of an agricultural enterprise with separate divisions is the timely and reliable reflection of financial and material costs in the accounting accounts and in the reporting, the formation of internal management information, as well as monitoring compliance with the established rules of settlement relations and the basic principles of the enterprise. The current law on accounting regulates that the regulation of the activities of branches and representative offices and their relations with their parent company is not given sufficient attention, there is no independence. The accounting, financial and analytical basis for the activities of agricultural enterprises and their separate divisions is the presence of a certain composition and structure of resources and property. In the modern conditions of the accounting process, the article presents the development of accounting as one of the management tools for agricultural enterprises and organizations. Very important for the development and improvement of the activities of agricultural enterprises as one of the management tools in agriculture is the direct connection with the development of economic relations, as well as the consideration of accounting aspects of their creation. The article deals with the accounting processes of agricultural enterprises, the issues of regulating their activities that will be under the accounting of the parent company. This means that the accounting side of these relations in organizational and methodological aspects should be regulated by the norms of the developed accounting policy of the agricultural enterprise. The forms of diversification of the creation of separate divisions-branches and representative offices in agricultural enterprises are also considered., Бизнес. Образование. Право, Выпуск 2 (55) 2021
- Published
- 2021
- Full Text
- View/download PDF
4. Journal of Social Intervention: Theory and Practice
- Subjects
sociel intervention ,social policy ,organizational innovation ,development of methods ,professional practice ,Sociology (General) ,HM401-1281 - Published
- 2009
5. Testing the illustrative method: How to reveal hidden knowledge stored in traditional water systems
- Author
-
Bobbink, I. (author) and Bobbink, I. (author)
- Abstract
The polder-boezem system, a traditional water system, is a stepping-up discharge system that drains water from the lowlands into the outer water of rivers and sea. In order to reveal the landscape architectonic structure and form of the Dutch polder-boezem system the form-layer method (Steenbergen et al. 2005) was applied and extended in the dissertation: The Landscape Architecture of the Polder-boezem system, structure and form of water network, water pattern and water work in the Dutch lowlands (Bobbink 2016). Originally the form-layer method is an analytic tool to understand the structure and form relation between a landscape architectonic composition (a project) and it’s site. Four layers are distinguished: the basic form, in which the relation between the intervention and the topography is unfolded; the program form, in which the structure and form of the intervention in relation to its program is clarified; the image form, in which the cultural and metaphorical expression is linked to the structure and form of the landscape and the layer of the spatial form, in which the structure and form of landscape and intervention is defined from the experience on eyelevel perspective. In the dissertation the method was used and adapted to analyse a cultural landscape (the polder landscape) instead of a landscape architectonic design. After identifying the landscape architecture form and structure of the lowland water system we felt the need to extend the method further to reveal the use, maintenance and the circularity of humanmade traditional water systems in general. Humans transformed and manage natural water flow in an particular area during decades for different kinds of reasons. Depending on its scale these water management measures shaped the landscape. Indigenous water systems are interesting study objects because they develop over a long period of time by trial and error, cut and fill and therefore store a lot of knowledge related to use, adaptation and, Landscape Architecture
- Published
- 2019
6. Varianzschätzung von Nettoveränderungen mit dem Mikrozensus ab 2012
- Author
-
Schimpl-Neimanns, Bernhard and Schimpl-Neimanns, Bernhard
- Abstract
In diesem Aufsatz wird die Varianzschätzung von Nettoveränderungen am Beispiel ausgewählter Indikatoren des Mikrozensus untersucht. Auf der Grundlage von Scientific-Use-Files des Mikrozensus als große replikative Mehrthemenumfrage werden häufig zeitliche Veränderungen von Indikatoren berichtet. Durch die partielle Rotation von Erhebungseinheiten reduziert sich die Varianz von Nettoveränderungen. Dieser methodische Vorteil kann seit der Bereitstellung längsschnittkonsistenter Ordnungsnummern in den Daten ab 2012 genutzt werden. Hierfür wird das von Berger und Priam (2016) vorgeschlagene Verfahren verwendet. Damit ist es nun für die Wissenschaft möglich, die hohe Präzision der Schätzergebnisse von Nettoveränderungen effizient auszuschöpfen., This article examines the variance estimation of net changes using selected indicators of the Microcensus as an example. Based on the scientific use files of the Microcensus, which is a large replicative multi-topic survey, temporal changes of indicators are often reported. The partial rotation of survey units reduces the variance of net changes. This methodological advantage can be used since the provision of longitudinally consistent identification numbers in the data from 2012. The procedure proposed by Berger and Priam (2016) will be applied for this purpose. This makes it possible for the scientific community to make efficient use of the high precision of the estimation results of net changes.
- Published
- 2019
7. Regionale Standards: Ausgabe 2019
- Author
-
GESIS - Leibniz-Institut für Sozialwissenschaften, Arbeitsgruppe Regionale Standards, Behrens, Kurt, Böltken, Ferdinand, Dittmar, Holger, Göttsche, Florian, Gutfleisch, Ralf, Habla, Heike, Herter-Eschweiler, Robert, Hoffmann, Hermann, Hoffmeyer-Zlotnik, Jürgen H. P., Klinger, Julia, Kobl, Doris, Krack-Roberg, Elle, Krajzar, Harry, Krischausky, Gesine, Milbert, Antonia, Mundil-Schwarz, Rabea, Pfister, Martin, Müller, Stefan, Pavetic, Monika, Rösch, Günther, Schmidt-Seiwert, Volker, Siegers, Pascal, Sodeur, Wolfgang, Sturm, Gabriele, Trutzel, Klaus, Wiese, Kathrin, GESIS - Leibniz-Institut für Sozialwissenschaften, Arbeitsgruppe Regionale Standards, Behrens, Kurt, Böltken, Ferdinand, Dittmar, Holger, Göttsche, Florian, Gutfleisch, Ralf, Habla, Heike, Herter-Eschweiler, Robert, Hoffmann, Hermann, Hoffmeyer-Zlotnik, Jürgen H. P., Klinger, Julia, Kobl, Doris, Krack-Roberg, Elle, Krajzar, Harry, Krischausky, Gesine, Milbert, Antonia, Mundil-Schwarz, Rabea, Pfister, Martin, Müller, Stefan, Pavetic, Monika, Rösch, Günther, Schmidt-Seiwert, Volker, Siegers, Pascal, Sodeur, Wolfgang, Sturm, Gabriele, Trutzel, Klaus, and Wiese, Kathrin
- Abstract
Die "Regionalen Standards" gehen zurück auf die Initiative eines gemeinsamen Arbeitskreises, bestehend aus Vertretern des Statistischen Bundesamtes, der Arbeitsgemeinschaft Sozialwissenschaftlicher Institute e.V. (ASI) und des ADM Arbeitskreis Deutscher Markt- und Sozialforschungsinstitute e.V. Sie stellen ein Angebot für die Forschung in der Bundesrepublik Deutschland dar. Die "Regionalen Standards" beschreiben Gebietsabgrenzungen und Instrumente zur Typisierung von Regionen, wie sie in der Bundesrepublik Deutschland von der amtlichen Statistik und/oder der Markt- und Sozialforschung in gewisser Regelmäßigkeit eingesetzt werden. Zusätzlich werden Datensätze aus unterschiedlichen Quellen vorgestellt, die für die Regionalisierung von Bevölkerungsumfragen genutzt werden können und für die Forschung (teils jedoch mit Einschränkungen) zur Verfügung stehen.
- Published
- 2019
8. Measuring the Coverage Bias in Landline Telephone Surveys by Comparison of Swiss Registry Data with Commercially Available Telephone Number Databases
- Author
-
Klug, Stefan and Arn, Birgit
- Subjects
switzerland ,cell phone ,coverage bias ,amtliche Statistik ,telephone interview ,representativity ,Umfrageforschung ,Repräsentativität ,Antwortverhalten ,RDD ,lcsh:Social Sciences ,Bevölkerungsstatistik ,mobile research ,survey research ,basic research ,Schweiz ,data quality ,survey ,response behavior ,Datengewinnung ,Social sciences, sociology, anthropology ,lcsh:Statistics ,lcsh:HA1-4737 ,computer-assisted telephone interview ,Erhebungstechniken und Analysetechniken der Sozialwissenschaften ,CATI surveys ,Sozialwissenschaften, Soziologie ,Datenqualität ,Stichprobe ,Mobiltelefon ,representative ,Switzerland ,Befragung ,Telefoninterview ,sample ,CATI ,data capture ,lcsh:H ,Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods ,official statistics ,development of methods ,population statistics ,Methodenentwicklung ,ddc:300 ,Grundlagenforschung - Abstract
Coverage of the population within the sampling frame is a very important quality characteristic of a study. However, a metrical evaluation of the coverage bias to approach the question of representativeness is usually not possible. Switzerland stands out in that the federal statistical office (SFSO) has legal access to population registers (person universe) and a full list of landline telephone numbers (phone number universe). However, these data are not available for research institutes, which must rely on commercially available number collections or RDD sampling frames. This paper wants to quantify the coverage bias of such alternative sampling frames by metric calculation of their congruence with the SFSO universes. The analysis shows that 85.0% of private phone numbers and 88.9% of the resident population of Switzerland that can be reached via landline by the SFSO definition (non-ALTELs) are included in our exemplarily analyzed commercially available phone number collection. The highest coverage bias is present in the 20-39 age group. The RDD frame covers 97.8% of private phone numbers and 99.8% of non-ALTEL persons. Hence, both available alternative sampling frames are useful for representative studies. Finally, the potential of use of the Swiss coverage results as benchmarks for other countries is discussed., methods, data, analyses, Vol 10, No 2 (2016)
- Published
- 2016
9. Assessing the Use of Mode Preference as a Covariate for the Estimation of Measurement Effects between Modes. A Sequential Mixed Mode Experiment
- Author
-
Vandenplas, Caroline, Loosveldt, Geert, and Vannieuwenhuyze, Jorre T.A.
- Subjects
mixed mode surveys ,Umfrageforschung ,Antwortverhalten ,mode preferance ,lcsh:Social Sciences ,selection effects ,measurement effects ,mode preference ,back-door method ,survey research ,basic research ,data quality ,survey ,response behavior ,Datengewinnung ,Social sciences, sociology, anthropology ,lcsh:Statistics ,lcsh:HA1-4737 ,Erhebungstechniken und Analysetechniken der Sozialwissenschaften ,Sozialwissenschaften, Soziologie ,Datenqualität ,Stichprobe ,interview ,Befragung ,sample ,data capture ,lcsh:H ,Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods ,development of methods ,Methodenentwicklung ,ddc:300 ,Grundlagenforschung - Abstract
Mixed mode surveys are presented as a solution to increasing survey costs and decreasing response rates. The disadvantage of such designs is the lack of control over mode effects and the interaction between selection and measurement effects. In a mixed mode survey, measurement effects can put into doubt data comparability between subgroups, or similarly between waves or rounds of a survey conducted using different modes. To understand the extent of measurement effects, selection and measurement effects between modes have to be disentangled. Almost all techniques to separate these effects depend on covariates that are assumed to be mode-insensitive and to fully explain selection effects. Most of the time, these covariates are sociodemographic variables that might be mode-insensitive, but fail to sufficiently explain selection effects. The aim of this research is to assess the performance of mode preference variables as covariates to evaluate selection and measurement effects between modes. In 2012, a mixed mode survey – a web questionnaire followed by face-to-face interviews– was conducted alongside the face-to-face European Social Survey in Estonia (Ainsaar et al., 2013). The questionnaire included mode preference items. In this paper, the effects of the trade-offs between the two assumptions on the precision of estimated selection and measurement effects are compared. The results show that while adding the mode preference to the propensity score model seems to increase the explanatory power of web participation, it decreases the correlation between propensity scores and target variables. In addition, the estimated selection and measurement effects do not always fit the expectation that more selection effects are explained and more measurement effects are detected., methods, data, analyses, Vol 10, No 2 (2016)
- Published
- 2016
10. Testing the illustrative method
- Subjects
illustrative method ,development of methods ,student research ,water systems worldwide ,landscape architectonic approach - Abstract
The polder-boezem system, a traditional water system, is a stepping-up discharge system that drains water from the lowlands into the outer water of rivers and sea. In order to reveal the landscape architectonic structure and form of the Dutch polder-boezem system the form-layer method (Steenbergen et al. 2005) was applied and extended in the dissertation: The Landscape Architecture of the Polder-boezem system, structure and form of water network, water pattern and water work in the Dutch lowlands (Bobbink 2016). Originally the form-layer method is an analytic tool to understand the structure and form relation between a landscape architectonic composition (a project) and it’s site. Four layers are distinguished: the basic form, in which the relation between the intervention and the topography is unfolded; the program form, in which the structure and form of the intervention in relation to its program is clarified; the image form, in which the cultural and metaphorical expression is linked to the structure and form of the landscape and the layer of the spatial form, in which the structure and form of landscape and intervention is defined from the experience on eyelevel perspective. In the dissertation the method was used and adapted to analyse a cultural landscape (the polder landscape) instead of a landscape architectonic design. After identifying the landscape architecture form and structure of the lowland water system we felt the need to extend the method further to reveal the use, maintenance and the circularity of humanmade traditional water systems in general.Humans transformed and manage natural water flow in an particular area during decades for different kinds of reasons. Depending on its scale these water management measures shaped the landscape. Indigenous water systems are interesting study objects because they develop over a long period of time by trial and error, cut and fill and therefore store a lot of knowledge related to use, adaptation and climate variation. Many different water elements and works are developed to direct, drain, irrigate, retain, infiltrate and reuse water. Commonly different water elements and works are combined in one system, in which they most of the time try to keep the water in place as long as possible. Next to the benefit for humans, traditional water systems are relevant and valuable for ecosystem services due to their size and connecting capacity as part of blue-green networks.The extended method, called ‘the illustrative method’ (Bobbink and Ruy, 2017) is tested by international graduate students and researchers of the TU Delft, section of Landscape Architecture in the Circular Water Stories LAB. All students within the LAB are interested in water topics and want to learn from existing systems. Nine traditional water systems are mapped according to the method. By evolving the drawings simultaneous a set of theme-drawings and diagrams, flanked by one legend for all cases is developed. Every drawing is drawn again and again until the best result, a meaningful drawing is achieved. Students and researchers learn from each other. During the process the understanding of which layers (soil map, height maps, relief etc.) need to be combined to express the essence of the waterscape have become clearer. From here the description of the method is explicated. Each set of drawings include: a short introduction, a description of the project, photos of the past and today; diagrams of the climate zone including the rain fall curve over the year and a diagram presenting the flow directions of the system; the water system drawn on the regional scale in relation to the topographical and soil map; the development of the water system over a longer time period, a more technical drawing of the catchment area and the different water compartments; sections and/or diagrams in which the interaction between the water elements, water works, its ecology and the use is explained; a crucial detail which is representative for the system and a conclusion. In the conclusion students summarized their findings of the analyses by transforming general values into specific values. So far we came up with six values.Landscape values: natural landscapes are transformed to cultural landscapes, through transformation the natural landscape is architectonically pronounced and is part of the cultural expression; Strategic values: smart use of the site to achieve maximum profitability with the minimum resources and infrastructures, by taking advantage of natural elements, topographic changes, slopes, river bends...; Functional values: water systems are constructions with simple formal and practical solutions; Material and tangible values: water elements and water works are a source of knowledge of traditional construction techniques, local materials from the surrounding area are used that adapt to climate and lithology, expression of rituals; Values of sustainability and circularity: by using materials of the surroundings and non-polluting materials by using natural local materials. The water is used in the system for different purposes and brought back into the natural circuit;Ethnographic and identity values: to encompass the knowledge of what was the main activities of the region. The process of testing the method made clear that a lot of work is involved, especially for those cases which are situated in countries that do not have open access to data. Sites need to be reconstructed with the help of google earth maps. Computer and analytical skills are needed to process the amount of data. Examples help to figure out the path of the analyses. A description of the method is not enough to get a good result, intensive discussions are needed to improve the drawings. Comparison of cases and ongoing reflection is essential for a valuable outcome of the research, this still needs to be done. For now (march 2019) the material is on display in an exhibition at TU Delft and waits for comments of peers. The new input can help to develop the method further and to come up with more circular traditional water systems that in the end can be published in a book. The graduation LAB is called ‘Circular Water Stories’ but so far we did not manage to work on the story part, since this involves more research, research in which we involve the makers and users of the system and dive into achieves to learn more about its history. Knowledge stored in traditional water systems can inspire spatial, smart and sustainable approaches on water management (Ryu 2012). To design with water, one has to understand the geomorphology of the landscape, the operation of the natural water system and its transformation in order to relate to it. The work of the students proves that the illustrative method can be used regardless of scale, complexity and cultural background of the water system to reveal knowledge on the relation between landscape, water management and people. In general the research on traditional water systems delivers first of all knowledge from the past for sustainable, adaptive water design. For the students the analytical work at this stage delivers tools for their final design-thesis.
- Published
- 2019
11. Testing the illustrative method: How to reveal hidden knowledge stored in traditional water systems
- Author
-
Bobbink, I., Gao, Lei, and Egoz, Shelly
- Subjects
illustrative method ,development of methods ,student research ,water systems worldwide ,landscape architectonic approach - Abstract
The polder-boezem system, a traditional water system, is a stepping-up discharge system that drains water from the lowlands into the outer water of rivers and sea. In order to reveal the landscape architectonic structure and form of the Dutch polder-boezem system the form-layer method (Steenbergen et al. 2005) was applied and extended in the dissertation: The Landscape Architecture of the Polder-boezem system, structure and form of water network, water pattern and water work in the Dutch lowlands (Bobbink 2016). Originally the form-layer method is an analytic tool to understand the structure and form relation between a landscape architectonic composition (a project) and it’s site. Four layers are distinguished: the basic form, in which the relation between the intervention and the topography is unfolded; the program form, in which the structure and form of the intervention in relation to its program is clarified; the image form, in which the cultural and metaphorical expression is linked to the structure and form of the landscape and the layer of the spatial form, in which the structure and form of landscape and intervention is defined from the experience on eyelevel perspective. In the dissertation the method was used and adapted to analyse a cultural landscape (the polder landscape) instead of a landscape architectonic design. After identifying the landscape architecture form and structure of the lowland water system we felt the need to extend the method further to reveal the use, maintenance and the circularity of humanmade traditional water systems in general.Humans transformed and manage natural water flow in an particular area during decades for different kinds of reasons. Depending on its scale these water management measures shaped the landscape. Indigenous water systems are interesting study objects because they develop over a long period of time by trial and error, cut and fill and therefore store a lot of knowledge related to use, adaptation and climate variation. Many different water elements and works are developed to direct, drain, irrigate, retain, infiltrate and reuse water. Commonly different water elements and works are combined in one system, in which they most of the time try to keep the water in place as long as possible. Next to the benefit for humans, traditional water systems are relevant and valuable for ecosystem services due to their size and connecting capacity as part of blue-green networks.The extended method, called ‘the illustrative method’ (Bobbink and Ruy, 2017) is tested by international graduate students and researchers of the TU Delft, section of Landscape Architecture in the Circular Water Stories LAB. All students within the LAB are interested in water topics and want to learn from existing systems. Nine traditional water systems are mapped according to the method. By evolving the drawings simultaneous a set of theme-drawings and diagrams, flanked by one legend for all cases is developed. Every drawing is drawn again and again until the best result, a meaningful drawing is achieved. Students and researchers learn from each other. During the process the understanding of which layers (soil map, height maps, relief etc.) need to be combined to express the essence of the waterscape have become clearer. From here the description of the method is explicated. Each set of drawings include: a short introduction, a description of the project, photos of the past and today; diagrams of the climate zone including the rain fall curve over the year and a diagram presenting the flow directions of the system; the water system drawn on the regional scale in relation to the topographical and soil map; the development of the water system over a longer time period, a more technical drawing of the catchment area and the different water compartments; sections and/or diagrams in which the interaction between the water elements, water works, its ecology and the use is explained; a crucial detail which is representative for the system and a conclusion. In the conclusion students summarized their findings of the analyses by transforming general values into specific values. So far we came up with six values.Landscape values: natural landscapes are transformed to cultural landscapes, through transformation the natural landscape is architectonically pronounced and is part of the cultural expression; Strategic values: smart use of the site to achieve maximum profitability with the minimum resources and infrastructures, by taking advantage of natural elements, topographic changes, slopes, river bends...; Functional values: water systems are constructions with simple formal and practical solutions; Material and tangible values: water elements and water works are a source of knowledge of traditional construction techniques, local materials from the surrounding area are used that adapt to climate and lithology, expression of rituals; Values of sustainability and circularity: by using materials of the surroundings and non-polluting materials by using natural local materials. The water is used in the system for different purposes and brought back into the natural circuit;Ethnographic and identity values: to encompass the knowledge of what was the main activities of the region. The process of testing the method made clear that a lot of work is involved, especially for those cases which are situated in countries that do not have open access to data. Sites need to be reconstructed with the help of google earth maps. Computer and analytical skills are needed to process the amount of data. Examples help to figure out the path of the analyses. A description of the method is not enough to get a good result, intensive discussions are needed to improve the drawings. Comparison of cases and ongoing reflection is essential for a valuable outcome of the research, this still needs to be done. For now (march 2019) the material is on display in an exhibition at TU Delft and waits for comments of peers. The new input can help to develop the method further and to come up with more circular traditional water systems that in the end can be published in a book. The graduation LAB is called ‘Circular Water Stories’ but so far we did not manage to work on the story part, since this involves more research, research in which we involve the makers and users of the system and dive into achieves to learn more about its history. Knowledge stored in traditional water systems can inspire spatial, smart and sustainable approaches on water management (Ryu 2012). To design with water, one has to understand the geomorphology of the landscape, the operation of the natural water system and its transformation in order to relate to it. The work of the students proves that the illustrative method can be used regardless of scale, complexity and cultural background of the water system to reveal knowledge on the relation between landscape, water management and people. In general the research on traditional water systems delivers first of all knowledge from the past for sustainable, adaptive water design. For the students the analytical work at this stage delivers tools for their final design-thesis.
- Published
- 2019
12. Semi-automated categorization of open-ended questions
- Author
-
Schonlau, Matthias and Couper, Mick P.
- Subjects
open-ended questions ,multinomial boosting ,qualitative data ,text mining ,uncertainty sampling ,qualitative Methode ,Fragebogen ,Umfrageforschung ,gradient boosting ,Automatisierung ,survey research ,basic research ,0502 economics and business ,Codierung ,data quality ,Datengewinnung ,lcsh:Social sciences (General) ,Social sciences, sociology, anthropology ,automation ,Erhebungstechniken und Analysetechniken der Sozialwissenschaften ,coding ,Sozialwissenschaften, Soziologie ,Datenqualität ,questionnaire ,05 social sciences ,050301 education ,data capture ,Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods ,qualitative method ,development of methods ,Methodenentwicklung ,ddc:300 ,050211 marketing ,lcsh:H1-99 ,0503 education ,Grundlagenforschung - Abstract
Text data from open-ended questions in surveys are difficult to analyze and are frequently ignored. Yet open-ended questions are important because they do not constrain respondents’ answer choices. Where open-ended questions are necessary, sometimes multiple human coders hand-code answers into one of several categories. At the same time, computer scientists have made impressive advances in text mining that may allow automation of such coding. Automated algorithms do not achieve an overall accuracy high enough to entirely replace humans. We categorize open-ended questions soliciting narrative responses using text mining for easy-to-categorize answers and humans for the remainder using expected accuracies to guide the choice of the threshold delineating between “easy” and “hard”. Employing multinomial boosting avoids the common practice of converting machine learning “confidence scores” into pseudo-probabilities. This approach is illustrated with examples from open-ended questions related to respondents’ advice to a patient in a hypothetical dilemma, a follow-up probe related to respondents’ perception of disclosure/privacy risk, and from a question on reasons for quitting smoking from a follow-up survey from the Ontario Smoker’s Helpline. Targeting 80% combined accuracy, we found that 54%-80% of the data could be categorized automatically in research surveys., Survey Research Methods, Vol 10, No 2 (2016)
- Published
- 2016
13. Interviewer Effects in the European Social Survey
- Author
-
Beullens, Koen and Loosveldt, Geert
- Subjects
interviewer effects ,European Social Survey ,multilevel covariance structure analysis ,Interviewer effects ,Forschungsreaktivität ,multilevel covariance ,Umfrageforschung ,Antwortverhalten ,01 natural sciences ,010104 statistics & probability ,survey research ,basic research ,050602 political science & public administration ,data quality ,response behavior ,0101 mathematics ,Datengewinnung ,lcsh:Social sciences (General) ,Social sciences, sociology, anthropology ,Erhebungstechniken und Analysetechniken der Sozialwissenschaften ,Sozialwissenschaften, Soziologie ,Datenqualität ,05 social sciences ,interview ,reactivity effect ,0506 political science ,data capture ,Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods ,development of methods ,Methodenentwicklung ,ddc:300 ,lcsh:H1-99 ,Grundlagenforschung - Abstract
In this paper, we focus on interviewer effects in the European Social Survey, and seek to demonstrate that academic publications seldom take these effects into consideration. An analysis is provided of interviewer effects for 48 continuous items, covering 36 countries in six rounds. The analysis does not only deal with the means of variables. Using multilevel covariance structure analysis, interviewer effects on the relationships between these variables is also assessed. Results indicate that first, countries showing considerable interviewer effects regarding means are also more at risk regarding regression coefficients and second, ignoring interviewer effects leads to an overestimation of the effect size of the relationships between variables and an underestimation of standard errors., Survey Research Methods, Vol 10, No 2 (2016)
- Published
- 2016
14. Helping Respondents Provide Good Answers in Web Surveys
- Author
-
Mick P, Couper and Chan, Zhang
- Subjects
Web survey ,Online-Befragung ,Fragebogen ,Umfrageforschung ,Article ,0504 sociology ,survey research ,basic research ,0502 economics and business ,data quality ,Datengewinnung ,lcsh:Social sciences (General) ,Social sciences, sociology, anthropology ,instrument design ,Erhebungstechniken und Analysetechniken der Sozialwissenschaften ,Internet ,Sozialwissenschaften, Soziologie ,Datenqualität ,questionnaire ,05 social sciences ,050401 social sciences methods ,data capture ,Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods ,development of methods ,Methodenentwicklung ,ddc:300 ,050211 marketing ,online survey ,lcsh:H1-99 ,Grundlagenforschung - Abstract
This paper reports on a series of experiments to explore ways to use the technology of Web surveys to help respondents provide well-formed answers to questions that may be difficult to answer. Specifically, we focus on the use of drop-down or select lists and JavaScript lookup tables as alternatives to open text fields for the collection of information on prescription drugs. The first two experiments were conducted among members of opt-in panels in the U.S. The third experiment was conducted in the 2013 Health and Retirement Study Internet Survey. Respondents in each of the studies were randomly assigned to one of three input methods: text field, drop box, or JavaScript lookup, and asked to provide the names of prescription drugs they were taking. We compare both the quality of answers obtained using the three methods, and the effort (time) taken to provide such answers. We examine differences in performance on the three input format types by key respondent demographics and Internet experience. We discuss some of the technical challenges of implementing complex question types and offer some recommendations for the use of such tools in Web surveys., Survey Research Methods, Vol 10, No 1 (2016)
- Published
- 2016
15. Is there an association between survey characteristics and representativeness? A meta-analysis
- Author
-
Cornesse, Carina, Bosnjak, Michael, Cornesse, Carina, and Bosnjak, Michael
- Abstract
How to achieve survey representativeness is a controversially debated issue in the field of survey methodology. Common questions include whether probability-based samples produce more representative data than nonprobability samples, whether the response rate determines the overall degree of survey representativeness, and which survey modes are effective in generating highly representative data. This meta-analysis contributes to this debate by synthesizing and analyzing the literature on two common measures of survey representativeness (R-Indicators and descriptive benchmark comparisons). Our findings indicate that probability-based samples (compared to nonprobability samples), mixed-mode surveys (compared to single-mode surveys), and other-than-Web modes (compared to Web surveys) are more representative, respectively. In addition, we find that there is a positive association between representativeness and the response rate as well as the number of auxiliary variables used in representativeness assessments. Furthermore, we identify significant gaps in the research literature that we hope might encourage further research in this area.
- Published
- 2018
16. Das unterschätzte Potenzial hoher Fallzahlen – Stärken und Limitierungen des Mikrozensus am Beispiel von Fertilitätsanalysen
- Author
-
Robert Herter-Eschweiler, Linda Lux, Jürgen Dorbritz, and Martin Bujard
- Subjects
Kinderlosigkeit ,Imputationen ,Sociology & anthropology ,sozioökonomische Faktoren ,childlessness ,First birth ,Sozialstruktur ,social structure ,Time pattern ,Mikrozensus ,soziale Faktoren ,Basic research ,empirisch-quantitativ ,Bevölkerung ,Sociology ,fertility ,quantitative empirical ,Sozialwissenschaften, Soziologie ,empirisch ,demographic factors ,Federal republic of germany ,Befragung ,Bundesrepublik Deutschland ,development of methods ,Methodenentwicklung ,Microcensus, quantitative survey, imputations, non-response, fertility, childlessness, social structure ,ddc:300 ,Fruchtbarkeit ,Family Sociology, Sociology of Sexual Behavior ,ddc:301 ,Bildungsniveau ,Schätzung ,Familiensoziologie, Sexualsoziologie ,demographische Faktoren ,medicine.medical_specialty ,Geburtenentwicklung ,socioeconomic factors ,Federal Republic of Germany ,Antwortverhalten ,birth trend ,level of education ,Population Studies, Sociology of Population ,Bildung ,basic research ,medicine ,microcensus ,response behavior ,survey ,Interview ,Datengewinnung ,Social sciences, sociology, anthropology ,social factors ,Erhebungstechniken und Analysetechniken der Sozialwissenschaften ,Gynecology ,Quantitative survey ,lcsh:HQ1-2044 ,estimation ,data capture ,Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods ,Mikrozensus, quantitative Erhebung, Imputationen, Non-Response, Fertilität, Kinderlosigkeit, Sozialstruktur ,Soziologie, Anthropologie ,lcsh:The family. Marriage. Woman ,empirical ,Grundlagenforschung ,Demography - Abstract
The unrecognised potential of large N – Strengths and limitations of the German Microcensus exemplified by fertility research Due to a large number of cases (688.931 persons in 2012) the German Microcensus has a huge potential for analyses in demography and family sociology. Content is further improved by the new voluntary question on biological children of women. This paper aims to systematically assess the methodological background as well as limitations and potentials of the Microcensus using the example of fertility data. The analyses of nonresponse show that the way of questioning has a strong impact. The related bias could, however, be reduced by imputations. The main limitations are the cross-sectional design and missing data on the children of men and internal migration. The potential of the high case numbers of the Microcensus is systematically discussed by analyzing confidence intervals: It allows for in-dept differentiations for analyzing social structure, birth parities and time patterns. Finally, we discuss three research designs which are able to use this potential: Dendrogram analyses allow group differentiations for up to five levels and thus reveal detailed patterns of childlessness. Parity patterns by cohorts illustrate differences by occupational education. Third, the age-specific analyses of first births among several cohorts allow for identifying trends of recuperation which differ considerable between educational groups. Zusammenfassung Aufgrund der hohen Fallzahlen (688.931 Personen in 2012) ist das Potenzial des Mikrozensus (MZ) für demografische und familiensoziologische Analysen groß, zudem inhaltlich durch die Erhebung der Geburten von Frauen noch gestiegen. Der Beitrag hat zum Ziel, methodische Hintergründe, Limitierungen und Potenziale des MZ am Beispiel von Fertilität systematisch aufzuzeigen. Die Analyse von Antwortverweigerungen zeigt, dass die Art der Befragung einen starken Einfluss hat, deren Verzerrungen durch Imputationen deutlich reduziert werden konnten. Die Limitierungen sind v.a. das Querschnittsdesign sowie die fehlenden Daten zur Kinderzahl von Männern und zur Binnenmobilität. Die hohen Fallzahlen des MZ ermöglichen tiefenscharfe Differenzierungen bezüglich Sozialstruktur, Paritäten und Zeitverläufe, was anhand von Konfidenzintervallen diskutiert wird. Drei Forschungsdesigns, die die Analysepotenziale nutzen, werden vorgestellt: Dendrogrammanalysen ermöglichen gruppenspezifische Differenzierungen nach fünf Ebenen und zeigen so ein detailliertes Muster der Kinderlosigkeit. Der Verlauf von Paritätsmustern im Kohortenvergleich verdeutlicht die je nach beruflicher Bildung unterschiedlichen Verläufe. Die Analysen zur altersspezifischen Häufigkeit von Erstgeburten ermöglichen, Trends von nachholenden Geburten für verschiedene Bildungsgruppen zu identifizieren., JFR - Journal of Family Research, Vol 27 No 3 (2015)
- Published
- 2015
17. Kreative medienbiografische Forschung
- Author
-
Baetge, Caroline
- Subjects
Biografieforschung ,Gegenstand ,Bedeutsamkeit ,Method ,Medienpädagogik ,Medien ,Biografie ,Theoriebildung ,Reflexion ,Development of methods ,Theory ,Innovation ,Theory formation ,Media education ,Forschungsmethode ,Media pedagogics ,Koffer ,Biographical Inventories ,Methode ,Studie ,Sozialwissenschaftliche Forschung ,Visualisieren ,Biographies ,Social scientific research ,Methodenentwicklung ,Selbstreflexion ,Research method ,Ranking - Abstract
Der vorliegende Beitrag diskutiert die Relevanz medienbiografischer Forschung in der Medienpädagogik und stellt neue methodische Ansätze vor. Neben den „Standardmethoden“ Biografisches Interview, Medientagebuch und Zeitstrahl werden innovative methodische Zugänge vorgestellt. Visuelle Darstellungsformen wie beispielsweise der Visiograph und haptische wie der Medien-(karten)koffer regen das Erzählen von biografischen Erfahrungen ganzheitlich an, sodass Erinnerungen im Sinne Fritz Schützes umfassender und unmittelbarer reproduziert werden können. Ziel des vorliegenden Beitrages ist es, drei neue methodische Zugänge vorzustellen sowie ihr Potential und mögliche Einsatzgebiete im Kontext medienbezogener sozialwissenschaftlicher Forschung zu diskutieren. Dabei soll kritisch reflektiert werden, ob diese als singuläre, eigenständige Methoden betrachtet werden können. (DIPF/Orig.), This article discusses the relevance of media-biographical research in media education and presents new methodical approaches in the field. In addition to using standard methods such as biographical interviews, media diaries and media timelines, the author also presents further, innovative approaches. Visual forms of representation such as the visiograph, together with haptic methods like the media suitcase or the suitcase of media cards, serve to stimulate a holistic debate about biographical experience, thereby enabling memories to be reproduced more comprehensively and instantaneously in accordance with Fritz Schütze's methodical approach. This article investigates the potential represented by three new methodical approaches as well as their possible areas of application in the field of media-related social science. It also subjects the approaches to critical evaluation in order to examine whether they can be regarded as single, stand-alone methods on a par with existing methods. (DIPF/Orig.)
- Published
- 2018
- Full Text
- View/download PDF
18. How many mailings are enough?
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Vehovar, Vasja, Lozar, Katja, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Vehovar, Vasja, and Lozar, Katja
- Abstract
Gegenstand der Untersuchung ist das Verhältnis von Kosten und Fehlern bei postalischen Umfragen. Zwei Alternativen werden verglichen: eine größere Stichprobe mit wenigen Aussendungswellen und eine kleinere Stichprobe mit mehr Aussendungswellen. Stichprobenfehler und Kostenfunktionen werden am empirischen Beispiel des Internetzugangs slowenischer Firmen berechnet. Eine solche Kalkulation kann sich in der Praxis als nützlich erweisen. (ICEÜbers), "This paper addresses the balance between costs and errors in mail surveys. Two alternatives are compared: a larger sample with less follow-up mailings and a smaller sample with more follow-up mailings. The comparison involves a detailed elaboration of mean squared errors and cost functions. Based on the model, the key variables are discussed. The empirical example refers to the percentage of companies with access to the Internet. It is shown that the above elaboration can be helpful for practical decisions." (author's abstract)
- Published
- 2017
19. Is it true that nonresponse rates in a panel survey increase when supplement surveys are annexed?
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Kantorowitz, Malka, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, and Kantorowitz, Malka
- Abstract
Allgemein geht man davon aus, dass Nonresponse, vor allem Antwortverweigerung, zunimmt, wenn den Befragten eine größere Last auferlegt wird. In diesem Beitrag geht es vor allem um die Frage, wie die Nonresponse-Quote bei einer aktuell durchgeführten Panelstudie von der zusätzlichen Belastung durch eine Ergänzungsbefragung tangiert wird. Die Basis bildet eine Analyse der langfristigen Entwicklung von Nonresponse beim Israeli Labour Force Survey (LFS). Darüber hinaus wird auch nach Einflüssen gefragt, die aus der Art der Datenerhebung oder der Jahreszeit resultieren. Auch die Annahme einer schwindenden Beteiligung über die Wellen der Untersuchung hinweg wird behandelt. (ICEÜbers), "It is usually assumed that there will be an increase in nonresponse, especially for refusals, when a greater burden is imposed an the respondents. The paper deals primarily with the issue relating to how nonresponse rates of a current panel survey are affected by the additional burden arising from appending supplement surveys. A long-term analysis of the nonresponse rates in the Israeli Labour Force Survey (LFS), by main types of nonresponse, is used for this study. At the same time, some other effects are studied, such as that of the mode of data collection and of the season of the year. The assumption of a decrease in the response rates with the number of rounds is examined to a limited extent." (author's abstract)
- Published
- 2017
20. Improving advance letters for major government surveys
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, White, Amanda, Martin, Jean, Bennett, Nikki, Freeth, Stephanie, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, White, Amanda, Martin, Jean, Bennett, Nikki, and Freeth, Stephanie
- Abstract
Die Verfasser berichten über ein Projekt, bei dem es um die Rolle von Briefen mit Vorabinformationen bei größeren staatlichen Umfrageaktionen geht. Kognitive Interviews zeigten, dass in der Regel kurze Briefe favorisiert werden. In einem solchen Brief sollten das Ziel der Untersuchung, der Name der durchführenden Organisation, eine einfach formulierte Zusicherung von Vertraulichkeit sowie Details über den Besuch des Interviewers und den Umgang mit den Untersuchungsergebnissen enthalten sein. Auch die Einschätzung der Interviewer wurde erhoben. Auf dieser Basis wurde die Vorabinformation neu formuliert. Im Rahmen des Family Resources Survey wurden drei Gruppen gebildet, von denen eine das ursprüngliche Anschreiben, eine das neue Anschreiben und eine das neue Anschreiben mit zusätzlichem Flugblatt erhielt. Verglichen mit dem Original war das Antwortverhalten bei den Empfängern des neuen Anschreibens leicht verbessert, während sich bei der dritten Gruppe keine Änderung gegenüber den Empfängern des Originals ergab. (ICEÜbers), "This paper reports the latest results in a project examining the role of the advance letter in major government surveys. Results of cognitive interviews with members of the public showed that subjects preferred short letters. They wanted the letter to include the purpose of the survey, the name of the survey organisation, a simple statement about confidentiality, details of the interviewer's visit, and post survey results. Interviewers' views were sought using focus groups. Results from these stages were used to redesign the advance letters of the surveys. A three way split sample experiment was carried out on the Family Resources Survey, original letter versus new letter versus new letter plus leaflet. Preliminary results showed that response rates were slightly higher for the new letter compared to the original, but the new letter plus the leaflet did not show much of an increase an the original." (author's abstract)
- Published
- 2017
21. Assessment of efforts to reduce nonresponse bias: 1996 Survey of Income and Program Participation (SIPP)
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Waite, Preston Jay, Huggins, Vicki J., Mack, Stephen P., Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Waite, Preston Jay, Huggins, Vicki J., and Mack, Stephen P.
- Abstract
Im Vorfeld der neuen Welle des SIPP 1996 tauchten Bedenken in Hinblick auf eine zunehmende Tendenz zur Antwortverweigerung in den Panelwellen der Jahre 1991 bis 1993 auf. Gleichzeitig wurde die Existenz eines Bias in den SIPP-Zeitreihenschätzungen zu Armut bekannt. Das US Census Bureau hat viel Zeit und Geld darauf verwandt, den Anteil der Antwortverweigerung zu reduzieren und die hierauf beruhende Fehlgewichtung zu korrigieren. Die Verfasser geben einen Überblick über diese Maßnahmen und diskutieren deren Wirksamkeit mit Blick auf das erste Jahr der Panelwelle 1996. Sie setzen sich mit dem Einsatz finanzieller Anreize, der Durchführung von Untersuchungen zur Antwortverweigerung sowie Veränderungen in der Durchführung der Feldforschung auseinander. (ICEÜbers), "Concern over increasing levels of nonresponse in the 1991-1993 SIPP Panels and new information about the existence of bias in time series estimates of poverty front the SIPP surfaced prior to fielding the newly redesigned SIPP 1996 sample. A tremendous amount of effort and expense has been dedicated by the U.S. Census Bureau to reducing nonresponse and adjusting for its bias. This paper will summarize these efforts and provide a preliminary assessment of the success of the efforts for the first year of the 1996 panel. The authors will discuss the use of monetary incentives, fielding nonresponse surveys, and changes in field staffing and procedures." (author's abstract)
- Published
- 2017
22. An evaluation of unit nonresponse bias in the Italian Households Budget Survey
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Ceccarelli, Claudio, Coccia, Giuliana, Crescenzi, Fabio, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Ceccarelli, Claudio, Coccia, Giuliana, and Crescenzi, Fabio
- Abstract
Die Auswirkungen von Antwortverweigerung sind in der Literatur zur Umfrageforschung vielfach diskutiert worden. Antwortverweigerung führt zu einer Erhöhung der Stichprobenvarianz, deren Ausmaß über die Schätzung der durch Antwortverweigerung verursachten Verzerrung gemessen werden kann. Wenn Befragte nur unvollkommen kooperieren, führt dies zu ungenauen oder unvollständigen Informationen, die nicht zum Zweck einer Schätzung herangezogen werden können. Istat streicht seit 1991 alle Haushalte mit inkompatiblen Daten für Ausgaben und Einkommen aus seiner Stichprobe. Die Verfasser bezeichnen diese Gruppe als "unzuverlässige Respondenten". Solche Daten eignen sich zwar nicht für Schätzungen, sie erlauben jedoch Rückschlüsse auf die Gruppe der Antwortverweigerer. Dem liegt die Annahme zu Grunde, dass die Gruppe der unzuverlässigen Respondenten eher der Gruppe der Antwortverweigerer ähnelt als der Gruppe der Antwortenden. Die Verfasser berichten über den Versuch, den durch Antwortverweigerung entstandenen Bias im Italian Household Budget Survey 1995 zu bestimmen. Hierzu wurde keine gesonderte Untersuchung der Nonrespondenten durchgeführt. (ICEÜbers), "The effect of nonresponse is a crucial aspect which has received considerable attention in literature. Nonresponse causes an increase in sampling variance and the estimates of units nonresponse bias are useful to give a concrete measure of this increase. Scarce co-operation of respondents gives inaccurate or incomplete information, and this part of the answers can't be used in the estimation. Since 1991, Istat erases from its sample file all households with incompatible data on expenditure and income. The authors call this the 'UR (Unreliable Respondents) sub population'. UR data can't be used to build estimates, but can be used to give approximate information an NR. The idea is that, concerning behaviour, the NR population is more similar to UR than to R. The results of an attempt to evaluate unit nonresponse bias in the 1995 Italien Household Budget Survey (HBS) are shown in this paper. These results were obtained without performing a specific survey on nonrespondents." (author's abstract)
- Published
- 2017
23. Current issues in household survey nonresponse at Statistics Canada
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Swain, Larry, Dolson, David, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Swain, Larry, and Dolson, David
- Abstract
Die Verfasser informieren über eine Vielzahl aktueller Initiativen und Untersuchungen in Bezug auf Antwortverweigerung bei Haushaltsbefragungen (Querschnitt und Längsschnitt), die von Statistics Canada durchgeführt wurden. Zu den behandelten Untersuchungen zählen der Labour Force Survey (LFS) und die auf dem LFS basierenden weiteren Untersuchungen, der General Social Survey und mehrere gesondert durchgeführte Haushaltsbefragungen. Die Verfasser fragen nach Determinanten der Teilnahmebereitschaft sowie nach Möglichkeiten, positiv auf diese einzuwirken. Sie stellen zudem Techniken zur Auswahlfehlerkorrektur vor. (ICEÜbers), "A variety of current and recent initiatives and studies related to unit nonresponse for both cross-sectional and longitudinal household surveys at Statistics Canada is presented. Surveys discussed include the Labour Force Survey (LFS), supplementary and longitudinal surveys based an the LFS frame, the General Social Survey, and several household surveys carried out as special surveys. Factors influencing response and initiatives taken to maintain and maximize response are then reviewed. The next sections present adjustment techniques and a summary of the major themes discussed in the paper." (author's abstract)
- Published
- 2017
24. Understanding household survey nonresponse through geo-demographic coding schemes
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, King, John, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, and King, John
- Abstract
Zur Analyse des Antwortverhaltens bei einer groß angelegten Haushaltsbefragung wurde ein geo-demographisches Codierungssystem eingesetzt. Damit lag ein Indikator des Antwortverhaltens vor, der auf Größen außerhalb der betreffenden Befragung basierte. Auf der Basis der durch die geo-demographische Codierung zur Verfügung gestellten Informationen ist eine Beschreibung der Antwortverweigerer möglich. Diese Informationen lassen sich auch zur Beseitigung von Problemen bei der Feldarbeit einsetzen. (ICEÜbers), "A geo-demographic coding system was used to analyse response to a large household survey. This provided a contemporaneous indicator of response and of nonresponse to the survey using terms external to the survey. Geo-demographic coding information is used to describe the non-respondents to the survey. Use of this information for reducing some fieldwork problems is also indicated." (author's abstract)
- Published
- 2017
25. Promised incentives on a random digit dial survey
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Cantor, David, Allen, Bruce, Cunningham, Patricia, Brick, J. Michael, Slobasky, Renee, Giambo, Pamela, Kenny, Genevieve, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Cantor, David, Allen, Bruce, Cunningham, Patricia, Brick, J. Michael, Slobasky, Renee, Giambo, Pamela, and Kenny, Genevieve
- Abstract
Die Verfasser legen die Ergebnisse von zwei Experimenten vor, mit denen die Wirkung von versprochenen Belohnungen bei einer Random-Digit-Dial-Untersuchung im Stadium der Gesprächseröffnung sowie im Stadium der Aufgabe einer anfänglichen Verweigerungshaltung untersucht werden sollte. In beiden Fällen zeigte sich kein Effekt. Dieses Ergebnis steht im Widerspruch zu mindestens einem weiteren Experiment aus jüngster Zeit sowie auch zum Einsatz versprochener Belohnungen zur Reduktion von Antwortverweigerung bei mehreren Meinungsforschungsinstituten. Die Verfasser diskutieren mögliche Ursachen für das Ausbleiben eines Effekts. (ICEÜbers), "This paper presents the results of two experiments carried out to test the effectiveness of promised incentives for a random digit dial survey (RDD) at the initial household contact (introduction) and at the stage of refusal conversion. The results of the experiments find no effect of at either stage of the survey process. These results are contrary to those found by at least one other recent experiment, as well as the use of promised incentives used routinely to convert reluctant respondents by several survey organizations. The possible reasons for not finding an effect are discussed." (author's abstract)
- Published
- 2017
26. Response distributions when TDE is introduced
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Lindström, Hakan L., Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, and Lindström, Hakan L.
- Abstract
Statistics Sweden benutzt Touch-tone Data Entry (TDE) zur Datenerhebung im Rahmen von drei Untersuchungen: Index der Herstellerpreise (PPI), Kurzfristige Umsatzstatistik für den inländischen Handels- und Dienstleistungssektor (STS), Statistik der kommunalen Aufwendungen für Sozialhilfe (MCSA). PPI wird monatlich erstellt, MCSA vierteljährlich, STS liegt sowohl monatlich wie vierteljährlich vor. Alle drei Erhebungen haben verpflichtenden Charakter. Der Einführung von TDE bei PPI ging ein groß angelegtes Experiment voran. Auch für STS und MCSA wurden methodische Untersuchungen durchgeführt. Der Verfasser zeigt, wie sich TDE und Antwortverhalten im Zeitverlauf entwickelt haben und inwieweit sich die Untersuchungen verschiedener Methoden bedienen. Darüber hinaus diskutiert er Gründe für das unterschiedliche Antwortverhalten bei TDE. Bei diesem Bericht handelt es sich um die Kurzfassung eines Berichts für Statistics Sweden, der genaue Daten für MCSA und die monatlichen Antwortverteilungen für 1997 präsentieren wird. (ICEÜbers), "Three surveys at Statistics Sweden use Touch-tone Data Entry (TDE) for their data collection: Producers Price Index (PPI), Short-term Turnover Statistics for Domestic Trade and Services (STS), and Statistics an Municipalities' Costs for Social Assistance (MCSA). PPI is a monthly survey, MCSA is a quarterly and STS has both monthly and quarterly parts. MCSA is a census and the two other surveys use the same sample each month during the year. All three are mandatory surveys. The TDE implementation in PPI was preceded by a large experiment. Methodological studies were also made in STS and MCSA. Details are given to show the development of TDE and overall response rates over time and to what extent the surveys have turned into multimode surveys. The TDE response rates differ in these surveys. This report presents the differences and offers some explanations to them. It is a condensed version of a report written for Statistics Sweden. The complete report will-include the details of MCSA and response distributions for all months of 1997." (author's abstract)
- Published
- 2017
27. Fighting nonresponse in telephone interviews: successful interviewer tactics
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Hox, Joop, Leeuw, Edith de, Snijkers, Ger, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Hox, Joop, Leeuw, Edith de, and Snijkers, Ger
- Abstract
Bei Telephoninterviews haben Interviewer weitaus weniger Zeit als in face-to-face-Interviews, einen Befragten zur Kooperation zubringen. Da sie ihren Gesprächspartner nur hören können, fehlt es ihnen auch an Informationen, um sich selbst optimal zu verhalten. Gleichwohl verfügen erfahrene Telephoninterviewer über einen Vorrat an taktischen Varianten, die sie einsetzen können. In diesem Beitrag werden Taktiken beschrieben, mit denen sich Antwortverweigerung bekämpfen lässt und die von erfahrenen Telephoninterviewern bei Statistics Netherlands angewandt werden. (ICEÜbers), "In telephone interviews interviewers have far less time to persuade sampling units to cooperate than in a face-to-face interview. Furthermore, they also have less information to tailor their behaviour due to the limited channel capacity of the telephone. Nevertheless, experienced telephone interviewers have a 'tool box' of tactics, which they apply expertly. In this paper we describe the tactics to fight nonresponse as reported by experienced telephone interviewers at Statistics Netherlands." (author's abstract)
- Published
- 2017
28. The effect of interviewer persuasion strategies on refusal rates in household surveys
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Sturgis, Patrick, Campanelli, Pamela, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Sturgis, Patrick, and Campanelli, Pamela
- Abstract
Die Verfasser fragen danach, in welchem Umfang Antwortverweigerungen bei großangelegten Haushaltsbefragungen reduziert werden können. Die Grundlage bieten Tonbandaufnahmen von über 300 Gesprächen an der Wohnungstür, die von zwei Meinungsforschungsinstituten zur Verfügung gestellt wurden. Diese Gespräche wurden nach dem Ausmaß der Ablehnung klassifiziert, das die Befragten an den Tag legten, sowie nach den damit zusammenhängenden Möglichkeiten des Interviewers, seine Interaktionskompetenz und Überzeugungskraft auszuspielen. Wo es sowohl Ablehnung seitens des zu Befragenden als auch Spielraum für den Interviewer gab, wurden die von den Interviewern angewandten Taktiken verglichen, wobei zwischen erfolgreichen (Kooperation) und nicht erfolgreichen (Antwortverweigerung) Gesprächen differenziert wurde. Die Verfasser diskutieren unterschiedliche Interaktionstypen und erörtern die Möglichkeit einer Reduzierung der Verweigerungsquote, wenn Interviewer in der Anwendung bestimmter Taktiken für Gespräche an der Wohnungstür geschult werden. (ICEÜbers), "The analysis focuses an the extent to which there is scope for reducing rates of refusal an large-scale household surveys below current standard levels. Our data consisted of over 300 tape-recorded doorstep interactions, drawn from substantive surveys at two different organisations. Tape-recorded interactions were classified in terms of the degree of reluctance expressed by the respondent and the consequent scope for the interviewer to deploy interpersonal skills and persuasion. Interactions where there was both reluctance and scope for persuasion were classified according to whether they resulted in cooperation or refusal and the interviewer tactics associated with the two types of outcome were compared. Conclusions are drawn about the prevalence of different types of interaction and the scope for reducing refusal rates through training interviewers to use techniques likely to minimise refusals an the doorstep." (author's abstract)
- Published
- 2017
29. The impact of nonresponse on the unemployment rate in the Current Population Survey (CPS)
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Tucker, Clyde, Harris-Kojetin, Brian A., Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Tucker, Clyde, and Harris-Kojetin, Brian A.
- Abstract
Gegenstand der Untersuchung sind CPS-Daten für alle Monate zwischen Januar 1994 und Juni 1997. Dabei wurden auch Antwortverweigerung und -ausfälle untersucht, um den Wechsel von Personen von der Nicht-Beteiligung zur Beteiligung am CPS und die Auswirkungen auf die Schätzung des Erwerbspersonenpotenzials zu untersuchen. Personen, die sich in einem Monat nicht am CPS beteiligten, wiesen höhere Quoten bei Arbeitslosigkeit, Erwerbsbeteiligung und Beschäftigung auf als Befragte, die sich in zwei aufeinander folgenden Monaten an der Umfrage beteiligten. Es traten auch - wenn auch in geringem Umfang - signifikante positive Korrelationen zwischen den Unterschieden in den Arbeitslosenquoten und der Antwortverweigerung insgesamt im Rahmen des CPS zu Tage. Zudem wurden Unterschiede hinsichtlich bestimmter Merkmale der Erwerbstätigkeit zwischen Antwortverweigerern und Nichtangetroffenen sichtbar. (ICEÜbers), "In the present research authors matched CPS data from all consecutive months from January, 1994 to June, 1997 and conducted an analysis similar to a gross flows analysis that included nonrespondents to examine the 'flow' of persons from respondent to nonrespondent status in the CPS and the resulting effect an labor force estimates. Persons who were nonrespondents to the CPS one month had higher rates of unemployment, labor force participation, and employment than those who were respondents both months. There were also moderate, but significant positive correlations between the differences an unemployment rates and the overall level of nonresponse in the CPS. There were also some differences in labor force characteristics between refusals and noncontacts." (author's abstract)
- Published
- 2017
30. Nonresponse in the 1996 income survey (supplement to the microcensus)
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Havasi, Eva, Marton, Adam, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Havasi, Eva, and Marton, Adam
- Abstract
Einkommensstudie: ergänzender freiwilliger Fragebogen für ein Viertel des Mikrozensus vom April 1996, 18117 Haushalte, 16% Verweigerer (2988). Die eine Beteiligung verweigernden Haushalte sind nicht zufallsverteilt. Vielmehr weisen einige im Rahmen des Mikrozensus erhobenen Merkmale eine Verbindung mit Antwortverweigerung auf. Vor allem das Qualifikationsniveau des Haushaltsvorstands und regionale Faktoren sind für das Antwortverhalten aussagekräftig. Ältere Haushalte auf dem Land mit niedrigem Einkommen und niedrigem Qualifikationsniveau weisen eine höhere Beteiligung an der Befragung auf, während in Budapest, vor allem in den Gruppen mit hohem Einkommen und hoher Qualifikation, die Quote der Antwortverweigerer hoch ist. (ICEÜbers), "Income survey: supplementary voluntary questionnaire to the randomly selected one quarter of the April 1996 microcensus, 18.117 households, 16% (2.988) refusals. The characteristics of the households which refused to answer the income survey (they are not randomly distributed) were carefully studied The most important results and measures which were done to reduce the bias are presented. A substantial number of census variables for households were found to be associated with nonresponse. The characteristics most strongly associated with Income Survey response rate were the qualification level of head of household and the type of region. Higher response rate was found in the countryside among the older households with low income and low qualification and high refusal rate in Budapest, mainly in high income groups with high qualification level, as well." (author's abstract)
- Published
- 2017
31. Aspects concerning data fusion techniques
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Rässler, Susanne, Fleischer, Karlheinz, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Rässler, Susanne, and Fleischer, Karlheinz
- Abstract
Mit Techniken der Datenfusion lassen sich Datensätze aus unterschiedlichen Stichproben auf der Basis gemeinsamer Variablen mit Hilfe des statistischen Matchings verschmelzen. So entsteht eine virtuelle Stichprobe, die zwar vollständig, aber künstlich geschaffen ist. Fehlen in einer Stichprobe Informationen über ein Individuum, so werden sie auf der Basis der Daten eines anderen, sehr ähnlichen Individuums aus einer anderen Stichprobe abgeleitet. Die Verfasser diskutieren die Möglichkeiten der Datenfusionstechniken und stellen Parameter der Verteilung aller Variablen in der künstlichen Stichprobe auf. Von Interesse ist dabei besonders die Korrelation von nicht gemeinsam beobachteten Variablen, die nur mit Hilfe des Matchings geschätzt werden können. Simulationsstudien beschäftigen sich zudem mit den Einflüssen von nearest neighbour matches, sogenannten "Heiratsprozessen" und kleinen Stichprobenumfängen. (ICEÜbers), "Data fusion techniques merge data sets of different survey samples by means of statistical matching an the basis of common variables. As a result a virtual sample of complete, but artificial nature is generated. Because being completely unobserved, the missing information of an individual in one sample is imputed using the observed data values of some individual which is found to be most similar in the other sample. The power of data fusion techniques is analysed and the parameters of the distributions of all variables in the artificial sample are formulated. The correlation between variables not jointly observed, which can only be estimated by means of the matched file, is of main interest herein. Furthermore the influences of nearest neighbour matches, several so-called marriage processes, and small sample sizes are the focus of simulation studies." (author's abstract)
- Published
- 2017
32. Handling of household and item nonresponse in surveys
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Singh, Rajendra P., Petroni, Rita J., Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Singh, Rajendra P., and Petroni, Rita J.
- Abstract
Für den Zensus 2000 wird das US Census Bureau eine Stichprobe zur Qualitätsprüfung auswählen (auch bekannt als integrated coverage measurement oder ICM), die die Schätzungen des Zensus verbessern soll. Die ICM-Stichprobe wird durch fehlende Daten aufgrund von Antwortverweigerung der befragten Haushalte oder Antwortverweigerung auf einzelne Fragen beeinflusst. Der Verfasser diskutiert alternative Methoden zur Berücksichtigung von Antwortverweigerung in der ICM-Stichprobe. Hierzu zählen folgende Vorgehensweisen: (1) keine Korrektur bei Antwortverweigerung durch Haushalte und keine Ableitung von Items; (2) Korrektur bei Antwortverweigerung durch Haushalte auf der Basis der Zensus-Kurzcharakteristiken; (3) Ersatz fehlender ICM-Items durch Zensusdaten; (4) Hot-Deck-Ableitungsverfahren. (ICEÜbers), "For the 2000 Census, the U.S. Census Bureau will select a quality check, also known as integrated coverage measurement (ICM), sample to improve Census estimates. The ICM sample is subject to missing data due to household and item nonresponse. This paper discusses alternative methods researched to deal with nonresponse in the ICM sample. These methods include no adjustment for household nonresponse and no item imputation, use of Census short form characteristics to perform household nonresponse adjustment, substitution of Census data for ICM missing items, and alternative hot deck imputation procedures." (author's abstract)
- Published
- 2017
33. Comparing wealth - data quality of the HFCS
- Author
-
Tiefensee, Anita, Grabka, Markus M., Tiefensee, Anita, and Grabka, Markus M.
- Abstract
"The Household Finance and Consumption Survey (HFCS) provides information about household wealth (real and financial assets as well as liabilities) from 15 Euro-countries around the year 2010 (first wave). The survey will be the central dataset in this topic in the future. However, several aspects point to potential methodological constraints regarding cross-country comparability. Therefore the aim of this paper is to get a better insight in the data quality of this important data source. The framework for our analysis is the 'Guidelines for Micro Statistics on Household Wealth' from the OECD (2013). We have two main focuses: First, we present a synopsis of cross-country differences, which is the core of the paper. We compare the sampling processes, the interview modes, the oversampling techniques, the unit and item non-response rates and how it is dealt with them via weighting and imputation as well as further points which might restrict cross-country comparability of net wealth. We classify the individual country behavior and evaluate the impact on net wealth. Second, we give a first insight in the selectivity of item non-response in a cross-national setting. We make use of logit models to identify differences in characteristics as well as item non-response patterns across countries." (author's abstract)
- Published
- 2017
34. Interviewer effects in the European Social Survey
- Author
-
Beullens, Koen, Loosveldt, Geert, Beullens, Koen, and Loosveldt, Geert
- Abstract
"In this paper, we focus on interviewer effects in the European Social Survey, and seek to demonstrate that academic publications seldom take these effects into consideration. An analysis is provided of interviewer effects for 48 continuous items, covering 36 countries in six rounds. The analysis does not only deal with the means of variables. Using multilevel covariance structure analysis, interviewer effects on the relationships between these variables is also assessed. Results indicate that first, countries showing considerable interviewer effects regarding means are also more at risk regarding regression coefficients and second, ignoring interviewer effects leads to an overestimation of the effect size of the relationships between variables and an underestimation of standard errors." (author's abstract)
- Published
- 2017
35. A conditional minimax estimator for treating nonresponse
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Gabler, Siegfried, Häder, Sabine, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Gabler, Siegfried, and Häder, Sabine
- Abstract
Ausfälle auf Grund von Antwortverweigerung können in Stichproben zu systematischen Verzerrungen führen, die wiederum verzerrte Schätzungen verursachen. Gewöhnlich wird dieser Bias durch die Korrektur der Netto-Stichprobe mit Hilfe bekannter Bevölkerungsdaten behoben. Hier wird ein anderer Ansatz vorgeschlagen. Wenn für jedes Individuum aus der Brutto-Stichprobe weitere Informationen vorliegen, wird die Netto-Stichprobe an die Brutto-Stichprobe angepasst. Gegenüber dem üblichen Verfahren hat diese Methode den Vorteil, dass jedes Element der Netto-Stichprobe ein eigenes Gewicht bekommen kann. Zur Konstruktion dieser Gewichte wird auf das bedingte Minimax-Prinzip zurückgegriffen. Dabei werden die optimalen Gewichte unter Berücksichtigung der ausgewählten Netto-Stichprobe bestimmt, was den maximalen Verlust unter der Annahme minimiert, dass eine bestimmte Varianz der unbekannten Bevölkerungswerte in der Brutto-Stichprobe endlich ist. Die Auswirkungen dieses Gewichtungsverfahrens werden am Beispiel der deutschen ALLBUS 1996 dargestellt. (ICEÜbers), "Losses due to nonresponse may lead to systematic biases in the samples which result in biased estimates. A usual way to compensate for this bias is the adjustment of the net sample to known population data. We choose another approach. If auxiliary information is available for each individual of the gross sample we adjust the net sample to the gross sample. The advantage is - in contrast to the usual post-stratification - that each element of the net sample may get an 'own' weight. For the construction of these weights the conditional minimax principle is applied It determines optimal weights conditional an the selected net sample which minimizes the maximal loss under the assumption that a certain variance of the unknown population values in the gross sample is finite. The effects of our weighting procedure are shown for data of the German General Social Survey (ALLBUS) 1996." (author's abstract)
- Published
- 2017
36. Semi-automated categorization of open-ended questions
- Author
-
Schonlau, Matthias, Couper, Mick P., Schonlau, Matthias, and Couper, Mick P.
- Abstract
"Text data from open-ended questions in surveys are difficult to analyze and are frequently ignored. Yet open-ended questions are important because they do not constrain respondents' answer choices. Where open-ended questions are necessary, sometimes multiple human coders hand-code answers into one of several categories. At the same time, computer scientists have made impressive advances in text mining that may allow automation of such coding. Automated algorithms do not achieve an overall accuracy high enough to entirely replace humans. We categorize open-ended questions soliciting narrative responses using text mining for easy-to-categorize answers and humans for the remainder using expected accuracies to guide the choice of the threshold delineating between 'easy' and 'hard'. Employing multinomial boosting avoids the common practice of converting machine learning 'confidence scores' into pseudo-probabilities. This approach is illustrated with examples from open-ended questions related to respondents’ advice to a patient in a hypothetical dilemma, a follow-up probe related to respondents' perception of disclosure/privacy risk, and from a question on reasons for quitting smoking from a follow-up survey from the Ontario Smoker's Helpline. Targeting 80% combined accuracy, we found that 54%-80% of the data could be categorized automatically in research surveys." (author's abstract)
- Published
- 2017
37. An exploration of proxy- and self-reported adolescent health in low-resource settings
- Author
-
Nolan, Laura B. and Nolan, Laura B.
- Abstract
"Proxy reports in survey research are widely used when the index individual is unavailable or somehow incapacitated by age or disability. Proxy reports are plagued by concerns about accuracy, however, and self-reports are generally preferred when objective measurement is not possible. This paper uses the Young Lives Study of International Child Poverty to assess the validity and utility of adolescent self-reported health (SRH) and the conventional parent's proxy report. Using multivariate regression models and the framework of convergent validity, I find evidence for the validity of both proxy and self-reports, although proxy reports appear to be slightly more robustly associated with available physical health information. Exploratory multiple imputation simulations suggest that researchers should request both proxy and self-reports in household surveys; having both substantially improves the imputation of one if it is missing or implausible. Along with a moderate correlation between the two reports, these results suggest that proxy and self-reports of adolescent's general health status are not interchangeable and may complement one another." (author's abstract)
- Published
- 2017
38. Adaptive survey designs for nonresponse and measurement error in multi-purpose surveys
- Author
-
Calinescu, Melania, Schouten, Barry, Calinescu, Melania, and Schouten, Barry
- Abstract
"Recently, survey methodology literature has put forward responsive and adaptive survey designs as means to make efficient tradeoffs between survey quality and survey costs. The designs, however, restrict quality-cost assessments to nonresponse error, while there are various design features that impact also measurement error, e.g. the survey mode, the type of questionnaire (long or condensed) and the type of reporting (self or proxy). Extension of adaptive survey design to measurement error is, however, not straightforward when a survey has many and diverse survey items. An adaptive survey design needs to make an overall choice of design features that applies to all survey items simultaneously. In this paper, we investigate adaptive survey designs that account for both nonresponse and measurement error. In order to do so, we model the underlying causes for differences in measurement error between design features. This leads to response styles or response latencies. We tailor efforts so that either response style propensities are minimized or constrained. We illustrate the ideas with a case study on the 2008 Dutch Labor Force Survey. The design features in this study are the type of reporting (self-reporting only versus proxy-reporting allowed), and the number of face-to-face calls." (author's abstract)
- Published
- 2017
39. Conducting cross-national and cross-cultural surveys: papers from the 2005 meeting of the international workshop on Comparative Survey Design and Implementation (CSDI)
- Author
-
Harkness, Janet, GESIS-ZUMA, Harkness, Janet, and GESIS-ZUMA
- Abstract
"The papers in this volume stem from the third annual meeting of the InternationalWorkshop on Comparative Survey Design and Implementation (CSDI). Initiated in 2002, the Workshop developed out of cross-cultural symposia held at ZUMA throughout thenineteen nineties. One of CSDI's primary goals is to promote research intomethodological issues of particular and sometimes unique salience for cross-cultural andcross-national survey research. The seven papers are good illustrations of the broad spectrum of research fields in whichCSDI researchers are engaged. The volume begins and ends with two framework papers,the first discussing what makes cross-national research special, the last on where we beginto draw boundaries between entities to be compared in 'comparative' research. The fiveremaining papers discuss (in order of the volume): the rich information available from themultinational European Social Survey on data collection; socio-demographic measurementand comparability in the cross-national context, again with reference to the EuropeanSocial Survey; cognitive pre-testing of translated questionnaires; communicativeissues across cultures in telephone interviews; and preliminary work on guidelines onusing interpreters underway at the U.S. Census Bureau. The last-mentioned papers reflectresearch concerns in U.S. cross-cultural context." (author's abstract). Contents: Peter Lynn, Lilli Japec, Lars Lyberg: What's so special about cross-national surveys? (7-20); Achim Koch, Michael Blohm: Fieldwork details in the European Social Survey 2002/2003 (21-52); Uwe Warner, Jürgen H.P. Hoffmeyer-Zlotnik: Discussion of the income measure in the European Social Survey: a proposal of revised survey questions about the "total net household income" (53-66); Patricia L. Goerman: An examination of pretesting methods for multicultural, multilingual surveys: the use of cognitive interviews to test Spanish instruments (67-80); Brian Kleiner, Yuling Pan: Cross-cultural communication and the
- Published
- 2017
40. Regression-based nearest neighbour hot decking
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Laaksonen, Seppo, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, and Laaksonen, Seppo
- Abstract
Der Verfasser entwickelt eine Methode der Ableitung, die sowohl auf einem multivariaten Regressionsmodell als auch auf einem "nearest neighbour hot decking" beruht. Er wendet diese Methode erfolgreich auf eine ratioskalierte Variable an, die aus einer hohen Zahl unbekannter Nullwerte besteht. Die so erhaltenen Ergebnisse werden mit Ergebnissen verglichen, die vermittels random hot decking berechnet wurden. Der Verfasser versucht darüber hinaus, Varianzen zu schätzen, die die Tatsache berücksichtigen, dass einige Daten abgeleitet sind. Diese Methode führt zu einer zusätzlichen Komponente der Varianz, die als Ableitungsvarianz bezeichnet wird. Im ersten Teil des Beitrags werden Ableitungsmethoden und -strategien im allgemeinen diskutiert. Der Verfasser entwickelt auch einen diagnostischen Test für die Qualität von Ableitungen. Dieser Test überprüft, wie oft dieselbe Quelle zur Ableitung fehlender Werte verwandt wird. (ICEÜbers), "The paper develops the imputation method which takes advantage both of a multivariate regression model and a nearest neighbour hot decking method. This method is successfully applied to a ratio-scale variable which consists of a high number of non-known zero values. The results obtained by means of the method are compared with those obtained by random hot decking. The paper also makes an attempt to estimate variances which take into account the fact that some data are imputed. This method provides an additional variance component, called imputation variance. In the first part of the paper, imputation methods and imputation strategies are discussed more generally. The paper also develops a diagnostic test for the quality of imputations; this test checks how many times the same donor is used in imputing missing values." (author's abstract)
- Published
- 2017
41. Does the payment of incentives create expectation effects?
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Singer, Eleanor, Hoewyk, John van, Maher, Mary P., Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Singer, Eleanor, Hoewyk, John van, and Maher, Mary P.
- Abstract
Die Tendenz, Befragte für ihre Teilnahme an Umfragen zu bezahlen, lässt verschiedene nicht intendierte Folgen befürchten, so die Erwartung zukünftiger Zahlungen und die Möglichkeit einer Verschlechterung der Antwortqualität. Die Ergebnisse dieser Untersuchung sind eher beruhigend, was diese beiden Punkte angeht. Zwar stimmen Befragte, die schon einmal für ihre Teilnahme an einer Umfrage bezahlt worden sind, häufiger dem Statement "Man sollte für die Teilnahme an solchen Umfragen bezahlt werden" zu, sie beteiligen sich jedoch auch ohne weitere Zahlungen überdurchschnittlich oft an weiteren Untersuchungen. Befragte, die vor sechs Monaten eine Zahlung erhielten, verweigern die Beantwortung einer Batterie von achtzehn Fragen über diese Untersuchung nicht mit höherer Wahrscheinlichkeit als Befragte, die keine Zahlung erhielten. Darüber hinaus äußern sie häufiger positive Einstellungen zum Nutzen von "Untersuchungen wie dieser". Es ist jedoch noch zu untersuchen, in wie weit diese Ergebnisse verallgemeinerbar sind. (ICEÜbers), "Increasing use of incentive payments to survey respondents raises the threat of several unintended consequences, among them the creation of expectations for future payments and the possibility of a deterioration in the quality of response. The findings from the present study are somewhat reassuring with respect to both of these unintended outcomes. Although people who have received a monetary incentive in the past are significantly more likely to agree that 'people should be paid for doing surveys like this', they are also more likely to participate in a subsequent survey, in spite of receiving no further payments. And respondents who received an incentive six months earlier are no more likely than those who received no incentive to refuse to answer (or to answer don't know to) a series of eighteen key questions an the survey. Furthermore, they are more likely than other respondents to express favourable attitudes toward the usefulness of 'surveys like this'. The generality of these findings, however, needs much further testing." (author's abstract)
- Published
- 2017
42. Interviewer opinions, attitudes and strategies regarding survey participation and their effect on response
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Leeuw, Edith de, Hox, Joop, Snijkers, Ger, Heer, Wim de, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Leeuw, Edith de, Hox, Joop, Snijkers, Ger, and Heer, Wim de
- Abstract
Antwortverweigerung stellt eine Bedrohung für die Gültigkeit von Schlussfolgerungen dar, die auf der Basis von Umfragedaten gezogen werden. Im allgemeinen werden hier zwei Gegenstrategien eingesetzt. Die erste Strategie besteht darin, den Anteil der Antwortverweigerer soweit wie möglich zu reduzieren, die zweite Strategie versucht eine statistische Fehlerkorrektur der Antwortverweigerung. Umfragen sind in der amtlichen Statistik, in den Sozialwissenschaften und in der Marktforschung in den Niederlanden immer noch an der Tagesordnung, und Interviewer stellen im Kampf gegen Antwortverweigerung einen wichtigen Faktor dar. Die Verfasser fragen nach der Einstellung von Interviewern zu Antwortverweigerung und zu deren eigener Rolle, wenn es darum geht, Menschen für ein Interview zu gewinnen. Statistics Netherlands hat ein Projekt zur Überarbeitung der fortlaufenden Untersuchung der Lebensverhältnisse (POLS) durchgeführt. In diesem Zusammenhang wurden auch Daten über die Interviewer erhoben. Es zeigt sich, dass die Einstellung der Interviewer und die Antwortquote korrelieren. Interviewer mit einer positiven Einstellung zu Strategien der Überzeugung von zu Befragenden weisen eine höhere Antwortquote auf. Hinsichtlich der von den Interviewern beschriebenen Verhaltensmuster "an der Haustür" ergeben sich keine Unterschiede. (ICEÜbers), "Nonresponse is a threat to the validity of conclusions based an survey data. In general, two strategies are used to counteract this threat. The first strategy is to reduce the proportion of nonresponse as far as possible, the second is to statistically adjust for the remaining nonresponse. Interview surveys are still the norm for official statistics, social studies and market research in the Netherlands, and interviewers are an important factor in the battle against nonresponse. We focus an interviewers' opinions an nonresponse and their attitudes regarding the role of the interviewer in persuading potential respondents. In a special project at Statistics Netherlands the continuous survey an living conditions (POLS) was redesigned. During that study interviewer data were collected. It is shown that interviewer attitude and response rate are correlated. Interviewers with a positive attitude towards persuasion strategies attain a higher response rate. No differences between interviewers are found regarding self-reported 'door step' behaviour." (author's abstract)
- Published
- 2017
43. The effect of interviewer and respondent characteristics on refusals in a panel survey
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Loosveldt, Geert, Carton, Ann, Pickery, Jan, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Loosveldt, Geert, Carton, Ann, and Pickery, Jan
- Abstract
Die vorliegende Untersuchung basiert auf Daten einer Panelstudie aus dem Bereich der Wahlforschung. Die Ergebnisse zeigen, dass politisch Interessierte mit höherer Wahrscheinlichkeit an der zweiten Welle einer Panel-Studie teilnehmen und dass der erste Kontakt für das zweite Interview vor allem bei Frauen mit niedrigem Bildungsstand sehr wichtig ist. Der Interviewereffekt wurde mit Hilfe einer Mehrebenenanalyse untersucht. Diese Analyse zeigt, dass der von den Interviewern des Jahres 1991 auf die Antwortverweigerungen 1995 ausgehende Effekt stärker war als der Effekt, der von den Interviewern des Jahres 1995 ausgelöst wurde. Dieses bemerkenswerte Ergebnis unterstreicht die Bedeutung, die die beim ersten Interview gemachten Erfahrungen haben. Anhand verschiedener Charakteristika wurden die Unterschiede zwischen den Interviewern modelliert. Ein signifikanter Effekt ging nur von der Anzahl der Interviews aus, die ein Interviewer durchführte: mehr Interviews bedeuten mehr Verweigerungen. (ICEÜbers), "In this paper data from an election panel survey are used. The results make clear that respondents who are more interested in politics are more likely to take part in the second interview of an election panel survey and that the initial contact for the second interview is extremely important for the group of poorly educated women. To evaluate the effect of the interviewer a multi level analysis was done. The results of this analysis show that the effect of the interviewers used in '91 an the refusals realized in '95 is more significant then the effect of the interviewers used in '95. This remarkable result stresses the importance of the experience of the first interview. Several interviewer characteristics were used to model the differences between the interviewers. Only the number of interviews done by an interviewer has a significant effect: more interviews result in more refusals." (author's abstract)
- Published
- 2017
44. Two of a kind: similarities between ranking and rating data in measuring values
- Author
-
Moors, Guy, Vriens, Ingrid, Gelissen, John P.T.M., Vermunt, Jeroen K., Moors, Guy, Vriens, Ingrid, Gelissen, John P.T.M., and Vermunt, Jeroen K.
- Abstract
"The key research question asked in this research is to what extent the respondents’ answers to ranking a set of items is mirrored in the response pattern when using rating questions. For example: Do respondents who prefer intrinsic over extrinsic work values in a ranking questionnaire also rate intrinsic values higher than extrinsic values when ratings are used? We adopt a modified version of the form-resistant hypothesis, arguing that each questionnaire mode yields unique features that prevent it from establishing a perfect match between both modes. By adopting a unified latent class model that allows identifying latent class profiles that share a particular preference structure in both question modes, we show that a large portion of respondents tend to identify similar preferences structures in work values regardless of the questionnaire mode used. At the same time the within-subjects design we use is able to answer questions regarding how non-differentiators in a rating assignment react to a ranking assignment in which non-differentiation is excluded by design. Our findings are important since - contrary to popular belief - ranking and ratings do produce results that are more similar than often thought. The practical relevance of our study for secondary data analysts is that our approach provides them with a tool to identify relative preference structures in a given dataset that was asked by rating questions and hence not directly designed to reveal such preferences." (author's abstract)
- Published
- 2017
45. A bootstrap strategy for the detection of a panel attrition bias in a household panel with an application to the German Socio-Economic Panel (GSOEP)
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Rendtel, Ulrich, Büchel, Felix, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Rendtel, Ulrich, and Büchel, Felix
- Abstract
Die Verfasser stellen ein einfaches Verfahren zur Identifizierung sinkender Panelausschöpfung dar. Diese Strategie basiert auf dem Unterschied zwischen der ursprünglichen Schätzung und einer Schätzung, die sich durch die Reduzierung der ursprünglichen Stichprobe vermittels eines zweiten Experiments zu Panelausfällen ergibt. Die Informationen hierzu stammen aus der vorhergehenden Welle sowie aus der Feldarbeit im Zuge der laufenden Welle. Das Verfahren kann zur Schätzung des Bias verwendet werden, der auf Panelausfälle zurückgeht. Hier wird es auf Einkommensschätzungen auf der Basis von Daten aus den ersten acht Wellen des SOEP für die Bundesrepublik Deutschland angewendet. (ICEÜbers), "A bootstrap strategy for detecting non-ignorable panel attrition is proposed. The strategy is based an the difference of the original estimate and an estimate that is obtained by reducing the original sample by a second attrition experiment. The attrition propensities are estimated from previous wave information and field work information of the current panel wave. The routine may be used to estimate the bias due to panel attrition. The bootstrap routine is applied to two income estimates with data from the first 8 waves of the GSOEP." (author's abstract)
- Published
- 2017
46. Helping respondents provide good answers in Web surveys
- Author
-
Couper, Mick P., Zhang, Chan, Couper, Mick P., and Zhang, Chan
- Abstract
"This paper reports on a series of experiments to explore ways to use the technology of Web surveys to help respondents provide well-formed answers to questions that may be difficult to answer. Specifically, we focus on the use of drop-down or select lists and JavaScript lookup tables as alternatives to open text fields for the collection of information on prescription drugs. The first two experiments were conducted among members of opt-in panels in the U.S. The third experiment was conducted in the 2013 Health and Retirement Study Internet Survey. Respondents in each of the studies were randomly assigned to one of three input methods: text field, drop box, or JavaScript lookup, and asked to provide the names of prescription drugs they were taking. We compare both the quality of answers obtained using the three methods, and the effort (time) taken to provide such answers. We examine differences in performance on the three input format types by key respondent demographics and Internet experience. We discuss some of the technical challenges of implementing complex question types and offer some recommendations for the use of such tools in Web surveys." (author's abstract)
- Published
- 2017
47. Methodological aspects in cross-national research
- Author
-
Hoffmeyer-Zlotnik, Jürgen H. P., Harkness, Janet, GESIS-ZUMA, Hoffmeyer-Zlotnik, Jürgen H. P., Harkness, Janet, and GESIS-ZUMA
- Abstract
Die Beiträge diese Heftes gehen zumeist auf mehrere Tagungen des Research Committee 33 (Logik und Methodologie) der International Sociological Association zurück. Im Mittelpunkt stehen Fragen der Messung sowie die Vergleichbarkeit, Reliabilität und Validität in der international vergleichenden empirischen Forschung. Die Beiträge sind vier Themengruppen zugeordnet. Im ersten Teil geht es um Design und Implementation kulturvergleichender Studien (Instrumentarium, Question Appraisal System, EU-Projekte, Fragebogenverstehen, Interpretation der Ergebnisse). Der zweite Teil ist verschiedenen Aspekten der "Äquivalenz"-Problematik gewidmet, vor allem in Bezug auf das International Social Survey Programme (ISSP) und den European Social Survey (ESS). Im dritten Teil wird die Harmonisierung soziodemographischer Information in unterschiedlichen Untersuchungen behandelt (amtliche Statistik, ESS, ISSP). Im abschließenden vierten Teil werden sozioökonomische Variablen in international vergleichender Perspektive diskutiert (Einkommen, Bildung, Beruf, Ethnizität, Religion). (ICE), "Cross-national and cross-cultural survey research has been growing apace for several decades and interest in how best to do them has possibly never been greater. At the International Sociological Association Research Committee 33 (Logic and Methodology) several sessions were dedicated to cross-cultural cross-national survey methodology and the vast majority of the papers in this volume were presented at that conference. Researchers involved in comparative research have always been worried about measurement issues, comparability, reliability and validity of their data. But the design and execution of comparative studies has changed markedly since the early cross-national projects of the nineteen sixties and nineteen seventies." (excerpt). Contents: Jürgen H.P. Hoffmeyer-Zlotnik, Janet A. Harkness: Methodological aspects in cross-national research: foreword (5-10). I. Designing and implementing cross-cultural surveys - Johnny Blair, Linda Piccinino: The development and testing of instruments for cross-cultural and multi-cultural surveys (13-30); Elizabeth Dean Rachel Caspar, Georgina McAvinchey, Leticia Reed, Rosanna Quiroz: Developing a low-cost technique for parallel cross-cultural instrument development: the Question Appraisal System (QAS-04) (31-46); Felizitas Sagebiel: Using a mixed international comparable methodological approach in a European Commission project on gender and engineering (47-64); Timothy P. Johnson, Young Ik Cho, Allyson Holbrook, Diane O'Rourke, Richard Warnecke, Noel Chávez: Cultural variability in the effects of question design features on respondent comprehension (65-78); Kristen Miller, Gordon Willis, Connie Eason, Lisa Moses, Beth Canfield: Interpreting the results of cross-cultural cognitive interviews: a mixed-method approach (79-92). II. Different issues of comparability or "equivalence" - Michael Braun, Janet A. Harkness: Text and context: challenges to comparability in survey questions (95-108); Nina Rother: Measuring attitudes towar
- Published
- 2017
48. Smartphones vs PCs: does the device affect the Web survey experience and the measurement error for sensitive topics? A replication of the Mavletova & Couper's 2013 experiment
- Author
-
Toninelli, Daniele, Revilla, Melanie, Toninelli, Daniele, and Revilla, Melanie
- Abstract
"More and more respondents use mobile devices to complete web surveys. These devices have different characteristics, if compared to PCs (e.g. smaller screen sizes and higher portability). These characteristics can affect the survey responses, mostly when a questionnaire includes sensitive questions. This topic was already studied by Mavletova and Couper (2013), through a two-wave experiment comparing PCs and mobile devices results for the same respondents in a Russian opt-in panel. We replicated this cross-over design, focusing on an opt-in panel for Spain, involving 1,800 panellists and comparing PCs and smartphones. Our results support most of Mavletova and Couper’s (2013) findings (e.g. generally the used device does not significantly affect the reporting of sensitive information), confirming their robustness over the two studied countries. For other results (e.g. trust in data confidentiality), we found differences that can be justified by the diverse context/culture or by the quick changes that are still characterizing the mobile web survey participation." (author's abstract)
- Published
- 2017
49. The stability of nonresponse rates according to socio-demographic categories
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Zaletel, Metka, Vehovar, Vasja, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Zaletel, Metka, and Vehovar, Vasja
- Abstract
Daten aus verschiedenen Quellen (Zentrales Melderegister, Zensusdaten, Finanzverwaltung, regionale Register etc.) wurden für das gesamte Territorium Sloweniens zusammengeführt. Dieses Modell wurde mit Daten zu Nonresponse und Antwortverweigerung bei face-to-face-Interviews verknüpft. Das Antwortverhalten erweist sich als stabil in Bezug auf bestimmte vorgegebene Determinanten. (ICEÜbers), "The data from various sources (e.g. Central Population Register, Census data, Tax Register, Register of Territorial Units, etc.) were merged at the level of enumeration areas for the whole territory of Slovenia. The nonresponse and refusal rates of face-to-face surveys were connected to this model. The paper shows the stability of responses according to the given predictors." (author's abstract)
- Published
- 2017
50. Incentives in two German mail surveys 1996/97 & 1997
- Author
-
Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Harkness, Janet, Mohler, Peter Ph., Schneid, Michael, Christoph, Bernhard, Koch, Achim, Porst, Rolf, Zentrum für Umfragen, Methoden und Analysen -ZUMA, Harkness, Janet, Mohler, Peter Ph., Schneid, Michael, and Christoph, Bernhard
- Abstract
Im Winter 1996/97 und im Frühjahr 1997 wurden in Ost- und Westdeutschland zwei postalische Befragungen mit jeweils drei Aussendungen und einer landesweit repräsentativen Stichprobe durchgeführt. Für beide Befragungen liegen Daten zu Respondenten und Antwortverweigerern vor. In der erst genannten Studie reduziert sich dies bei den Antwortverweigerern auf Geschlecht, Alter und Wohnort, der Datensatz für die zweite Studie ist detaillierter. Bei der ersten Studie wurde ein geldnaher Anreiz eingesetzt (Briefmarken), bei der zweiten Studie wurde für den Fall der Partizipation die Teilnahme an einer besonderen Verlosung in Aussicht gestellt. Antwortverhalten und weitere Reaktionen wurden dokumentiert. Der vorliegende Beitrag fasst erste Ergebnisse der Untersuchung zusammen. Neuere Untersuchungen über Anreize und Antwortverhalten bei Erhebungen mit mehr als einer Welle sind in Deutschland rar. Unsere Ergebnisse stimmen mit denen für Nordamerika überein, sowohl was den allgemein positiven Effekt des Einsatzes von Anreizen angeht als auch hinsichtlich von Unterschieden zwischen versprochenen und beigefügten Belohnungen. Briefmarken wurden anscheinend als Bargeldgeschenke betrachtet. Die höheren Verweigerungsquoten bei Befragten, denen Briefmarken mitgeschickt wurden, werden im Kontext kommunikativer Verpflichtungen und kognitiver Dissonanz diskutiert. Darüber hinaus werden alters- und geschlechtsspezifische Unterschiede sowie Kosten und Rentabilität beider Anreiztypen erörtert. (ICEÜbers), "Two mail surveys, each with three mailings, were carried out with nationally representative samples in eastern and western Germany in winter 1996/97 and spring 1997. Data is available an respondents and nonrespondents for both. In the 1996/97 study this is limited for nonrespondents to sex, age and regional location. In the second study rich data is available an everyone eligible. The first study used an enclosed 'near-to-cash' incentive (postage stamps), the second promised inclusion in a special lottery in return for participation. Detailed records of response and other reactions were kept. This paper presents the first results from the studies. Recent research an incentives and nonresponse in studies with more than one mailing is scarce in Germany. Our findings an incentive impact are in line with findings for North America, both with respect to the generally positive effect of using incentives and to differences in the impact of promised and enclosed incentives. Stamps seem to have been perceived as 'cash' gifts. Higher refusal rates among those sent stamps are seen as increases in 'reaction-response' and are discussed in terms of communicative obligations as well as cognitive dissonance. Age and sex differences in the two studies are discussed, as are costs and cost-effectiveness for the two kinds of incentive." (author's abstract)
- Published
- 2017
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.