Search

Proceeding of 2023 IEEE 16th International Conference on Software Testing, Verification and Validation (ICST 2023), 16-20 April 2023, Dublin, Ireland. Modern web applications are complex and used for tasks of primary importance, so their quality must be guaranteed at the highest levels. For this reason, testing techniques (e.g., end-to-end) are required to validate the overall behavior of web applications. One of the most popular tools for testing web applications is Selenium WebDriver. Selenium WebDriver automates the browser to mimic real user actions on the web.While Selenium has made testing easier for many Teams worldwide, it still has its share of challenges. To better understand the challenges and the corresponding solutions adopted we decided to undertake a personal opinion survey from the industry (in total with 78 highly skilled participants) with a focus on the Selenium ecosystem.The results allow understanding which challenges are consid-ered more relevant by professionals in their daily practice and which are the techniques, approaches, and tools they adopt to face them. Therefore, this study is useful to (1) practitioners interested in understanding how to solve the problems they face every day and (2) researchers interested in proposing innovative solutions to problems having a solid industrial impact. This work was partially supported in part by the Ministerio de Ciencia e Innovación-Agencia Estatal de Investigación (10.13039/501100011033) through the H2O Learn project under Grant PID2020-112584RB-C31, and in part by the Madrid Regional Government through the e-Madrid-CM Project under Grant S2018/TCS-4307.

Akzeptanztests werden verwendet, um die erforderliche Funktionalität eines Softwaresystems sicherzustellen. Sie werden durchgeführt, bevor das System in den Echtbetrieb geht. Das Durchführen von Akzeptanztests wird erschwert, wenn es sich bei dem zu testenden System (SUT) um ein verteiltes System handelt, d.h. es besteht aus mehreren Anwendungen, die miteinander interagieren. Dabei liegt die größte Herausforderung in der Synchronisation und der Administration des Testprozesses. Das Automatisieren von Akzeptanztests bei solchen Systemen kann sehr aufwändig sein, wenn es dabei keine strukturierte Vorgehensweise gibt. Einsatzleitsysteme für das Annehmen und Bearbeiten von Notrufen sind hoch verteilte und komplexe Systeme. Diese laufen üblicherweise in einer bereits vorhandenen Service-Infrastruktur, wie z.B. Telefonnetze, Radio-Kommunikationssysteme und Clients von Drittanbietern. Das Automatisieren von Akzeptanztests für Einsatzleitsysteme erfordert daher Simulation an unterschiedlichen Schnittstellen. Da es keine passende Automatisierungsunterstützung für das Testen von Einsatzleitsystemen gibt, hat Frequentis ein Framework entwickelt, mit welchem sich Akzeptanztests automatisieren lassen. Dieses Framework ermöglicht die Steuerung sämtlicher Kommunikation mit dem SUT, die für Akzeptanztests notwendig sind. Das Framework kann jedoch nur Java Swing Benutzeroberflächen ansprechen. Da immer mehr Anwendungen über Weboberflächen zugänglich werden, bietet Frequentis ebenfalls webbasierte Clients an, um das Annehmen und Bearbeiten von Notrufen im Browser zu ermöglichen. Daher muss das bestehende Testautomatisierungs-Framework ebenfalls Weboberflächen ansprechen können. Im Rahmen dieser Diplomarbeit haben wir dieses Framework erweitert, sodass Weboberflächen als Teil eines verteilten Systems angesprochen und getestet werden können. Wir sammelten die notwendigen Anforderungen und haben eine Softwarelösung, welche sich in das bestehende Framework integriert, entworfen und implementiert. Diese Erweiterung des Frameworks bietet eine Programmierschnittstelle (API) an, welche Testentwickler dazu animieren soll, das Page Object Pattern anzuwenden, sodass die erzeugten Akzeptanztests leichter wartbar sind. Unsere Erweiterung basiert auf dem Browser-Automatisierungstool Selenium. Wir führten eine Anforderungsanalyse durch, um die notwendigen Funktionen der Framework-Erweiterung zu bestimmen. Die Entwicklung und Integration der Erweiterung in das bestehende Framework haben wir mittels evolutionärem Prototyping durchgeführt. Zuletzt führten wir eine Fallstudie durch, um zu evaluieren, ob das erweiterte Testautomatisierungs-Framework den beabsichtigten Zweck erfüllt. Unsere Fallstudie hat gezeigt, dass die Erweiterung in zahlreichen Projekten innerhalb Frequentis eingesetzt wird und dass die angebotene API häufig verwendet wird., Acceptance tests are used to ensure that a software system delivers its required functionality. They are performed on a system prior to its delivery to a live environment. Acceptance testing becomes a complex task when the system under test (SUT) is distributed, i.e. it consists of multiple applications interacting with each other. The main challenge lies in the synchronization and administration of the test process. Automating acceptance tests of such systems can result in high effort when not performed in a structured way. Control center solutions for handling and managing emergency calls are highly distributed and complex systems. They are usually embedded into an existing infrastructure of services (like telephony call lines, radio communication systems and 3rd party clients). Hence, automating acceptance tests for control center solutions requires simulation on multiple interfaces. As no suitable tool is available for testing control center solutions, Frequentis developed an acceptance test automation framework. With this framework, it is possible to control all necessary communications with the SUT in a uniform and simple way. However, it is only capable of addressing Java Swing based front-ends. As more and more applications become accessible via web interfaces, Frequentis’ control center solutions also offer web based clients to enable emergency call handling via a browser. Therefore the existing test automation framework is required to also address web front-ends. In this master thesis, we extended this framework so that web front-ends participating in a distributed system can be addressed and tested. We collected the necessary requirements, designed and implemented a solution which integrates into the existing framework. This framework extension offers an API to encourage test developers to apply the page object pattern in order to create maintainable tests. Our extension is based on the browser automation tool Selenium. We used requirements engineering to determine the necessary capabilities of the extension. Furthermore, we performed evolutionary prototyping to develop and integrate the extension into the existing framework. Eventually, we performed a case study to evaluate whether the extended test automation framework fits its intended purpose. Our study shows that the extension is used in numerous projects within Frequentis and that there is a high adoption rate of the offered API.

The success of companies engaged in the field of distributors is not only from good and smart human resources, but how ready the company's way to provide tools or programs supporting the work of employees. Some of the problems are the administration system between the company's internal divisions, so there are restrictions on the processing of input data, processes, outputs that are still manual. Web Application is made to facilitate employees to conduct administrative activities with the access role of each user admin division, for example inventory data, creation of sales invoices, road letters, procurement forms and bookkeeping. In addition, The Web View application is already responsive in this sense can adjust the device PC / Tablet / Mobile, then for visualization of data calculation already using cart / data graphics in real time, and there is also a feature preview, download and print JPEG, PNG, PDF, Barcode and QR code. Web Testing This application with black box method and shows it is running well and no error method, so it can be declared passed. Web Creation This application involves the LTE 2.0 Admin Template with bootstrap CSS, for programmer frameworks using MVC model view controllers that exist in the Code Igniter 3.0 framework so that it is faster and easier to implement or developed in other field companies or in the manufacturing industry. Tests using lighthouse for perform by 94% showed that the application designed to have a good performance for display results, and its access value of 60%, indicating that the process related to responsiveness between users is appropriate both using PC / Tablet / Mobile

Perkembangan smartphone membuat aktivitas manusia lebih muda, dengan fitur-fitur yang diberikan, perkembangan tersebut tidak menutup kemungkinan dengan kecanggihan fitur smartphone dimanfaatkan sebagai media komunikasi untuk mendukung bentuk aksi kejahatan. Proses investigasi forensik dalam penanganan barang bukti elektronik pada smartphone menjadi sebuah tantangan bagi ahli forensik karena perkembangan smartphone yang terus berkembang. permasalahan yang dihadapi oleh ahli forensik adalah sulit menentukan tools forensik yang harus digunakan dalam penanganan barang bukti karena beberapa aplikasi yang dikembangan belum diuji dengan standar forensik. untuk itu dalam penelitian ini akan dilakukan pengujian aplikasi web based android analysis tools berdasarkan standar computer forensics tools testing menggunakan aplikasi federated testing. pengujian ini dilakukan untuk mengetahui kelayakan aplikasi web based dengan melakukan evaluasi data antara hasil pengujian web based dan hasil pengujian federated testing. dari hasil evaluasi tersebut didapatkan bahwa aplikasi web based masih lebih rendah dibandingkan dengan federated testing karena pada aplikasi web based hanya mampu menghasilkan empat variabel data yang sama dengan laporan federated testing, sedangkan data lainnya belum di support oleh aplikasi tersebut, sehingga dapat dapat disimpulkan bahwa aplikasi web based android analysis tools ini belum memenuhi syarat standarisasi cftt.

The rapid spread of smart mobile technology is transforming the way how governments provide information and services to their citizens. We all are rely more on our devices, namely smartphones, laptops, or desktop to get information and a wide range of services from government websites. Such heavy usage of government websites results in an increased need for efficient and effective delivery of government services. Therefore, mobile government websites’ usability and accessibility are essential dimensions that determine the quality and accessibility of mobile e-government. The main objective of this research is to analyze the accessibility and usability aspects of selected public sector websites in Saudi Arabia. This study investigates how well the Saudi mobile e-government websites comply with usability standards and accessibility guidelines recommended in the Web Content Accessibility Guidelines (WCAG). Websites assessments were conducted using manual evaluation and complemented by different automated analysis tools. This study applies a number of evaluation techniques to assess Saudi government websites accessed from desktop or mobile devices, such as an automated website testing technique, mobile-friendliness testing, and content observation technique. Various tools have been used for site evaluation, such as GTmetrix (PageSpeed Score, YSlow Score), WAVE, Google mobile-friendly test, and Dareboost for mobile websites. The study uncovers shortcomings regarding non-compliance to international web standards recommendations. The findings revealed usability and accessibility problems that affect the performance of government websites. In order to improve these websites within these aspects, several recommendations were suggested for improving the usability and accessibility of websites in Saudi Arabia that will make sure different groups of citizens are satisfied with the website features and services provided by them.

Об’єктом дослідження є інструментарій та методи написання скриптів автоматизації тестування веб-додатків. Значимість роботи пов’язана з високим попитом на написання скриптів тестування веб- систем, оскільки мануальне тестування займає дуже великий обсяг часу і відповідно витрати бюджету. В даній роботі було проведене дослідження підходів та методів написання скриптів автоматизації тестування веб-застосунків, застосування інструментів Selenium WebDriver, TestNG та Allure у автоматизації веб-тестування, та розроблений приклад фреймворку на основі перерахованих інструментів. Результат виконання даної роботи може бути використаний в якості керування для швидкого введення автоматизації веб-тестування на проекті. Загальний об’єм роботи: 165 с., 36 рисунків, 13 таблиць, посилання на 25 літературних джерел. The Objectives for this thesis is exploring the tools and methods for the development of test-automation scripts for web-application QA. Importance of the thesis is attributable to increased demand for developing test-automation scripts due to overall time-consumption and resulting high cost of manual testing. In this thesis were explored the approaches and methods of developing test-automation scripts for web application testing, the use of Selenium WebDriver, TestNG and Allure tools in web testing automation, and developed an example of a framework based on these tools. The result of this work can be used as a basis for the deployment of web testing automation on the project. The paper contains: 165 p., 36 figures, 13 tables, 25 references.

The current condition experienced by the XYZ Polyclinic is that there is no application built to simplify the service process contained in the polyclinic so that all service processes are still manual. An example is the calculation of the number of drugs that are in and out of use. This calculation takes a long time, is prone to errors in accounting, and consumes many papers. To solve this problem, we develop an application to recap drugs. The drug recapitulation application is based on a website with the WebML method using the CodeIgniter framework and MySQL database. The application produces the result in the form of a PDF file of the drug recapitulation report per month and day. As a security feature, the monthly drug recapitulation report results include a digital signature as proof of authentication, integrity, and anti-denial. The application built has been tested using web testing methods and user acceptance testing to be applied.

An unrecognized significance of the web acts as a driving force for the massive and rapid growth of websites in each domain of social life. For making a successful website, it is necessary for developers to embrace appropriate web testing and evaluation methodology. Some valuable works in the past have striven to appraise the web applications quantitatively. Various parameters have been considered which are again sub-parameterized to measurable indicators. But their weighing criterion has not been appropriately taken into account according to the domain of the website. Also, the relative degrees of interactions among parameters have not been taken into consideration. The work presented in this paper aims at describing a framework, Quality Index Evaluation Method to gauge the design quality of a website in the form of index value. An automated tool has been designed and coded to measure the metrics quantitatively. A weighing technique based on Fuzzy-DEMATEL (Decision Making Trial and Evaluation Laboratory Method) has been applied on these metrics. Fuzzy trapezoidal numbers have been used for assessment of parameters and the final design quality index value. To verify the use of framework in different website domains, it has been exercised on eight academic (four institutional and four digital libraries), five informative and four commercial websites. The results have been validated through the most widely used method in literature, i.e., user judgment. Opinions of users for each website have been quantified and aggregated with fuzzy aggregation technique. Experimental results show that the proposed framework provides accurate and consistent results in very less time.

Automatic test case generation is usually based on models of the software under test. However, those models may not exist or may be outdated and so, the test case generation must resort to other artifacts. In a software maintenance context, test cases must adapt to software changes and should be improved continuously to test adequately the new versions of the software. Mutation testing is a fault-based testing technique that evaluates the quality of the tests by applying simple changes to the source code and checking afterwards if the tests are able to detects those changes. This paper presents a web testing approach in which test cases are generated from user execution traces as a way to deal with the absence of models. In addition, it applies mutation operators over those test cases to enrich the test suite. The mutation operators were designed so as to mimic possible real failures. The additional tests are analyzed, and those that generate different outcomes are kept because they exercise additional behavior of the web application under test. At the end, the overall approach is illustrated and validated in a case study.

Purpose: The aim is to find out the current state of accessibility of the websites of European national tourism boards. Furthermore, the identification of the most common errors in terms of accessibility as well as recommendations leading to their correction is aimed for. Design/methodology/approach: The study is based on methods of testing the availability of web systems. The testing included automated tools, namely AChecker and Accessibility Evaluation Tool, as well as the WCAG 2.1 checklist developed by WebAIM initiative. Findings: The research has shown a relatively high accessibility of those websites. Nevertheless, some accessibility violations have been identified that can significantly complicate the accessibility of those websites for users using various assistive devices or other alternative hardware or software means. The most commonly identified errors include: failure to use alternative text for content-relevant images, the absence of text or audio transcripts for videos shared via Youtube, missing descriptions for text form elements and missing label for search form. Practical implications: The results of the research can be used in the evaluation of web presentations at the level of tourism boards and destination management. Originality/Value: The main output of this article is the application of web testing methodology on a comprehensive set of national tourist boards., peer-reviewed

People with disabilities may have problems accessing websites and using web applications due to lack of necessary tests in the software development and carelessness or ignorance in maintenance. Bringing them into the web world unhindered should be one of the main goals of administrations, web developers and content managers. This study covers the accessibility evaluation of the 76 health related websites on the island of Cyprus to verify the degree of compliance of the websites with The Web Content Accessibility Guidelines 2.1 (WCAG 2.1) published by the World Wide Web Consortium (W3C). At the end of the evaluation by using two different tools it was concluded that the websites under investigation revealed that only 6.67% of the home pages are in the acceptable level and none of the websites are completely error free. In addition, all of the pages of the 20 websites that examined had accessibility errors.

In the context of End-to-End testing of web applications, automated exploration techniques (a.k.a. crawling) are widely used to infer state-based models of the site under test. These models, in which states represent features of the web application and transitions represent reachability relationships, can be used for several model-based testing tasks, such as test case generation. However, current exploration techniques often lead to models containing many near-duplicate states, i.e., states representing slightly different pages that are in fact instances of the same feature. This has a negative impact on the subsequent model-based testing tasks, adversely affecting, for example, size, running time, and achieved coverage of generated test suites. As a web page can be naturally represented by its tree-structured DOM representation, we propose a novel near-duplicate detection technique to improve the model inference of web applications, based on Tree Kernel (TK) functions. TKs are a class of functions that compute similarity between tree-structured objects, largely investigated and successfully applied in the Natural Language Processing domain. To evaluate the capability of the proposed approach in detecting near-duplicate web pages, we conducted preliminary classification experiments on a freely-available massive dataset of about 100k manually annotated web page pairs. We compared the classification performance of the proposed approach with other state-of-the-art near-duplicate detection techniques. Preliminary results show that our approach performs better than state-of-the-art techniques in the near-duplicate detection classification task. These promising results show that TKs can be applied to near-duplicate detection in the context of web application model inference, and motivate further research in this direction., Comment: 6 pages, 3 figures, accepted for presentation at the 15th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2021)

The Darkweb is an anonymous Internet network that keeps users communicating over an unknown, encrypted and highly anonymous channel. The most vital feature of the dark web is anonymity, and that makes it a favourite place for criminals as it is challenging for Legal Enforcement Agencies (LEAs) to track those IP addresses of hosted services and the dark web users they are hidden services. This point motivated us to review auditing and assessment of various applications on the dark web. In this paper, we proposed a methodology for identifying vulnerabilities in the dark web to understand the negligence of hosting web applications as in the surface web. We used the most common known vulnerabilities and respective Common Vulnerabilities and Exposures (CVEs), which are part of the list of publicly disclosed computer security flaws for around 600 websites and were able to identify 294 (around 50%) websites in the dark web found to be vulnerable and exploitable. Identifying vulnerabilities and exploiting methods helps in tracing users and their transactions with that website. The approach helped our further research integrate with a framework in combating the anonymity and invisible threat for monitoring criminal activities.