Software maintenance, which involves making enhancements, modifications and corrections to existing software systems, consumes more than half of developer time. Specification comprehensibility plays an important role in software maintenance as it permits the understanding of the system properties more easily and quickly. The use of formal notation such as B increases a specification-s precision and consistency. However, the notation is regarded as being difficult to comprehend. Semi-formal notation such as the Unified Modelling Language (UML) is perceived as more accessible but it lacks formality. Perhaps by combining both notations could produce a specification that is not only accurate and consistent but also accessible to users. This paper presents an experiment conducted on a model that integrates the use of both UML and B notations, namely UML-B, versus a B model alone. The objective of the experiment was to evaluate the comprehensibility of a UML-B model compared to a traditional B model. The measurement used in the experiment focused on the efficiency in performing the comprehension tasks. The experiment employed a cross-over design and was conducted on forty-one subjects, including undergraduate and masters students. The results show that the notation used in the UML-B model is more comprehensible than the B model., {"references":["B. W. Boehm, J. R. Brown, and J. R. Kaspar, \"Characteristics of\nSoftware Quality\", TRW Series of Software Technology, 1978.","I. Sommerville, Software Engineering. 6th Edition, Addision-Wesley,\n2001, ISBN: 020139815.","T. M. Pigoski, Practical Software Maintenance: Best Practices for\nManaging your Software Investment. Wiley Computer Publishing, 1996,\nISBN: 0471170011.","D. Craigen, S. Gerhart, and T. Ralston, Applications of Formal Methods,\nIn M. Hinchey, J. Bowen, Eds., Prentice-Hall, Englewoodcliffs, NJ,\n1995, ISBN:0133669491","M. G. Hinchey, \"Confessions of a Formal Methodist\", In P. Lindsay,\nEd., Conferences in Research and Practice in Information Technology,\nVol.15, Australian Computer Society, 2002, pp. 17-20.","K. Finney, and A. Fedorec, \"An Empirical Study of Specification\nReadability Teaching and Learning Formal Methods\", In: N. Dean, M.\nHinchey, Eds., Teaching and Learning Formal Methods, Academic\nPress, New York, 1996, ISBN: 0123490405.","K. Finney, \"Mathematical Notation in Formal Specification: Too\ndifficult for the Masses?\", IEEE Transactions on Software Engineering,\nVol.22, No.2, pp. 158-159, 1996.","D. Carew, C. Exton, and J. Buckley, \"An Empirical Investigation of the\nComprehensibility of Requirements Specifications\", International\nSymposium on Empirical Software Engineering, 2005, pp. 256-265.","J. P. Bowen, and M. G. Hinchey, \"Ten Commandments of Formal\nMethods... Ten Years Later\", IEEE Computer, Vol.39, No.1, 2006, pp.\n40-48.\n[10] A. van Lamsweerde, \"Formal Specification: A Roadmap\", In The Future\nof Software Engineering Track (ICSE-00), ACM Press, Los Angeles\nCA, 2000, pp. 147-159.\n[11] I. Vessey, and R. Weber, \"Structured Tools and Conditional Logic: An\nEmpirical Investigation\", Communications of the ACM, Vol.29, No.1,\n1986, pp. 48-57.\n[12] D. A. Scanlan, \"Structured Flowcharts Outperform Pseudocode: An\nExperiment Comparison\", IEEE Software, Vol.6, No.5, 1989, pp. 28-36.\n[13] N. Cunniff, and R. P. Taylor, \"Graphical vs Textual Representation: An\nEmpirical Study of Novices- Program Comprehension\", In Empirical\nStudies of Programmers: 2nd Workshop, 1987, pp. 114-131.\n[14] M. Bauer, and P. Johnson-Laird, \"How Diagrams Can Improve\nReasoning\", Psychological Science, Vol.4, 1993, pp. 372-378.\n[15] K. Stenning, and J. Oberlander, \"A Cognitive Theory of Graphical and\nLinguistic Reasoning: Logic and Implementation\", Cognitive Science,\nVol.19, 1995, pp. 97-140.\n[16] M. Petre, \"Why looking isn't always seeing: Readership skills and\ngraphical programming\", Communications of the ACM, Vol.38, 1995,\npp.33-44.\n[17] M. Scaife, and Y. Rogers, \"External Cognition: How do Graphical\nRepresentations Work?\", International Journal of Human-Computer\nStudies, Vol.45, 1996, pp. 185-213.\n[18] J. R. Abrial, The B-Method - Assigning Programs to Meanings,\nCambridge University Press, 1996, ISBN: 0521496195.\n[19] Object Management Group (2006). Introduction to OMG-s Unified\nModeling Language (UML). [Online]. Available:\nhttp://www.omg.org/gettingstarted/what_is_uml.htm\n[20] C. Snook, I. Oliver, and M. Butler, \"The UML-B Profile for Formal\nSystems Modelling in UML\", In J. Mermet, , Ed., UML-B Specification\nfor Proven Embedded Systems Design, Springer, 2004, ch. 5, ISBN:\n1402028660.\n[21] C. Snook, and M. Butler, \"UML-B: Formal Modelling and Design\nAided by UML\", ACM Transactions on Software Engineering and\nMethodology, Vol.15, No.1, 2006, pp.92-122.\n[22] ClearSy, AtelierB User Manual V3.6, ClearSy System Engineering,\n2003, Aix-en-Provence, France.\n[23] B-Core (UK) Limited, Oxon, UK (1999). B-Toolkit, On-line manual,\n(Online). Available:\nhttp://www.b-core.com/ONLINEDOC/Contents.html\n[24] J. R. Abrial, and D. Cansell (2003) Click ÔÇÿn- Prove - Interactive Proofs\nwithin Set Theory B. (Online). Available: http://www.b4free.com/ and\nhttp://www.loria.fr/cansell/cnp.html\n[25] T. Pender, UML Bible, Wiley, 2003, ISBN: 0764526049.\n[26] S. Senn, Cross-over Trials in Clinical Research (Statistics in Practice),\nJohn Wiley & Sons, 2002, ISBN: 0471496537.\n[27] J. Foster, \"Program Lifetime: A Vital Statistic for Maintenance\", In\nProceedings of the IEEE Conference on Software Maintenance, 1991,\npp. 98-103.\n[28] A. Davis, S. Overmyer, K. Jordan, J. Caruso, F. Dandashi, A. Dinh, G.\nKincaid, G. Ledeboer, P. Reynolds, A. Sitaram, A. Ta, and M.\nTheofanos, \"Identifying and Measuring Quality in a Software\nRequirements Specification\", In Proceedings of the 1st. International\nSoftware Metrics Symposium, IEEE, 1993, pp. 141-152.\n[29] M. Piattini, M. Genero, G. Poels, and J. Nelson, \"Towards a Framework\nfor Conceptual Modelling Quality\", In M. Genero, M. Piattini, and C.\nCalero, Eds., Metrics for Software Conceptual Models, London :\nImperial College Press, 2005, ISBN: 1860944973.\n[30] S. L. Pfleeger, \"Experimental Design and Analysis in Software\nEngineering: Part 1-5\", ACM SIGSOFT Software Engineering\nNotes, Vol.20, No.1-5, 1995.\n[31] B. A. Kitchenham, and S. L. Pfleeger, \"Principles of Survey Research:\nPart 1-6\", ACM SIGSOFT Software Engineering Notes, Vol.27, No.1-6,\n2002.\n[32] B. Efron, and R. Tibshirani, An Introduction to the Bootstrap, Chapman\nand Hall, New York, London, 1993.\n[33] D. S. Moore, and G. P. McCabe, Introduction to the Practice of\nStatistics, 5th Edition, W. H. Freeman, New York, 2006, ISBN:\n071676282.\n[34] B. Efron, and R. Tibshirani, \"The Bootstrap Method for standard errors,\nconfidence intervals and other measures of statistical accuracy\",\nStatistical Science, Vol.1, No. 1, 1986, pp 1-35.\n[35] Insightful Corporation (2006). Available:\nhttp://www.insightful.com/products/splus/default.asp\n[36] B. Jones, and M. G. Kenward, Design and Analysis of Cross-over Trials,\n2nd Edition, Chapman and Hall, London, 2003, ISBN: 0412606402.\n[37] V. R. Basili, R. W. Selby, and D. H. Huthchens, \"Experimentation in\nSoftware Engineering\", IEEE Transactions on Software Engineering,\nVol.12, No.7, 1986, pp. 733-743.\n[38] V. R. Basili, F. Shull, and F. Lanubile, \"Building Knowledge through\nFamilies of Experiments\", IEEE Transactions on Software Engineering,\nVol.25, No.4, 1999, pp. 456-473.\n[39] R. Jeffery, and L. Scott, \"Has Twenty-five Years of Empirical Software\nEngineering Made a Difference?\", In Proceedings of the 9th Asia-Pacific\nSoftware Engineering Conference, 2002, pp. 539-546.\n[40] W. F. Tichy, \"Should Computer Scientists Experiment More?\", IEEE\nComputer, Vol.31, No.5, 1998, pp. 32-40."]}