Mag. Rudolf Ramler

Scientific Head Software Analytics and Evolution
Telefon: +43 50 343 872


Software Science - SAE

S. Fischer, R. Ramler, L. Linsbauer, A. Egyed. Automating test reuse for highly configurable software. Proceedings of the 23rd International Systems and Software Product Line Conference (SPLC 2019), volume A, pages 1-11, DOI 10.1145/3336294.3336305, ACM, September, 2019.

R. Ramler, G. Buchgeher, C. Klammer, M. Pfeiffer, C. Salomon, H. Thaller, L. Linsbauer. Benefits and drawbacks of representing and analyzing source code and software engineering artifacts with graph databases. In D. Winkler, S. Biffl, J. Bergsmann (editors), oftware Quality: The Complexity and Challenges of Software Engineering and Software Quality in the Cloud - Proc. SWQD 2019, Lecture Notes in Business Information Processing, volume 338, pages 125-148, DOI 10.1007/978-3-030-05767-1_9, Springer, January, 2019.

R. Ramler, C. Klammer. Enhancing acceptance test-driven development with model-based test generation. Proceedings of the IEEE 19th International Conference on Software Quality, Reliability and Security Companion (QRS-C), pages 503-504, DOI 10.1109/QRS-C.2019.00096, IEEE, July, 2019.

R. Ramler, C. Klammer, T. Wetzlmaier. Lessons learned from making the transition to model-based GUI testing. Proceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation - A-TEST 2019, pages 22-27, DOI 10.1145/3340433.3342823, ACM, August, 2019.

S. Mohacsi, R. Ramler. Why software testing fails: Common pitfalls observed in a critical smart metering project. In D. Winkler, S. Biffl, J. Bergsmann (editors), Lecture Notes in Business Information Processing, volume 338, pages 73-92, DOI 10.1007/978-3-030-05767-1_6, Springer, January, 2019.

C. Artho, R. Ramler, M. Seidl, J. Yoneyama. Adaptations of API test case generation. Proceedings of the 30th Nordic Workshop on Programming Theory (NWPT'18), pages Report Nr. 485, University of Oslo, October, 2018.

R. Ramler, G. Buchgeher, C. Klammer. Adapting automated test generation to GUI testing of industry applications. Information and Software Technology, volume 93, pages 248-263, DOI: 10.1016/j.infsof.2017.07.005, January, 2018.

R. Ramler, K. Klammer, G. Buchgeher. Applying automated test case generation in industry: A retrospective. Proceedings of the 2018 IEEE 11th International Conference on Software Testing, Verification and Validation Workshops, pages 364-369, DOI 10.1109/ICSTW.2018.00074, IEEE, April, 2018.

H. Thaller, R. Ramler, J. Pichler, A. Egyed. Exploring code clones in programmable logic controller software. Proceedings of the 2nd IEEE International Conference on Emerging Technologies And Factory Automation (ETFA 2017), pages IEEE Xplore, DOI 10.1109/ETFA.2017.8247574, IEEE, January, 2018.

R. Ramler, T. Wetzlmaier, R. Hochek. GUI scalability issues of Windows Desktop Applications and how to find them. Proceedings for the ISSTA/ECOOP 2018 Workshops, pages 63-67, DOI 10.1145/3236454.3236491, ACM, December, 2018.

R. Ramler, C. Klammer. A journey from manual testing to automated test generation in an industry project. Proceedings of the IEEE International Conference on Software Quality, Reliability & Security (Companion Volume) (QRS-C 2017), pages 591-592, DOI 10.1109/QRS-C.2017.108, IEEE, July, 2017.

R. Ramler, M. Felderer, M. Leitner. A lightweight approach for estimating probability in risk-based software testing. In J. Großmann, M. Felderer, F. Seehusen (editors), Risk Assessment and Risk-Driven Quality Assurance - RISK 2016, Revised Selected Papers, Lecture Notes in Computer Science, volume 10224, pages 115-128, DOI 10.1007/978-3-319-57858-3_9, Springer, April, 2017.

R. Ramler, T. Wetzlmaier, C. Klammer. An empirical study on the application of mutation testing for a safety-critical industrial software system. Proceedings of the SAC 2017 - 32nd ACM Symposium on Applied Computing, pages 1401-1408, DOI 10.1145/3019612.3019830, ACM, April, 2017.

R. Ramler, R. Hoschek. How to test in sixteen languages? Automation support for localization testing. Proceedings of the 10th IEEE International Conference on Software Testing, Verification and Validation (ICST 2017), pages 542-543, DOI 10.1109/ICST.2017.63, IEEE, March, 2017.

T. Wetzlmaier, R. Ramler. Hybrid monkey testing: Enhancing automated GUI tests with random test generation. In T. Vos, S. Eldh, W. Prasetya (editors), Proceedings of the 8th ACM SIGSOFT International Workshop on Automated Software Testing (A-TEST'17), pages 5-10, DOI 10.1145/3121245.3121247, ACM, September, 2017.

T. Kitamura, E. Alégroth, R. Ramler. Industry-academia collaboration in software testing: An overview of TAIC PART 2017. Proceedings of the 10th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2017), pages 42-43, DOI 0.1109/ICSTW.2017.13, IEEE, March, 2017.

R. Ramler, R. Hoschek. Process and tool support for internationalization and localization testing in software product development. In M. Felderer, D. Méndez-Fernández, B. Turhan, M. Kalinowski, F. Sarro, D. Winkler (editors), Product-Focused Software Process Improvement - Proc. PROFES 2017, Lecture Notes in Computer Science, volume 10611, pages 385-393, DOI 10.1007/978-3-319-69926-4_27, Springer, November, 2017.

M. Felderer, R. Ramler. Special issue on collaboration in software testing between industry and academia. Software Quality Journal, volume 25, number 4, pages 1087-1089, DOI: 10.1007/s11219-017-9395-1, December, 2017.

R. Ramler, C. Salomon, G. Buchgeher, M. Lusser. Tool support for change-based regression testing: An industry experience report. In D. Winkler, S. Biffl, J. Bergsmann (editors), Software Quality. Complexity and Challenges of Software Engineering in Emerging Technologies - Proc. SWQD 2017, Lecture Notes in Business Information Processing, volume 269, pages 133-152, DOI 10.1007/978-3-319-49421-0_10, January, 2017.

C. Salomon, R. Ramler, A. Mayrhofer, G. Sperrer. Towards information management support in testing and piloting of complex mechatronic systems: An industry case study. In F. Piazolo, V. Geist, L. Brehm, R. Schmidt (editors), Innovations in Enterprise Information Systems Management and Engineering - ERP Future 2016 - Research, Revised Papers, Lecture Notes in Business Information Processing, volume 285, pages 69-76, DOI 10.1007/978-3-319-58801-8_6, Springer, Mayr, 2017.

R. Ramler, T. Ziebermayr. What you see is what you test - Augmenting software testing with computer vision. Proceedings of the 10th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2017), pages 398-400, DOI 10.1109/ICSTW.2017.76, IEEE, March, 2017.

T. Wetzlmaier, R. Ramler, W. Putschögl. A framework for monkey GUI testing. Proceedings of the 9th IEEE International Conference on Software Testing, Verification and Validation (ICSTW 2016), pages 416-423, DOI 10.1109/ICST.2016.51, IEEE, April, 2016.

S. Fischer, R. Lopez-Herrejon, R. Ramler, A. Egyed. A preliminary empirical assessment of similarity for combinatorial interaction testing of software product lines. Proceedings of the 9th International Workshop on Search-Based Software Testing (SBST'16), pages 15-18, DOI 10.1145/2897010.2897011, ACM, May, 2016.

C. Klammer, R. Ramler, M. Winterer, H. Stummer. Analyzing performance issues of industrial user interfaces: Experiences and results. Proceedings of the 42nd Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2016), pages 30-33, DOI 10.1109/SEAA.2016.61, IEEE, August, 2016.

R. Ramler, M. Moser, J. Pichler. Automated static analysis of unit test code. Proceedings of the 23rd IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2016), pages 25-28, DOI 10.1109/SANER.2016.102, IEEE, March, 2016.

M. Felderer, R. Ramler. Exploring expectations about risk-based Testing: Towards increasing effectiveness and efficiency. In P. Abrahamsson, A. Jedlitschka, A. Nguyen Duc, M. Felderer, S. Amasaki, T. Mikkonen (editors), Product-Focused Software Process Improvement - Proc. PROFES 2016, Lecture Notes in Computer Science, volume 10027, pages 683-688, Springer, November, 2016.

L. Ma, C. Artho, C. Zhang, H. Sato, J. Gmeiner, R. Ramler. Guiding random test generation with program analysis. Software Engineering 2016 Fachtagung des GI-Fachbereichs Softwaretechnik - Proc. SE 2016, Lecture Notes in Informatics, volume 252, pages 15-16, Gesellschaft für Informatik, February, 2016.

C. Klammer, R. Ramler, H. Stummer. Harnessing automated test case generators for GUI testing in industry. Proceedings of the 42nd Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2016), pages 227-234, DOI 10.1109/SEAA.2016.60, IEEE, August, 2016.

R. Ramler, M. Felderer, T. Kitamura, D. Marinov. Industry-academia collaboration in software testing: An overview of TAIC PART 2016. Proceedings of the 9th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW 2016), pages 238-239, DOI 10.1109/ICSTW.2016.36, IEEE, April, 2016.

R. Ramler, M. Felderer. Requirements for integrating defect prediction and risk-based testing. Proceedings of the 42nd Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2016), pages 359-362, DOI 10.1109/SEAA.2016.62, IEEE, August, 2016.

M. Felderer, R. Ramler. Risk-based software testing: Increasing effectiveness and efficiency in testing. pages Tutorial, November, 2016.

M. Felderer, R. Ramler. Risk-Based Testing: Mehr Effizienz und Effektivität im Software Test. Tutorial at SWQD 2016 - Software Quality Days 2016, Vienna, Austria, January 18-21, 2016., January, 2016.

H. Prähofer, F. Angerer, R. Ramler, F. Grillenberger. Static code analysis of IEC 61131-3 Programs: Comprehensive tool support and experiences from large-scale industrial application. IEEE Transactions on Industrial Informatics, volume 13, number 1, pages 37-47, DOI: 10.1109/TII.2016.2604760, August, 2016.

R. Lopez-Herrejon, S. Fischer, R. Ramler, A. Egyed. A first systematic mapping study on combinatorial interaction testing for software product lines. Proceedings of the IEEE 8th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 4th International Workshop on Combinatorial Testing (IWCT 2015), DOI 10.1109/ICSTW.2015.7107435, April, 2015.

R. Ramler, M. Felderer. A process for risk-based test strategy development and its industrial evaluation. In P. Abrahamsson, L. Corral, M. Oivo, B. Russo (editors), Product-Focused Software Process Improvement - Proc. PROFES 2015, pages 355-371, DOI 10.1007/978-3-319-26844-6_26, Springer, December, 2015.

J. Gmeiner, R. Ramler, J. Haslinger. Automated testing in the continous delivery pipeline: A case study of an online company. Proceedings of the IEEE 8th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 13th User Symposium on Software Quality, Test and Innovation (ASQT 2015), DOI 10.1109/ICSTW.2015.7107423, April, 2015.

S. Fischer, L. Linsbauer, R. Lopez-Herrejon, A. Egyed, R. Ramler. Bridging the gap between software variability and system variant management: Experiences from an industrial machinery product line. roceedings of the 41st Euromicro Conference series on Software Engineering and Advanced Applications (SEAA 2015), pages 402-409, DOI 10.119/SEAA.2015.57, IEEE, August, 2015.

L. Ma, C. Artho, C. Zhang, H. Sato, J. Gmeiner, R. Ramler. GRT: An automated test generator using orchestrated program analysis. Proceddings of the 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE 2015), pages 842-847, DOI 10.1109/ASE.2015.102, IEEE, November, 2015.

L. Ma, C. Artho, C. Zhang, H. Sato, J. Gmeiner, R. Ramler. GRT: Program-analysis-guided random testing. Proceddings of the 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE 2015), pages 212-223, DOI 10.1109/ASE.2015.49, IEEE, November, 2015.

T. Wetzlmaier, R. Ramler. Improving manual change impact analysis with tool support: A study in an industrial project. In D. Winkler, S. Biffl, J. Bergsmann (editors), Software Quality. Software and Systems Quality in Distributed and Mobile Environments - Proc. SWQD 2015, Lecture Notes in Business Information Processing, volume 200, pages 47-66, DOI 10.1007/978-3-319-13251-8_4, Springer, January, 2015.

N. Alshahwan, M. Felderer, R. Ramler. Industry-academia collaboration in software testing: An overview of TAIC PART 2015. Proceedings of the IEEE 8th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), 10th Testing: Academic & Industrial Conference - Practice and Research Techniques (TAIC PART 2015), DOI 10.1109/ICSTW.2015.7107463, April, 2015.

C. Artho, M. Seidl, Q. Gros, E. Choi, T. Kitamura, A. Mori, R. Ramler, Y. Yamagata. Model-based testing of stateful APIs with Modbat. Proceddings of the 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE 2015), pages 858-863, DOI 10.1109/ASE.2015.95, IEEE, November, 2015.

M. Felderer, R. Ramler. Risk orientation in software testing processes of small and medium enterprises: An exploratory and comparative study. Software Quality Journal, volume 24, number 3, pages 519-548, DOI: 10.1007/s11219-015-9289-z, August, 2015.

M. Felderer, R. Ramler. A multiple case study on risk-based testing in industry. International Journal on Software Tools for Technology Transfer (STTT), volume 16, number 5, pages 609-625, October, 2014.

R. Ramler, W. Putschögl, D. Winkler. Automated testing of industrial automation software: Practical receipts and lessons learned. In A. Nair, H. Prähofer, A. Zoitl, R. Jetley, A. Dubey, A. Kumar (editors), Proceedings of the 1st International Workshop on Modern Software Engineering Methods for Industrial Automation (MoSEMInA 2014), pages 7-16, May/June, 2014.

R. Ramler, J. Himmelbauer, T. Natschläger. Building defect prediction models in practice. In I. Ghani, W. Wan Kadir, M. Ahmad (editors), Handbook of Research on Emerging Advancements and Technologies in Software Engineering, pages 540-565, IGI Global, April, 2014.

T. Wetzlmaier, R. Ramler. Extracting dependencies from software changes: an industry experience report. Proceedings of the joint conference of the 24th International Workshop on Software Measurement (IWSM) and the 9th International Conference on Software Process and Product Measurement (Mensura) - IWSM MENSURA 2014, pages 163-168 DOI 10.1109/IWSM.Mensura.2014.12, October, 2014.

M. Felderer, R. Ramler. Integrating risk-based testing in industrial test processes. Software Quality Journal, volume 22, number 3, pages 543-575, September, 2014.

R. Ramler, J. Gmeiner. Practical challenges in test environment management. Proceedings of the 7th IEEE International Conference on Software Testing, Verification and Validation - ICST 2014, pages 358-359 DOI 10.1109/ICSTW.2014.41, IEEE, April, 2014.

C. Salomon, G. Buchgeher, R. Ramler, M. Lusser. Sherlock: A tool prototype for change-based regression testing. In D. Wuksch, B. Peischl, C. Kop (editors), ASQT 2013 - Selected Topics to the User Conference on Software Quality, Test and Innovation 2013, books@ocg.at, volume 303, pages 33-36, OCG, May, 2014.

M. Moser, R. Ramler. Static analysis for industrial automation systems (Tutorial). May/June, 2014.

P. Schnitzhofer, F. Schnitzhofer, R. Ramler. Tool support for reuse-driven elicitation and specification of user requirements. Proceedings of the 2014 40th Euromicro Conference on Software Engineering and Advanced Applications (SEAA2014), pages 267-268 DOI 10.1109/SEAA.2014.73, IEEE, August, 2014.

I. Philipp, W. Platz, R. Ramler. Value-driven testing: The inner value of test cases. In D. Wuksch, B. Peischl, C. Kop (editors), ASQT 2013 - Selected Topics to the User Conference on Software Quality, Test and Innovation 2013, books@ocg.at, volume 303, pages 70-72, OCG, May, 2014.

C. Artho, K. Hayamizu, R. Ramler, Y. Yamagata. With an open mind: How to write good models. Formal Techniques for Safety-Critical Systems - Proc. FTSCS 2013, Communications in Computer and Information Science, volume 419, pages 3-18 (DOI 10.1007/978-3-319-05416-2_2), Springer, April, 2014.

R. Ramler, T. Kopetzky, W. Platz. A business view on testing ERP Systems with value-based requirements coverage. In F. Piazolo, M. Felderer (editors), Innovation and Future of Enterprise Information Systems - Proc. ERP Future 2012 (Revised Papers), Lecture Notes in Information Systems and Organisation, volume 4, pages 219-234, Springer, June, 2013.

R. Ramler, K. Wolfmaier, T. Kopetzky. A replicated study on random test case generation and manual unit testing: How Many bugs do professional developers find?. Proceedings of the 2013 IEEE 37th Annual Computer Software and Applications Conference - COMPSAC 2013, pages 484-491, IEEE, July, 2013.

R. Ramler, W. Putschögl. A retrospection on building a custom tool for automated system testing. Proceedings of the 2013 IEEE 37th Annual Computer Software and Applications Conference - COMPSAC 2013, pages 820-821, IEEE, July, 2013.

M. Felderer, R. Ramler. Experiences and challenges of introducing risk-based testing in an industrial project. In D. Winkler, S. Biffl, J. Bergsmann (editors), Software Quality – Increasing Value in Software and Systems Development - Proc. SWQD 2013, Lecture Notes in Business Information Processing, volume 133, pages 10-29, Springer, January, 2013.

R. Ramler, M. Felderer. Experiences from an initial study on risk probability estimation based on expert opinion. Proceedings of the Joint Conference of the 23rd International Workshop on Software Measurement (IWSM) and the Eighth International Conference on Software Process and Product Measurement (Mensura), pages 93-97, October, 2013.

C. Artho, A. Biere, M. Hagiya, R. Potter, R. Ramler, Y. Tanabe, F. Weitl, M. Yamamoto. Modbat: A model-based API tester for event-driven systems. Proceedings of the 10th JSSST Dependable System Workshop (DSW 2012), pages electronical, January, 2013.

R. Ramler, J. Himmelbauer. Noise in bug report data and the impact on defect prediction results. Proceedings of the Joint Conference of the 23rd International Workshop on Software Measurement (IWSM) and the Eighth International Conference on Software Process and Product Measurement (Mensura), pages 173-180, October, 2013.

H. Prähofer, F. Angerer, R. Ramler, H. Lacheiner, F. Grillenberger. Opportunities and challenges of static code analysis of IEC 61131-3 programs. Proceedings of the 17th IEEE International Conference on Emerging Technologies & Factory Automation (ETFA2012), pages DOI: 10.1109/ETFA.2012.6489535, IEEE Xplore, May, 2013.

F. Angerer, H. Prähofer, R. Ramler, F. Grillenberger. Points-to analysis of IEC 61131-3 programs: Implementation and application. Proceedings of the 18th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA2013), pages electronically etfa2013_98, September, 2013.

R. Ramler, W. Putschögl. Reusing automated regression tests for multiple variants of a software product line. Proceedings of the 2013 IEEE 6th International Conference on Software Testing, Verification and Validation Workshops (ICSTW2013), pages 122-123, IEEE, March, 2013.

F. Angerer, H. Prähofer, R. Ramler. Static code analysis for Kemro IEC 61131-3 programs: Requirements, methods, implementation, and results. Technical Report, number SCCH-TR-1301, January, 2013.

G. Buchgeher, C. Salomon, M. Lusser, R. Ramler. Towards tool-support for test case selection in manual regression testing. Proceedings of the 2013 IEEE 6th International Conference on Software Testing, Verification and Validation Workshops (ICSTW2013), pages 74-79, IEEE, March, 2013.

B. Peischl, R. Ramler, V. Turlo, S. Mohaci, V. Safronau, T. Walter. A practitioner’s guide to integrating model-based testing in a project’s tool landscape. te Testing Experience, number 17, pages 4-14, March, 2012.

R. Ramler, T. Kaspar. Applicability and benefits of mutation analysis as an aid for unit testing. In K. D. Kwack, S. Kawata, S. Hwang, D. Han, F. Ko (editors), Proceedings of the 7th International Conference on Computing and Convergence Technology ICCCT2012 (ICCIT, ICEI and ICACT), pages 920-925, IEEE, December, 2012.

H. Lacheiner, R. Ramler. Application Lifecycle Management als Infrastruktur zur kontinuierlichen Verbesserung des Softwareprozesses. In B. Peischl (editor), Ausgewählte Beiträge zur Anwenderkonferenz für Softwarequalität und Test 2011, pages 60-71, OCG, June, 2012.

R. Ramler, T. Natschläger. Applying heuristic approaches for predicting defect-prone software components. In R. Moreno-Diaz, F. Pichler, A. Quesada (editors), Computer Aided Systems Theory - Proc. EUROCAST 2011, Part I, Lecture Notes in Computer Science, volume 6927, pages 384-391, Springer, February, 2012.

R. Ramler, T. Kopetzky, W. Platz. Combinatorial test design in the TOSCA testsuite: Lessons learned and practical implications. Proceedings of the 5th International Conferences on Software Testing, Verification and Validation, pages 569-572, IEEE, April, 2012.

D. Winkler, M. Schmidt, R. Ramler, S. Biffl. Improving unfamiliar code with unit tests: An empirical investigation on tool-supported and human-based testing. In O. Dieste, A. Jedlitschka, N. Juristo (editors), Product-Focused Software Process Improvement - Proc. PROFES 2012, volume 7373, pages 290-304, Springer, June, 2012.

R. Ramler, M. Schmidt, D. Winkler. Random test case generation and manual unit testing: substitute or complement in retrofitting tests for legacy code?. In V. Cortellessa. H. Muccini, O. Demirors (editors), Proceedings of the 38th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2012), pages 286-293, IEEE Computer Society, September, 2012.

R. Ramler, H. Lacheiner, A. Kern. Rule-based detection of process conformance violations in application lifecycle management. In D. Winkler, R. O'Connor, R. Messnarz (editors), Systems, Software and Service Process Improvement - Proc. EuroSPI 2012, Communications in Computer and Information Science, volume 301, pages 37-48, Springer, June, 2012.

R. Ramler, T. Kopetzky, W. Platz. Value-based coverage measurement in requirements-based testing: Lessons learned from an approach implemented in the TOSCA testsuite. In V. Cortellessa. H. Muccini, O. Demirors (editors), Proceedings of the 38th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2012), pages 363-366, IEEE Computer Society, September, 2012.

H. Lacheiner, R. Ramler. Application lifecycle management as infrastructure for software processes improvement and evolution: Experience and insights from industry. In S. Biffl, M. Koivuluoma, P. Abrahamsson (editors), Proceedings of the 37th EUROMICRO Conference on Software Engineering and Advanced Applications - SEAA 2011, pages 286-293, IEEE, August/September, 2011.

R. Ramler, T. Natschläger. Applying heuristic approaches for predicting defect-prone software components. February, 2011.

S. Nica, R. Ramler, F. Wotawa. Is mutation testing scalable for real-world software projects?. In T. Kanstrén (editor), Proceedings of the 3rd International Conference on Advances in System Testing and Validation Lifecycle (VALID 2011), pages 40-45, Xpert Publishing Services, October, 2011.

R. Ramler. Kurzbericht zu Lösungen für das Application Lifecycle Management 2011. Technical Report, number SCCH-TR-1101, PQE, January, 2011.

B. Peischl, R. Ramler, T. Ziebermayr, S. Mohacsi, C. Preschern. Requirements and solutions for tool integration in software test automation. In T. Kanstrén (editor), Proceedings of the 3rd International Conference on Advances in System Testing and Validation Lifecycle (VALID 2011), pages 71-77, Xpert Publishing Services, October, 2011.

B. Peischl, R. Ramler, T. Ziebermayr. Solution concepts for an integrated test automation framework. In E. Grosspietsch, K. Klöckner (editors), Proceedings of the Work in Progress Session 37th EUROMICRO Conference on Software Engineering and Advanced Applications - SEAA 2011, SEA-Publications, August/September, 2011.

R. Ramler, T. Natschläger. Building defect prediction models in practice. Technical Report, number SCCH-TR-0916, June, 2010.

R. Ramler, W. Beer, C. Klammer, K. Wolfmaier, S. Larndorfer. Concept, implementation and evaluation of a web-based software cockpit. Proceedings of the 36th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), pages 385-397, IEEE, September, 2010.

H. Lacheiner, R. Ramler. Einmal Code und zurück - Traceability im Application Lifecycle Management. Technical Report, PQE, February, 2010.

K. Wolfmaier, R. Ramler, H. Dobler. Issues in testing collection class libraries. ETOOS'10 Proceedings of the 1st Workshop on Testing Object-Oriented Systems, pages doi: 10.1145/1890692.1890696, ACM, December, 2010.

R. Ramler, C. Klammer. Kurzbericht zu Lösungen für das Application Lifecycle Management. Technical Report, number SCCH-TR-1001, PQE, February, 2010.

R. Ramler, W. Beer. Software in Zahlen - Die Vermessung von Applikationen. In H. M. Sneed, M. Baumgartner, R. Seidl (editors), pages 314-319, Hanser Verlag, 2010.

R. Ramler, W. Beer. Software-Cockpits auf Basis von Open-Source-Software. Technical Report, number SCCH-TR-1043, PQE, September, 2010.

R. Ramler, C. Klammer, T. Natschläger. The usual suspects: A case study on delivered defects per developer. Proceedings of the ACM/IEEE 4th Empirical Software Engineering and Measurement Conference (ESEM 2010), ACM, September, 2010.

R. Ramler, C. Klammer. Towards tool support for risk-driven quality assurance. Proceedings of the Work in Progress Session, SEAA 2010 and DSD 2010, JKU, September, 2010.

G. Pirklbauer, R. Ramler, R. Zeilinger. An integration-oriented model for application lifecycle management. Proceedings of the 11th International Conference con Enterprise Information Systems (ICEIS 2009), volume volume ISAS, pages 399-403, INSTICC, May, 2009.

R. Ramler, R. Zeilinger. Analyse von Lösungen für das Application Lifecycle Management. Technical Report, number SCCH-TR-0903, PQE, February, 2009.

S. Larndorfer, R. Ramler, C. Buchwiser. Dashboards, Cockpits und Projektleitstände: Herausforderung "Messsysteme für die Softwareentwicklung". OBJEKTspektrum, number 4/2009, pages 72-77, June, 2009.

S. Larndorfer, R. Ramler, C. Buchwiser. Experiences and results from establishing a software cockpit at BMD Systemhaus. Proceedings oft the 35th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2009), pages 188-194, IEEE Computer Society, August, 2009.

R. Ramler, K. Wolfmaier, E. Stauder, F. Kossak, T. Natschläger. Key questions in building defect prediction models in practice. In F. Bomarius, M. Oivo, P. Jaring, P. Abrahamsson (editors), Key Questions in Building Defect Prediction Models in Practice - Proceedings 10th International Confercne PROFES 2009, Lecture Notes in Business Information Processing, volume 32, pages 14-27, Springer Berlin Heidelberg, June, 2009.

K. Wolfmaier, R. Ramler, G. Guta, H. Dobler. Observable runtime behavior for defects indicated by automated static analysis. Computer Aided Systems Theory - EUROCAST 2009, Revised Selected Papers, Lecture Notes in Computer Science, volume 5717, pages 312-319, Springer, October, 2009.

G. Weiß, G. Pomberger, W. Beer, G. Buchgeher, B. Dorninger, J. Pichler, H. Prähofer, R. Ramler, F. Stallinger, R. Weinreich. Software engineering - processes and tools. In B. Buchberger, M. Affenzeller, A. Ferscha, M. Haller, T. Jebelean, E. Klement, P. Paule, G. Pomberger, W. Schreiner, R. Stubenrauch, R. Wagner, G. Weiß, W. Windsteiger (editors), pages 157-236, Springer, June, 2009.

R. Ramler, R. Zeilinger. State of the art in application lifecycle management. Technical Report, number SCCH-TR-0902, PQE, January, 2009.

R. Ramler, S. Larndorfer, T. Natschläger. What software repositories should be mined for defect predictors?. Proceedings oft the 35th Euromicro Conference on Software Engineering and Advanced Applications (SEAA 2009), pages 181-187, IEEE Computer Society, August, 2009.

D. Wahyudin, R. Ramler, S. Biffl. A framework for defect prediction in specific software project contexts. In Z. Huzar, R. Koci, B. Meyer, B. Walter, J. Zendulka (editors), Software Engineering Techniques - 3rd IFIP TC2 Central and East European Conference in Software Engineering Techniques, Revised Selected Papers, Lecture Notes in Computer Science, volume 4980, pages 261-274, Springer, Juni, 2008.

J. Pichler, R. Ramler. How to test the intangible properties of graphical user interfaces?. Proceedings First International Conference on Software Testing, Verification, and Validation, pages 494-497, CPS, April, 2008.

R. Ramler, K. Wolfmaier. Issues and effort in integrating data from heterogeneous software repositories and corporate databases. Proceedings of the 2nd International Symposium on Empirical Software Engineering and Measurement (ESEM'08), pages 330-332, ACM, October, 2008.

R. Ramler. The impact of product development on the lifecycle of defects. Proceedings of the 2008 International Symposium on Software Testing and Analysis, International Workshop on Defects in Large Software Systems, pages 21-25, ACM, July, 2008.

A. Beer, R. Ramler. The role of experience in software testing practice. Proceedings of the 34th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA 2008), pages 258-265, IEEE Computer Society, September, 2008.

H. Dobler, R. Ramler, K. Wolfmaier. A study of tool support for the evaluation of programming exercises. Computer Aided Systems Theory - EUROCAST 2007, Lecuture Notes in Computer Science, volume 4739, pages 376-386, Springer, 2007.

R. Ramler, K. Wolfmaier, T. Natschläger. Observing distributions in size metrics: Experience from analyzing large software systems. Proc. 31st IEEE Int. Computer Software and Applications Conference, volume II, pages 299-304, IEEE Computer Society, July, 2007.

S. Larndorfer, R. Ramler. TestCockpit: Business intelligence for test management. In P. Müller, P. Liggesmeyer (editors), Proc. of the Work in Progress Session in conjunction with 33rd EUROMICRO Conf. on Software Engineering and Advanced Applications, J. Kepler University Linz, August, 2007.

S. Larndorfer, R. Ramler, C. Federspiel, K. Lehner. Testing high-reliability software for continuous casting steel plants - experiences and lessons learned from Siemens VAI. In P. Müller, P. Liggesmeyer, E. Maehle (editors), Proc. 33rd EUROMICRO Conf. on Software Engineering and Advanced Applications (SEAA 2007), pages 255-262, IEEE Computer Society, August, 2007.

R. Ramler, K. Wolfmaier. Economic perspectives in test automation: Balancing automated and manual testing with opportunity cost. Proc. of the Workshop on Automation of Software Test (AST'06) at 28th Int. Conf. on Software Engineering (ICSE'06)., pages 85-91, ACM, May, 2006.

R. Ramler, D. Winkler. Exploratory testing: An empirical study approach. Proc. Work in Progress Session, 32nd EUROMICRO Conf. in Software Engineering and Advanced Applications (SEAA 2006), SEA-Publications, August/September, 2006.

W. Beer, R. Ramler, G. Leonhartsberger. Provision and benefits of a unified bug tracking API. Proc. Work in Progress Session, 32nd EUROMICRO Conf. in Software Engineering and Advanced Applications (SEAA 2006), SEA-Publications, August/September, 2006.

C. Steindl, R. Ramler, J. Altmann. Testing web applications. In G. Kappel, B. Pröll, S. Reich, W. Retschitzegger (editors), Web Engineering: The Discipline of Systematic Development of Web Applications, pages 133-154, John Wiley & Sons, 2006.

R. Ramler, S. Biffl. Values-based management of software testing. In S. Biffl, A. Aurum, B. Boehm, H. Erdogmus, P. Grünbacher (editors), Value-based Software Engineering, pages 225-245, Springer, 2006.

K. Wolfmaier, R. Ramler. Common findings and lessons learned from software architecture and design analysis. Proc. 11th IEEE Int. Software Metrics Symposium (METRICS2000), IEEE Computer Society, September, 2005.

R. Ramler. Decision in software testing. April, 2005.

R. Ramler, D. Auer. Encouraging self-organization: Reflections on a quality improvement workshop. Proc. 31st Euromicro Conf. on Software Engineering and Advanced Applications (SEAA 2005), pages 284-291, IEEE Computer Society, August/September, 2005.

R. Ramler. Decision support for test management in interactive and evolutionary development: A proposal. Proc. Alpine Software Engineering Workshop (ASEW'04), pages 27-30, April, 2004.

R. Ramler. Decision support for test management in iterative and evolutionary development. Proc. 19th Int. Conf. on Automated Software Engineering (ASE 2004), pages 406-409, IEEE Computer Society, September, 2004.

R. Ramler, K. Wolfmaier, E. Weippl. From maintenance to evolutionary development of web applications: A pragmatic approach. In N. Koch, P. Fraternali, M. Wirsing (editors), Proc. 4th Int. Conf. on Web Engineering (ICWE 04), Lecture Notes in Computer Science, volume 3140, pages 287-299, Springer, 2004.

P. Grünbacher, R. Ramler, W. Retschitzegger, W. Schwinger. Making quality a first-class citizen in web engineering. Proc. 2nd Workshop on Software Quality (ICSE 04), pages 24-29, May, 2004.

C. Steindl, R. Ramler, J. Altmann. Testen von Web-Anwendungen. In G. Kappel, B. Pröll, S. Reich, W. Retschitzegger (editors), Web Engineering: Systematische Entwicklung von Web-Anwendungen, pages 161-186, dpunkt.verlag, 2003.

R. Ramler, G. Czech, D. Schlosser. Unit testing beyond a bar in green and red. In M. Marchesi, G. Succi (editors), Proc. 4th Int. Conf. XP 2003: Extreme Programming and Agile Processes in Software Engineering, Lecture Notes in Computer Science, volume 2675, pages 319-321, Springer, May, 2003.

R. Ramler, J. Altmann. A quality-based scheme for web testing. Proc. 24th Int. Conf. on Software Engineering (ICSE 2002), May, 2002.

R. Ramler, E. Weippl, M. Winterer, W. Schwinger, J. Altmann. A quality-driven approach to web testing. Proc. Ibero American Conf. on Web Engineering 2002 (ICWE'02), pages 81-95, September, 2002.

R. Ramler, W. Schwinger, J. Altmann. Testing web quality aspects. Technical Report, number SCCH-TR-0216, 2002.

R. Ramler, J. Altmann. State-of-the-art in web application testing. Technical Report, number SCCH-TR-0167, 2001.

C. Klammer, G. Buchgeher, A. Kern. A retrospective of production and test code co-evolution in an industrial project. In C. Artho, R. Ramler (editors), Proceedings of the 2nd Workshop on Validation, Analysis and Evolution of Software Tests (VST 2018), pages 16-20, IEEE, March, 2018.

Proceedings of the 2nd Workshop on Validation, Analysis and Evolution of Software Tests (VST 2018). In C. Artho, R. Ramler (editors), IEEE, March, 2018.

Software Quality Journal, Special issue on collaboration in software testing. In M. Felderer, R. Ramler (editors), volume 25, December, 2017.