• Publications
    • A Reference Model for Empirically Comparing LLMs with Humans
    • Quality Trade-Offs in ML-Enabled Systems: A Multiple Case Study
    • Architecture Decision Records in Practice: An Action Research Study
    • Challenges in Creating Effective Automated Design Environments: An experience report from the domain of generative manufacturing
    • Continuous Compliance in the Automotive Industry
    • Focusing on What Matters: Explaining Quality Tradeoffs in Software-Intensive Systems via Dimensionality Reduction
    • Guidelines for Supporting Software Engineers in Developing Secure Web Applications
    • Human Factors in Model-Driven Engineering: Future Research Goals and Initiatives for MDE
    • Increasing the Confidence in Security Assurance Cases using Game Theory
    • Meta-Adaptation Goals: Leveraging Feedback Loop Requirements for Effective Self-Adaptation
    • Not All Conflicts Are the Same: An Empirical Study of Requirement Conflicts in Practice
    • Supporting Early Architectural Decision-Making Through Tradeoff Analysis: A Study with Volvo Cars
    • Supporting value-aware software engineering through traceability and value tactics
    • Using Boundary Objects and Methodological Island (BOMI) Modeling in Large-Scale Agile Systems Development
    • We're Drifting Apart: Architectural Drift from the Developers' Perspective
    • What Impact do my Preferences Have? A Framework for Explanation-Based Elicitation of Quality Objectives for Robotic Mission Planning
    • AMon: A Domain-Specific Language and Framework for Adaptive Monitoring of Cyber-Physical Systems
    • Explaining Quality Attribute Tradeoffs in Automated Planning for Self-Adaptive Systems
    • ExTrA: Explaining architectural design tradeoff spaces via dimensionality reduction
    • Investigating Software Engineering Artifacts in DevOps Through the Lens of Boundary Objects
    • Supporting the Exploration of Quality Attribute Tradeoffs in Large Design Spaces
    • Guidelines for Artifacts to Support Industry-Relevant Research on Self-Adaptation
    • Run-Time Adaptation of Quality Attributes for Automated Planning
    • Towards cost-benefit-aware adaptive monitoring for cyber-physical systems
    • A Negotiation Support System for Defining Utility Functions for Multi-Stakeholder Self-Adaptive Systems
    • Aligning Architecture with Business Goals in the Automotive Domain
    • Defining Utility Functions for Multi-Stakeholder Self-Adaptive Systems
    • Charting Coordination Needs in Large-Scale Agile Organisations with Boundary Objects and Methodological Islands
    • Collaborative traceability management: a multiple case study from the perspectives of organization, process, and culture
    • Managing Traceability Information Models: Not Such a Simple Task After All?
    • Modeling and Analysis of Boundary Objects and Methodological Islands in Large-Scale Systems Development
    • What do Users Expect of Bidirectional Transformations?
    • Why and how to balance alignment and diversity of requirements engineering practices in automotive
    • Why and How Your Traceability Should Evolve: Insights from an Automotive Supplier
    • Improving the Consistency and Usefulness of Architecture Descriptions: Guidelines for Architects
    • On Interfaces to Support Agile Architecting in Automotive: An Exploratory Case Study
    • Boundary objects and their use in agile systems engineering
    • Challenges of Scaled Agile for Safety-Critical Systems
    • T-Reqs: Tool Support for Managing Requirements in Large-Scale Agile System Development
    • An Architecture for Decentralized, Collaborative, and Autonomous Robots
    • Boundary Objects in Agile Practices: Continuous Management of Systems Engineering Artifacts in the Automotive Domain
    • The Problem of Consolidating RE Practices at Scale: An Ethnographic Study
    • Continuous Management of Design- and Run-Time Artifacts for Self-Adaptive Systems
    • Collaborative Traceability Management: Challenges and Opportunities
    • Traceability Maintenance: Factors and Guidelines
    • Experience of pragmatically combining RE methods for performance requirements in industry
  • News
  • Research
Publications
A Reference Model for Empirically Comparing LLMs with Humans

A Reference Model for Empirically Comparing LLMs with Humans

May 12, 2025·
Kurt Schneider
,
Farnaz Fotrousi
,
Rebekka Wohlrab
PDF Cite
Type
Conference paper
Publication
Proc. of the 47th International Conference on Software Engineering Companion (ICSE-SEIS)
Last updated on May 12, 2025
Quality Trade-Offs in ML-Enabled Systems: A Multiple Case Study Jan 1, 2025 →

© 2025 Rebekka Wohlrab

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.