Show simple item record

dc.contributor.authorQian, Crystal
dc.contributor.authorWexler, James
dc.date.accessioned2025-06-13T18:39:29Z
dc.date.available2025-06-13T18:39:29Z
dc.date.issued2024-03-18
dc.identifier.isbn979-8-4007-0508-3
dc.identifier.urihttps://hdl.handle.net/1721.1/159404
dc.descriptionIUI ’24, March 18–21, 2024, Greenville, SC, USAen_US
dc.description.abstractAlthough recent developments in generative AI have greatly enhanced the capabilities of conversational agents such as Google’s Bard or OpenAI’s ChatGPT, it’s unclear whether the usage of these agents aids users across various contexts. To better understand how access to conversational AI affects productivity and trust, we conducted a mixed-methods, task-based user study, observing 76 software engineers (N=76) as they completed a programming exam with and without access to Bard. Effects on performance, efficiency, satisfaction, and trust vary depending on user expertise, question type (open-ended "solve" questions vs. definitive "search" questions), and measurement type (demonstrated vs. self-reported). Our findings include evidence of automation complacency, increased reliance on the AI over the course of the task, and increased performance for novices on “solve”-type questions when using the AI. We discuss common behaviors, design recommendations, and impact considerations to improve collaborations with conversational AI.en_US
dc.publisherACM|29th International Conference on Intelligent User Interfacesen_US
dc.relation.isversionofhttps://doi.org/10.1145/3640543.3645198en_US
dc.rightsArticle is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.en_US
dc.sourceAssociation for Computing Machineryen_US
dc.titleTake It, Leave It, or Fix It: Measuring Productivity and Trust in Human-AI Collaborationen_US
dc.typeArticleen_US
dc.identifier.citationQian, Crystal and Wexler, James. 2024. "Take It, Leave It, or Fix It: Measuring Productivity and Trust in Human-AI Collaboration."
dc.identifier.mitlicensePUBLISHER_POLICY
dc.eprint.versionFinal published versionen_US
dc.type.urihttp://purl.org/eprint/type/ConferencePaperen_US
eprint.statushttp://purl.org/eprint/status/NonPeerRevieweden_US
dc.date.updated2025-06-01T07:48:23Z
dc.language.rfc3066en
dc.rights.holderThe author(s)
dspace.date.submission2025-06-01T07:48:23Z
mit.licensePUBLISHER_POLICY
mit.metadata.statusAuthority Work and Publication Information Neededen_US


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record