Details
Role
Key Researcher
Key Researcher
Connected to
WP4: Media Content Interaction & Accessibility
WP4: Media Content Interaction & Accessibility
Affiliation
University of Bergen
University of Bergen
Contact
/ Biography
Frode Guribye is a Professor of Information Science at the Department of Information Science and Media Studies, University of Bergen, Norway. He focuses on human-computer interaction and the social implications of information and communication technologies. His research spans various application areas such as technology enhanced learning, computing and mental health and mobile journalism. Across these areas he is doing research through design and empirical studies aiming to critically and constructively understand the potential and limitations of emerging technologies.
/ Publications
Publications from 2020 and before are not direct results of the SFI MediaFutures, but are key results from our team members working on related topics in MediaFutures.
2024
Andrews, Peter; Nordberg, Oda Elise; Guribye, Frode; Fjeld, Morten; Borch, Njål
Designing for Automated Sports Commentary Systems Conference
IMX'24, 2024.
@conference{designing_for_automated24,
title = {Designing for Automated Sports Commentary Systems},
author = {Peter Andrews and Oda Elise Nordberg and Frode Guribye and Morten Fjeld and Njål Borch },
url = {https://mediafutures.no/designing_for_automated_sports_commentary_systems-2/},
year = {2024},
date = {2024-06-12},
booktitle = {IMX'24},
abstract = {Advancements in Natural Language Processing (NLP) and Computer Vision (CV) are revolutionizing how we experience sports broadcasting. Traditionally, sports commentary has played a crucial role in enhancing viewer understanding and engagement with live games. Yet, the prospects of automated commentary, especially in light of these technological advancements and their impact on viewers’ experience, remain largely unexplored. This paper elaborates upon an innovative automated commentary system that integrates NLP and CV to provide a multimodal experience, combining auditory feedback through text-to-speech and visual cues, known as italicizing, for real-time in-game commentary. The system supports color commentary, which aims to inform the viewer of information surrounding the game by pulling additional content from a database. Moreover, it also supports play-by-play commentary covering in-game developments derived from an event system based on CV. As the system reinvents the role of commentary in sports video, we must consider the design and implications of multimodal artificial commentators. A focused user study with eight participants aimed at understanding the design implications of such multimodal artificial commentators reveals critical insights. Key findings emphasize the importance of language precision, content relevance, and delivery style in automated commentary, underscoring the necessity for personalization to meet diverse viewer preferences. Our results validate the potential value and effectiveness of multimodal feedback and derive design considerations, particularly in personalizing content to revolutionize the role of commentary in sports broadcasts.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Advancements in Natural Language Processing (NLP) and Computer Vision (CV) are revolutionizing how we experience sports broadcasting. Traditionally, sports commentary has played a crucial role in enhancing viewer understanding and engagement with live games. Yet, the prospects of automated commentary, especially in light of these technological advancements and their impact on viewers’ experience, remain largely unexplored. This paper elaborates upon an innovative automated commentary system that integrates NLP and CV to provide a multimodal experience, combining auditory feedback through text-to-speech and visual cues, known as italicizing, for real-time in-game commentary. The system supports color commentary, which aims to inform the viewer of information surrounding the game by pulling additional content from a database. Moreover, it also supports play-by-play commentary covering in-game developments derived from an event system based on CV. As the system reinvents the role of commentary in sports video, we must consider the design and implications of multimodal artificial commentators. A focused user study with eight participants aimed at understanding the design implications of such multimodal artificial commentators reveals critical insights. Key findings emphasize the importance of language precision, content relevance, and delivery style in automated commentary, underscoring the necessity for personalization to meet diverse viewer preferences. Our results validate the potential value and effectiveness of multimodal feedback and derive design considerations, particularly in personalizing content to revolutionize the role of commentary in sports broadcasts.
Andrews, Peter; Nordberg, Oda Elise; Guribye, Frode; Fujita, Kazuyuki; Fjeld, Morten; Borch, Njål
AiCommentator: A Multimodal Conversational Agent for Embedded Visualization in Football Viewing Conference
2024.
@conference{AIComment,
title = {AiCommentator: A Multimodal Conversational Agent for Embedded Visualization in Football Viewing},
author = {Peter Andrews and Oda Elise Nordberg and Frode Guribye and Kazuyuki Fujita and Morten Fjeld and Njål Borch},
url = {https://mediafutures.no/acm_iui_24_aicommentator_peterandrews-1/},
year = {2024},
date = {2024-03-18},
urldate = {2024-03-18},
journal = {Intelligent User Interfaces (IUI)},
abstract = {Traditionally, sports commentators provide viewers with diverse information, encompassing in-game developments and player performances. Yet young adult football viewers increasingly use mobile devices for deeper insights during football matches. Such insights into players on the pitch and performance statistics support viewers’ understanding of game stakes, creating a more engaging viewing experience. Inspired by commentators’ traditional roles and to incorporate information into a single platform, we developed AiCommentator, a Multimodal Conversational Agent (MCA) for embedded visualization and conversational interactions in football broadcast video. AiCommentator integrates embedded visualization, either with an automated non-interactive or with a responsive interactive commentary mode. Our system builds upon multimodal techniques, integrating computer vision and large language models, to demonstrate ways for designing tailored, interactive sports-viewing content. AiCommentator’s event system infers game states based on a multi-object tracking algorithm and computer vision backend, facilitating automated responsive commentary. We address three key topics: evaluating young adults’ satisfaction and immersion across the two viewing modes, enhancing viewer understanding of in-game events and players on the pitch, and devising methods to present this information in a usable manner. In a mixed-method evaluation (n=16) of AiCommentator, we found that the participants appreciated aspects of both system modes but preferred the interactive mode, expressing a higher degree of engagement and satisfaction. Our paper reports on our development of AiCommentator and presents the results from our user study, demonstrating the promise of interactive MCA for a more engaging sports viewing experience. Systems like AiCommentator could be pivotal in transforming the interactivity and accessibility of sports content, revolutionizing how sports viewers engage with video content.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Traditionally, sports commentators provide viewers with diverse information, encompassing in-game developments and player performances. Yet young adult football viewers increasingly use mobile devices for deeper insights during football matches. Such insights into players on the pitch and performance statistics support viewers’ understanding of game stakes, creating a more engaging viewing experience. Inspired by commentators’ traditional roles and to incorporate information into a single platform, we developed AiCommentator, a Multimodal Conversational Agent (MCA) for embedded visualization and conversational interactions in football broadcast video. AiCommentator integrates embedded visualization, either with an automated non-interactive or with a responsive interactive commentary mode. Our system builds upon multimodal techniques, integrating computer vision and large language models, to demonstrate ways for designing tailored, interactive sports-viewing content. AiCommentator’s event system infers game states based on a multi-object tracking algorithm and computer vision backend, facilitating automated responsive commentary. We address three key topics: evaluating young adults’ satisfaction and immersion across the two viewing modes, enhancing viewer understanding of in-game events and players on the pitch, and devising methods to present this information in a usable manner. In a mixed-method evaluation (n=16) of AiCommentator, we found that the participants appreciated aspects of both system modes but preferred the interactive mode, expressing a higher degree of engagement and satisfaction. Our paper reports on our development of AiCommentator and presents the results from our user study, demonstrating the promise of interactive MCA for a more engaging sports viewing experience. Systems like AiCommentator could be pivotal in transforming the interactivity and accessibility of sports content, revolutionizing how sports viewers engage with video content.
2020
Soe, Than Htut; Nordberg, Oda Elise; Guribye, Frode; Slavkovik, Marija
Circumvention by design - dark patterns in cookie consents for online news outlets Conference
Proceedings of the 11th Nordic Conference on Human-Computer Interaction, 2020, (Pre SFI).
@conference{Soe2020,
title = {Circumvention by design - dark patterns in cookie consents for online news outlets},
author = {Than Htut Soe and Oda Elise Nordberg and Frode Guribye and Marija Slavkovik},
url = {https://dl.acm.org/doi/pdf/10.1145/3419249.3420132},
doi = {10.1145/3419249.3420132},
year = {2020},
date = {2020-06-24},
booktitle = {Proceedings of the 11th Nordic Conference on Human-Computer Interaction},
abstract = {To ensure that users of online services understand what data are collected and how they are used in algorithmic decision-making, the European Union's General Data Protection Regulation (GDPR) specifies informed consent as a minimal requirement. For online news outlets consent is commonly elicited through interface design elements in the form of a pop-up. We have manually analyzed 300 data collection consent notices from news outlets that are built to ensure compliance with GDPR. The analysis uncovered a variety of strategies or dark patterns that circumvent the intent of GDPR by design. We further study the presence and variety of these dark patterns in these "cookie consents" and use our observations to specify the concept of dark pattern in the context of consent elicitation.},
note = {Pre SFI},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
To ensure that users of online services understand what data are collected and how they are used in algorithmic decision-making, the European Union's General Data Protection Regulation (GDPR) specifies informed consent as a minimal requirement. For online news outlets consent is commonly elicited through interface design elements in the form of a pop-up. We have manually analyzed 300 data collection consent notices from news outlets that are built to ensure compliance with GDPR. The analysis uncovered a variety of strategies or dark patterns that circumvent the intent of GDPR by design. We further study the presence and variety of these dark patterns in these "cookie consents" and use our observations to specify the concept of dark pattern in the context of consent elicitation.
Okopnyi, Pavel; Juhlin, Oskar; Guribye, Frode
Unpacking Editorial Agreements in Collaborative Video Production Conference
IMX '20: ACM International Conference on Interactive Media Experiences, New York, 2020, (Pre SFI).
@conference{Okopnyi2020,
title = {Unpacking Editorial Agreements in Collaborative Video Production},
author = {Pavel Okopnyi and Oskar Juhlin and Frode Guribye},
url = {https://www.researchgate.net/publication/342251635_Unpacking_Editorial_Agreements_in_Collaborative_Video_Production},
doi = {https://doi.org/10.1145/3391614.3393652},
year = {2020},
date = {2020-06-01},
booktitle = {IMX '20: ACM International Conference on Interactive Media Experiences},
pages = {117–126},
address = {New York},
abstract = {Video production is a collaborative process involving creative, artistic and technical elements that require a multitude of specialised skill sets. This open-ended work is often marked by uncertainty and interpretive flexibility in terms of what the product is and should be. At the same time, most current video production tools are designed for single users. There is a growing interest, both in industry and academia, to design features that support key collaborative processes in editing, such as commenting on videos. We add to current research by unpacking specific forms of collaboration, in particular the social mechanisms and strategies employed to reduce interpretive flexibility and uncertainty in achieving agreements between editors and other collaborators. The findings contribute to the emerging design interest by identifying general design paths for how to support collaboration in video editing through scaffolding, iconic referencing, and suggestive editing.},
note = {Pre SFI},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Video production is a collaborative process involving creative, artistic and technical elements that require a multitude of specialised skill sets. This open-ended work is often marked by uncertainty and interpretive flexibility in terms of what the product is and should be. At the same time, most current video production tools are designed for single users. There is a growing interest, both in industry and academia, to design features that support key collaborative processes in editing, such as commenting on videos. We add to current research by unpacking specific forms of collaboration, in particular the social mechanisms and strategies employed to reduce interpretive flexibility and uncertainty in achieving agreements between editors and other collaborators. The findings contribute to the emerging design interest by identifying general design paths for how to support collaboration in video editing through scaffolding, iconic referencing, and suggestive editing.
Salzmann, Anja; Guribye, Frode; Gynnild, Astrid
“We in the Mojo Community” – Exploring a Global Network of Mobile Journalists Journal Article
In: Journalism Practice, pp. 1-18, 2020, (Pre SFI).
@article{Salzmann2020,
title = {“We in the Mojo Community” – Exploring a Global Network of Mobile Journalists},
author = {Anja Salzmann and Frode Guribye and Astrid Gynnild},
url = {https://www.tandfonline.com/doi/epub/10.1080/17512786.2020.1742772?needAccess=true},
doi = {https://doi.org/10.1080/17512786.2020.1742772},
year = {2020},
date = {2020-04-03},
journal = {Journalism Practice},
pages = {1-18},
abstract = {Mobile journalism is a fast-growing area of journalistic innovation that requires new skills and work practices. Thus, a major challenge for journalists is learning not only how to keep up with new gadgets but how to advance and develop a mojo mindset to pursue their interests and solidify future work options. This paper investigates a globally pioneering network of mojo journalism, the Mojo Community, that consists of journalists and practitioners dedicated to creating multimedia content using mobile technologies. The study is based on empirical data from interviews with and the observation of the participants of the community over a two-year period. The analysis draws on Wenger’s concept of “communities of practice” to explore the domain, structure, and role of this communal formation for innovation and change in journalistic practices. The community’s core group is comprised of journalists mainly affiliated with legacy broadcast organizations and with a particular interest in and extensive knowledge of mobile technologies. The participants perceive their engagement with the community as a way of meeting the challenges of organizational reluctance to change, fast-evolving technological advancements, and uncertain job prospects.},
note = {Pre SFI},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Mobile journalism is a fast-growing area of journalistic innovation that requires new skills and work practices. Thus, a major challenge for journalists is learning not only how to keep up with new gadgets but how to advance and develop a mojo mindset to pursue their interests and solidify future work options. This paper investigates a globally pioneering network of mojo journalism, the Mojo Community, that consists of journalists and practitioners dedicated to creating multimedia content using mobile technologies. The study is based on empirical data from interviews with and the observation of the participants of the community over a two-year period. The analysis draws on Wenger’s concept of “communities of practice” to explore the domain, structure, and role of this communal formation for innovation and change in journalistic practices. The community’s core group is comprised of journalists mainly affiliated with legacy broadcast organizations and with a particular interest in and extensive knowledge of mobile technologies. The participants perceive their engagement with the community as a way of meeting the challenges of organizational reluctance to change, fast-evolving technological advancements, and uncertain job prospects.
2019
Flobak, Eivind; Wake, Jo Dugstad; Vindenes, Joakim; Kahlon, Smiti; Nordgreen, T.; Guribye, Frode
Participatory Design of VR Scenarios for Exposure Therapy Conference
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19), no. Paper 569, New York, 2019, (Pre SFI).
@conference{Flobak2019,
title = {Participatory Design of VR Scenarios for Exposure Therapy},
author = {Eivind Flobak and Jo Dugstad Wake and Joakim Vindenes and Smiti Kahlon and T. Nordgreen and Frode Guribye},
url = {https://www.researchgate.net/publication/330205387_Participatory_Design_of_VR_Scenarios_for_Exposure_Therapy},
doi = {10.1145/3290605.3300799 },
year = {2019},
date = {2019-05-01},
booktitle = {Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19)},
number = {Paper 569},
address = {New York},
abstract = {Virtual reality (VR) applications for exposure therapy predominantly use computer-generated imagery to create controlled environments in which users can be exposed to their fears. Creating 3D animations, however, is demanding and time-consuming. This paper presents a participatory approach for prototyping VR scenarios that are enabled by 360° video and grounded in lived experiences. We organized a participa-tory workshop with adolescents to prototype such scenarios, consisting of iterative phases of ideation, storyboarding, live-action plays recorded by a 360° camera, and group evaluation. Through an analysis of the participants' interactions, we outline how they worked to design prototypes that depict situations relevant to those with a fear of public speaking. Our analysis also explores how participants used their experiences and refections as resources for design. Six clinical psychologists evaluated the prototypes from the workshop and concluded they were viable therapeutic tools, emphasizing the immer-sive, realistic experience they presented. We argue that our approach makes the design of VR scenarios more accessible.},
note = {Pre SFI},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Virtual reality (VR) applications for exposure therapy predominantly use computer-generated imagery to create controlled environments in which users can be exposed to their fears. Creating 3D animations, however, is demanding and time-consuming. This paper presents a participatory approach for prototyping VR scenarios that are enabled by 360° video and grounded in lived experiences. We organized a participa-tory workshop with adolescents to prototype such scenarios, consisting of iterative phases of ideation, storyboarding, live-action plays recorded by a 360° camera, and group evaluation. Through an analysis of the participants' interactions, we outline how they worked to design prototypes that depict situations relevant to those with a fear of public speaking. Our analysis also explores how participants used their experiences and refections as resources for design. Six clinical psychologists evaluated the prototypes from the workshop and concluded they were viable therapeutic tools, emphasizing the immer-sive, realistic experience they presented. We argue that our approach makes the design of VR scenarios more accessible.
2016
Guribye, Frode; Nyre, Lars
The changing ecology of tools for live news reporting Journal Article
In: Journalism Practice, vol. 10, no. 11, pp. 1216-1230, 2016, ISSN: 1751-2794, (Pre SFI).
@article{Guribye2016,
title = {The changing ecology of tools for live news reporting},
author = {Frode Guribye and Lars Nyre},
url = {https://www.tandfonline.com/doi/pdf/10.1080/17512786.2016.1259011?needAccess=true},
doi = {10.1080/17512786.2016.1259011},
issn = {1751-2794},
year = {2016},
date = {2016-12-05},
journal = {Journalism Practice},
volume = {10},
number = {11},
pages = {1216-1230},
abstract = {Broadcast news channels provide fresh, continuously updated coverage of events, in sharp competition with other news channels in the same market. The live moment is a valuable feature, and broadcasters have always relied on teams that can react quickly to breaking news and report live from the scene. Technology plays an important role in the production of live news, and a number of tools are applied by skilled actors in what can be called an ecology of tools for live news reporting. This study explores new video tools for television news, and the tinkering conducted by the reporting teams to adapt to such tools. Six journalists and photographers at broadcaster TV 2 in Norway were interviewed about their everyday work practices out in the field, and we present the findings in an analysis where six aspects of contemporary live news reporting are explored: (1) from heavy to light equipment, (2) more live news at TV 2, (3) the practice of going live, (4) the mobility of live reporters, (5) tinkering to go live, and (6) quicker pace of production. In the concluding remarks we summarize our insights about live news reporting.},
note = {Pre SFI},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Broadcast news channels provide fresh, continuously updated coverage of events, in sharp competition with other news channels in the same market. The live moment is a valuable feature, and broadcasters have always relied on teams that can react quickly to breaking news and report live from the scene. Technology plays an important role in the production of live news, and a number of tools are applied by skilled actors in what can be called an ecology of tools for live news reporting. This study explores new video tools for television news, and the tinkering conducted by the reporting teams to adapt to such tools. Six journalists and photographers at broadcaster TV 2 in Norway were interviewed about their everyday work practices out in the field, and we present the findings in an analysis where six aspects of contemporary live news reporting are explored: (1) from heavy to light equipment, (2) more live news at TV 2, (3) the practice of going live, (4) the mobility of live reporters, (5) tinkering to go live, and (6) quicker pace of production. In the concluding remarks we summarize our insights about live news reporting.