MediaFutures Demos

Below you can find a collection of Demos created by researchers at SFI MediaFutures.

Re-Ranker v2

Re-Ranker V2

2023

rerank2.demo.mediafutures.no
Anastasiia Klimashevskaia GitHub_logo

RecViz is a demonstrational tool built to receive a dataset containing a list of user profiles and pre-generated recommendations, both original ones from a baseline recommender model and post-processed ones. The dataset is inserted as a JSON object following a predefined format. After ingesting such a dataset, the system allows to display one or multiple user profiles on-demand to visually inspect their recommendations. The user profiles will show up in the interface together with multiple rows of recommendations, raw or post-processed. The platform can be used by researchers, educators, software developers and architects, data scientists and analysts. The interactive interface enables the end user to modify the visualization in the following ways: 1) The end user can select how many and which user profiles with recommendations they would like to visualize and inspect. A dropdown menu defines the number, while drag-and-drop feature lets the end user pick user profiles from the list of the available ones. 2) If multiple RS models were used to generate multiple recommendation lists for a profile, the end user would be able to select which ones to display in the interface. This way baseline recommendations can also be compared among each other. 3) In addition to recommendations, any profile descriptions or features can be included to provide more information for the analysis, e.g., user demographics or specific preferences. The tool is based on the research of Anastasiia Klimashevskaia , who provided the recommendations and recommender system, and Developed by Snorre Alvsvåg, who provided the full stack application.

I Dreamt of Something Lost

I Dreamt of Something Lost

2023

bodypoetic.itch.io/i-dreamt-of-something-lost
Florence Jane Walker GitHub_logo

The Phantasos Template is a code library designed to enable the exploration of data and the desktop interface through digital art and storytelling. It is an assemblage of Unity assets, C# scripts, and integrated plug-ins that combine to form a simple ‘fake desktop’ interface. This includes: an instant messaging system, a music player, a simulated web browser, a folder system, and a text editor. Programming has a famously steep learning curve, while electronic literature faces distinct pedagogical challenges. It is thus hoped that Phantasos will provide a valuable starting point to the novice digital writer, allowing for a deeper artistic engagement with the issues of our increasingly datafied society. I Dreamt of Something Lost is a short interactive narrative created as a demonstration of the Phantasos Template’s capabilities. It features the player character sitting down at their PC only to receive a message from their ex-girlfriend – who died a year ago to the day. The story is told almost exclusively through the characters' personal data, from instant message conversations to text files to photograph metadata. It is about how data can become a kind of haunting, how self-quantifying memory practices warp your relationship to your selfhood, and how losing someone means you also lose a version of yourself.

Faktisk

Tank Classifier

2023

faktisk.demo.mediafutures.no/tank
Sohail Ahmed Khan GitHub_logo

The wide use of social media nowadays allows for sharing unlimited amounts of information, which also means that some of it might be incorrect. Journalists state that it is very time-consuming to manually verify all content that comes in, especially when it requires domain knowledge, as it does with artillery machinery. To be able to convey the real story and sort out the false information, AI Tank Classifier in collaboration with Faktisk has been created. The AI image classifier recognizes tanks and artillery vehicles and makes it easier for journalists and fact-checkers to verify content and spend more time on researching the sources. Author: Sohail Ahmed Khan.

Faktisk

Language Checker

2023

faktisk.demo.mediafutures.no/lang
Sohail Ahmed Khan GitHub_logo

It is often that a video or an audio circulates online and contains information spoken in a language that people either do not understand or even do not recognize. This type of media can be easily used to manipulate the public by providing false translations and conveying the message that might significantly differ from the original. In order to be able to verify what language is being spoken, what is actually being said and where this language is spoken, Language Checker, created in collaboration with Faktisk, takes in an audio or video input and translates it to English, while also providing some details mentioned above. Author: Sohail Ahmed Khan.

Re-Ranker

Not Mobile Friendly

Re-Ranker

2022

rerank.demo.mediafutures.no
Anastasiia Klimashevskaia GitHub_logo DOI_logo

Recommender systems are used in practice on most streaming platforms. However, the recommendations provided to users can be affected by popularity bias, meaning that the most popular items are recommended time and time again, while more niche movies or series rarely make an appearance. Re-Ranker attempts at tackling this problem, while also taking into account user's watching history, since some users prefer popular items and, thus, should get more popular recommendations, while niche users want to discover something less mainstream. Author: Anastasiia Klimashevskaia.

Ballspark

2022

SingleDevice

Without info With info

Njål Borch GitHub_logo

MediaFutures edition of Ballspark. Soccer discussion (in Norwegian), quite heavy Bergen dialect. Fully automatic using Whisper (large) and nvidia/speakerverification titanet (large) for transcribing and speaker identification. Info links are based on a Norwegian trained network for annotation combined with simple Wikipedia searches. Author: Njål Borch.

NewsUsage

Not Mobile Friendly

News Usage

2022

newsusage.demo.mediafutures.no
Marianne Borchgrevink GitHub logo DOI logo

To be able to build successful and useful news recommender systems, it is crucial to understand media consumption, which can often be challenging for researchers due to overwhelming amount of content online that proves to be difficult to track. News Use Aggregation Tool allows to look deeper into users' media diet and visually represent how users consume media, focusing on user history over a month and providing infographics that can be used for further research. Author: Marianne Borchgrevink-Brækhus.

News in English

2022

MultiDevice

Video TextCast

Njål Borch

MediaFutures edition of News in English. Created for Norwegian school pupulils. Added some relevant articles manually, otherwise automated. Texts created fully automatic using Whisper (large) and nvidia/speakerverification titanet (large) for transcribing and speaker identification. Info links are based on a Norwegian trained network for annotation combined with simple Wikipedia searches. Author: Njål Borch.

Lørdagsrådet

2022

SingleDevice

TextCast

Njål Borch GitHub_logo

MediaFutures edition of Lørdagsrådet. A discussion show with four panelists in a humourous, fast paced problem solving debate. Fully automatic using Whisper (large) and nvidia/speakerverification titanet (large) for transcribing and speaker identification. Info links are based on a Norwegian trained network for annotation combined with simple Wikipedia searches. Author: Njål Borch.

MediaForensics

Media Forensics

2022

mediaforensics.mediafutures.no
Sohail Ahmed Khan

Fact-checking visual user-generated content is crucial to be able to navigate in the streams of information provided online. Media Forensics Repository presents a diverse set of resources to assist journalists, fact-checkers, and the public in verifying such content. Author: Sohail Ahmed Khan.

Debatten

2022

Njål Borch

MediaFutures edition of Debatten, 1. November 2022. Includes dynamic aspect ratio (MediaPipes AI), Fancy Subs (Automated, Whisper++). Author: Njål Borch.

History Extra Podcast

2022

SingleDevice

Without info With info

Njål Borch GitHub_logo

MediaFutures edition of History Extra. Fully automatic using Whisper (large) and nvidia/speakerverification titanet (large) for transcribing and speaker identification. Info links are based on a Norwegian trained network for annotation combined with simple Wikipedia searches. Author: Njål Borch.

FoodRecommenderBot

Food Recommeder Bot

2022

foodbot.demo.mediafutures.no
Ayoub El Majjodi GitHub logo DOI logo

How can recommender systems be used for guiding users towards healthy food choices? By using the Food Recommender Bot and providing their allergies and food preferences, users get access to recipes recommendations that focus on different health-related goals, compared to what users might normally eat. Available as a bot and can be used from a mobile phone. Author: Ayoub El Majjodi.

GenderGuesser

Gender Guesser

2022

genderguesser.demo.mediafutures.no
Samia Touileb DOI logo

Currently there is a big debate on use of language models for various aspects of everyday life: generating text, reviewing policies and etc. However, understanding how these models are created and what data is used for training is crucial for deciding whether these models are fair and applicable to real life. Gender Guesser lets users interactively learn about gender bias in Norwegian BERT models. Author: Samia Touileb.

VisualFeature

Not Mobile Friendly

Visual Feature Recommender

2022

visfeat.demo.mediafutures.no
Snorre Alvsvåg GitHub logo DOI logo

Movie recommenders are quite efficient at providing good suggestions, once there is enough data about both users and items from the platform. However, how do we tackle the Cold Start problem, when there is no information about users yet or when information about items themselves is unavailable? Visual Feature Recommender provides a novel way of approaching the problem by automatically extracting stylistic visual features from movie posters and recommending movies based on them. Author: Snorre Alvsvåg.

Vikingane

2021

Njål Borch

MediaFutures edition of Vikingane Series 3, episode 1. Includes recorded audio descriptions, new subtitles and dynamic aspect ratio. AI Video uses an AI to position the dynamic aspect ratio. Author: Njål Borch.

Valkyrien

2021

MultiDevice

Video Chat style AI Video

Njål Borch

MediaFutures edition of Valkyrien Series 1, episode 1. Includes recorded audio descriptions, new subtitles and dynamic aspect ratio. AI Video uses an AI to position the dynamic aspect ratio. Author: Njål Borch.

Exit2

2021

Njål Borch

MediaFutures edition of Exit Series 2, episode 1. Includes recorded audio descriptions, new subtitles and dynamic aspect ratio. AI Video uses an AI to position the dynamic aspect ratio. Author: Njål Borch.

Svaltards

2021

Njål Borch

This is a subtitled podcast (actually a radio documentary). It has been subtitled with fancy subtitles and there is also a slideshow edition where some visuals have been added. No controls or audio on the chat, so slides must be used to control it (for now). Author: Njål Borch.

Controllability

Not Mobile Friendly

Controlling Multi-list Recommendations

2020

multilist.demo.mediafutures.no
GitHub logo DOI logo

In recommender systems, the concept of control is associated with ways users can manipulate the system through interactions or by defining parameters in order to be provided more personal and better recommendations. Other studies in the movie domain have found that users may have a divergent perception of similarity regarding which features are important to them when looking for similar movies. This thesis sets out to investigate if these divergent opinions on similarity can be leveraged by controllability in the multi-lists presentation of recommendations. This thesis shows that user control did not appear to be evaluated more positively than a non-control recommender system for the average participant. This thesis found that multi lists presentation of recommendations without control were generally evaluated better than with control by performing a quantitative conditional user evaluation of the recommender system. When looking at participants’ demographic properties, it may be that some subgroups consisting of users with a higher level of domain knowledge or similar system experience may favor control. Furthermore, no significant variances between the three list sort methods that the system uses to enforce the users’ control were discovered. As controllability in recommender systems have not been extensively evaluated in the research corpus, this thesis hopes to be a starting point that can inspire future studies to attempt other novel approaches in implementing and evaluating controllability in the multi-lists presentation of recommendations to achieve more positive results. Author: Johnny Bjånesøy.

Deprecated demos

TweetSearcher

2022

Ghazaal Sheikhi Daniel Rosnes

For users who want to find relevant contextual information, including related images and news, surrounding a specific tweet. TweetSearcher collects them for you, using an image search and a news search, all that you need to start is a link to the tweet. Authors: Ghazaal Sheikhi, Daniel Rosnes.

Live Tweets

2022

Bjørnar Tessem Daniel Rosnes GitHub logo

Twitter can be very useful when a user is searching for what other people have shared about an ongoing event in real time but it can also prove difficult to find relevant tweets due to an overwhelming number of people posting at the same time. LiveTwets is a framework that monitors Twitter in order to find tweets that relate to an ongoing event. Developed with sports events in mind. Authors: Bjørnar Tessem, Daniel Rosnes.