BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//MediaFutures - ECPv6.15.13.1//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://mediafutures.no
X-WR-CALDESC:Events for MediaFutures
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:Europe/Oslo
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:20230326T010000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:20231029T010000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:20240331T010000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:20241027T010000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:20250330T010000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:20251026T010000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Europe/Oslo:20240213T121500
DTEND;TZID=Europe/Oslo:20240213T130000
DTSTAMP:20260511T215654
CREATED:20240212T130128Z
LAST-MODIFIED:20240212T130128Z
UID:17830-1707826500-1707829200@mediafutures.no
SUMMARY:More Room for Language: Investigating the Effect of Retrieval on Language Models
DESCRIPTION:The Language Technology Group (LTG) at University in Oslo is organising weekly RAG seminars. They do research on a number of topics related to Natural Language Processing (NLP)\, a subfield of Artificial Intelligence enabling computers to `make sense’ of human language. This weeks speakers for the LTG research seminar are David Samuel\, Lucas Charpentier and Sondre Wold\, PhD Candidates at the LTG. \nThey will present their work on investigating the effects of pretraining with retrieval on a language model. \nThe talk will be held in room 4118\, Styrerom\, from 12:15 to 13:00 on Tuesday 13th of February and  also streamed on Zoom\, you can join with this link: https://uio.zoom.us/j/66002313655?pwd=UlZBUnRPdG9zdytIWUxmczR3TlVOQT09 \nAbstract\nRetrieval-augmented language models pose a promising alternative to standard language modeling. During pretraining\, these models search in a corpus of documents for contextually relevant information that could aid the language modeling objective. We introduce an `ideal retrieval’ methodology to study these models in a fully controllable setting. We conduct an extensive evaluation to examine how retrieval augmentation affects the behavior of the underlying language model. Among other things\, we observe that these models: {i) save substantially less world knowledge in their weights\, (ii) are better in understanding local context and inter-word dependencies\, but {iii) are worse in comprehending global context.
URL:https://mediafutures.no/event/more-room-for-language-investigating-the-effect-of-retrieval-on-language-models/
LOCATION:UiO\, Room 4118\, Styrerom
CATEGORIES:Seminar
ATTACH;FMTTYPE=image/jpeg:https://mediafutures.no/wp-content/uploads/img_20211108_121847-scaled.jpg
END:VEVENT
END:VCALENDAR