CRAG: Comprehensive RAG Challenge

Workshop

The goal of this workshop is to engage in a detailed discussion on retrieval-augmented generation (RAG), with a special focus on the standout solutions from the KDD Cup 2024 on Comprehensive RAG Challenge. The workshop is an in-person event co-located with KDD 2024 in Barcelona, Spain on Tuesday, August 27, 2024. See paper submission, registration, hotel, and local information for attending.

The event will run from 11:00 to 16:30, with a lunch break scheduled from 13:05 to 14:00.

10:30–11:00 Poster Setup & Coffee Break
11:00–13:05 Session 1
  • [11:00–11:30] Opening remarks and competition summary (slides)
  • [11:30–12:05] Keynote talk 1 (30 min talk, 5 min Q&A)
    • Juan Sequeda: Increasing the LLM Accuracy for Question Answering on Structured Data: Knowledge Graphs to the Rescue!
  • [12:05–13:05] Team talk 1–3 (20 min each)
    • Team db3: Winning Solution for Meta KDD Cup’24 (slides)
    • Team APEX: Revisiting the Solution of Meta KDD Cup 2024 : CRAG (slides)
    • Team md_dh: MARAGS: A Multi-Adapter System for Multi-Task Retrieval Augmented Generation Question Answering (slides)
13:05–14:00 Lunch & Social Break
14:00–16:00 Session 2
  • [14:00–14:35] Keynote talk 2 (30 min talk, 5 min Q&A)
    • Mohit Iyyer: How can retrieval aid long-form text generation? (slides)
  • [14:35–15:10] Keynote talk 3 (30 min talk, 5 min Q&A)
    • Patrick Lewis: RAG, Past, Present, Future
  • [15:10–15:55] Team talk 4–6 (15 min each)
    • Team dRAGonRAnGers: KDD Cup Meta CRAG 2024: Three-step Question-Answering Framework (slides)
    • Team dummy_model: A Simple yet Effective Retrieval-Augmented Generation Framework for the Meta KDD Cup 2024 (slides)
    • Team ElectricSheep: A Hybrid RAG System with Comprehensive Enhancement on Complex Reasoning (slides)
  • [15:55–16:00] Closing remarks (slides)
16:00–16:30 Poster Session & Coffee Break