Publications

Publications

Papers on languages, compilers, and systems for computation across data representations and machines.

2026 8

  • OOPSLA Oct 2026

    Deegen: A JIT-Capable VM Generator for Dynamic Languages

    Haoran Xu and Fredrik Kjolstad

    PDF DOI
  • OSDI Jul 2026

    Optimal Software Pipelining and Warp Specialization for Tensor Core GPUs

    Rupanshu Soi, Rohan Yadav, Fredrik Kjolstad, Alex Aiken, Maryam Dehnavi, Michael Garland, and Michael Bauer

    PDF
  • PLDI Jun 2026

    A Compiler for Fused Relational Operations on Multisets

    James Dong and Fredrik Kjolstad

    PDF
  • PLDI Jun 2026

    Bonsai: Compiling Queries to Pruned Tree Traversals

    Alexander J Root, Christophe Gyurgyik, Purvi Goel, Kayvon Fatahalian, Jonathan Ragan-Kelley, Andrew Adams, and Fredrik Kjolstad

    Relational IR & iteration Distinguished Paper Award
    PDF
  • PLDI Jun 2026

    Decoupling Data Layouts from Bounding Volume Hierarchies

    Christophe Gyurgyik, Alexander J Root, and Fredrik Kjolstad

    PDF
  • ASPLOS Mar 2026

    FuseFlow: A Fusion-Centric Compilation Framework for Sparse Deep Learning on Streaming Dataflow

    Rubens Lacouture, Nathan Zhang, Ritvik Sharma, Marco Siracusa, Fredrik Kjolstad, Kunle Olukotun, and Olivia Hsu

    PDF
  • CGO Feb 2026

    Fast Autoscheduling for Sparse ML Frameworks

    Bobby Yan, Alexander J Root, Trevor Gale, David Broman, and Fredrik Kjolstad

    PDF DOI
  • CGO Feb 2026

    Ember: A Compiler for Embedding Operations on Decoupled Access-Execute Architectures

    Marco Siracusa, Olivia Hsu, Victor Soria-Pardos, Joshua Randall, Arnaud Grasset, Eric Biscondi, Doug Joseph, Randy Allen, Fredrik Kjolstad, Miquel Moretó Planas, and Adrià Armejach

    PDF

2025 7

  • OOPSLA Oct 2025

    REPTILE: Performant Tiling of Recurrences

    Muhammad Usman Tariq, Shiv Sundram, and Fredrik Kjolstad

    PDF
  • MICRO Oct 2025

    A Probabilistic Perspective on Tiling Sparse Tensor Algebra

    Ritvik Sharma, Zi Xue, Nathan Zhang, Rubens Lacouture, Fredrik Kjolstad, Sara Achour, and Mark Horowitz

    PDF
  • IEEE JSSC Sep 2025

    Onyx: A 12-nm Programmable Accelerator for Dense and Sparse Applications

    Kalhan Koul, Olivia Hsu, Yuchen Mei, Sai Gautham Ravipati, Maxwell Strange, Jackson Melchert, Alex Carsello, Taeyoung Kong, Po-Han Chen, Huifeng Ke, Keyi Zhang, Qiaoyi Liu, Gedeon Nyengele, Zhouhua Xie, Akhilesh Balasingam, Jayashree Adivarahan, Ritvik Sharma, Christopher Torng, Joel Emer, Fredrik Kjolstad, Mark Horowitz, and Priyanka Raina

  • IEEE Micro Apr 2025

    Designing Programmable Accelerators for Sparse Tensor Algebra

    Kalhan Koul, Zhouhua Xie, Maxwell Strange, Sai Gautham Ravipati, Bo Wun Cheng, Olivia Hsu, Po-Han Chen, Mark Horowitz, Fredrik Kjolstad, and Priyanka Raina

  • ASPLOS Apr 2025

    Automatic Tracing in Task-Based Runtime Systems

    Rohan Yadav, Michael Bauer, David Broman, Michael Garland, Alex Aiken, and Fredrik Kjolstad

    PDF
  • ASPLOS Apr 2025

    Composing Distributed Computations Through Task and Kernel Fusion.

    Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, and Fredrik Kjolstad

    PDF
  • CGO Mar 2025

    Stardust: Compiling Sparse Tensor Algebra to a Reconfigurable Dataflow Architecture

    Olivia Hsu, Alexander Rucker, Tian Zhao, Varun Desai, Kunle Olukotun, and Fredrik Kjolstad

    PDF

2024 7

  • OOPSLA Oct 2024

    Compiling Recurrences over Dense and Sparse Arrays

    Shiv Sundram, Muhammad Usman Tariq, and Fredrik Kjolstad

    PDF DOI
  • OOPSLA Oct 2024

    Compilation of Shape Operators on Sparse Arrays

    Alexander J Root, Bobby Yan, Peiming Liu, Christophe Gyurgyik, Aart J.C Bik, and Fredrik Kjolstad

    PDF DOI
  • OOPSLA Oct 2024

    Compiler Support for Sparse Tensor Convolutions

    Peiming Liu, Alexander J Root, Anlun Xu, Yinying Li, Fredrik Kjolstad, and Aart J.C Bik

    PDF
  • ISCA Jun 2024

    The Dataflow Abstract Machine Simulator Framework

    Nathan Zhang, Rubens Lacouture, Gina Sohn, Paul Mure, Qizheng Zhang, Fredrik Kjolstad, and Kunle Olukotun

    Accelerators ISCA Distinguished Artifact Award
    PDF DOI
  • PLDI Jun 2024

    Compilation of Modular and General Sparse Workspaces

    Genghan Zhang, Olivia Hsu, and Fredrik Kjolstad

    PDF
  • VLSI Jun 2024

    Onyx: A 12nm 756 GOPS/W Coarse-Grained Reconfigurable Array for Accelerating Dense and Sparse Applications

    Kalhan Koul, Maxwell Strange, Jackson Melchert, Alex Carsello, Yuchen Mei, Olivia Hsu, Taeyoung Kong, Po-Han Chen, Huifeng Ke, Keyi Zhang, Qiaoyi Liu, Gedeon Nyengele, Akhilesh Balasingam, Jayashree Adivarahan, Ritvik Sharma, Zhouhua Xie, Christopher Torng, Joel Emer, Fredrik Kjolstad, Mark Horowitz, and Priyanka Raina

  • HPCA Mar 2024

    Revet: A Language and Compiler for Dataflow Threads

    Alexander Rucker, Shiv Sundram, Coleman Smith, Matt Vilim, Raghu Prabhakar, Fredrik Kjolstad, and Kunle Olukotun

    PDF

2023 8

  • SC Nov 2023

    Legate Sparse: Distributed Sparse Computing in Python

    Rohan Yadav, Wonchan Lee, Melih Elibol, Manolis Papadakis, Taylor Lee-Patti, Michael Garland, Alex Aiken, Fredrik Kjolstad, and Michael Bauer

    PDF DOI
  • PLDI Jun 2023

    Indexed Streams: A Formal Intermediate Representation for the Fused Execution of Contraction Operations

    Scott Kovach, Praneeth Kolichala, Timothy Gu, and Fredrik Kjolstad

  • PLDI Jun 2023

    Mosaic: An Interoperable Compiler for Tensor Algebra

    Manya Bansal, Olivia Hsu, Kunle Olukotun, and Fredrik Kjolstad

    PDF DOI
  • ASPLOS Apr 2023

    BaCO: A Fast and Portable Bayesian Compiler Optimization Framework

    Erik Hellsten, Artur Souza, Johannes Lenfers, Rubens Lacouture, Olivia Hsu, Adel Ejjeh, Fredrik Kjolstad, Michel Steuwer, Kunle Olukotun, and Luigi Nardi

    PDF
  • ASPLOS Mar 2023

    The Sparse Abstract Machine

    Olivia Hsu, Maxwell Strange, Ritvik Sharma, Jaeyeon Won, Kunle Olukotun, Joel Emer, Mark Horowitz, and Fredrik Kjolstad

  • ACM TACO Mar 2023

    Unified Buffer: Compiling Image Processing and Machine Learning Applications to Push-Memory Accelerators

    Qiaoyi Liu, Jeff Setter, Dillon Huff, Maxwell Strange, Kathleen Feng, Mark Horowitz, Priyanka Raina, and Fredrik Kjolstad

    PDF
  • CGO Feb 2023

    Looplets: A Language For Structured Coiteration

    Willow Ahrens, Daniel Donenfeld, Fredrik Kjolstad, and Saman Amarasinghe

    PDF DOI
  • ACM TECS Jan 2023

    AHA: An agile approach to the design of coarse-grained reconfigurable accelerators and compilers

    Kalhan Koul, Jackson Melchert, Kavya Sreedhar, Leonard Truong, Gedeon Nyengele, Keyi Zhang, Qiaoyi Liu, Jeff Setter, Po-Han Chen, Yuchen Mei, Maxwell Strange, Ross Daly, Caleb Donovick, Alex Carsello, Taeyoung Kong, Kathleen Feng, Dillon Huff, Ankita Nayak, Raj Setaluri, James Thomas, Nikhil Bhagdikar, David Durst, Zachary Myers, Nestan Tsiskaridze, Stephen Richardson, Rick Bahr, Kayvon Fatahalian, Pat Hanrahan, Clark Barrett, Mark Horowitz, Christopher Torng, Fredrik Kjolstad, and Priyanka Raina

    PDF

2022 4

2021 2

  • OOPSLA Nov 2021

    Copy-and-Patch Compilation

    Haoran Xu and Fredrik Kjolstad

    Meta-compilation Distinguished Paper Award
  • OOPSLA Nov 2021

    Compilation of Sparse Array Programming Models

    Rawn Henry, Olivia Hsu, Rohan Yadav, Stephen Chou, Kunle Olukotun, Saman Amarasinghe, and Fredrik Kjolstad

    PDF Video

2020 4

  • OOPSLA Nov 2020

    A Sparse Iteration Space Transformation Framework for Sparse Tensor Algebra

    Ryan Senanayake, Changwan Hong, Ziheng Wang, Amalee Wilson, Stephen Chou, Shoaib Kamil, Saman Amarasinghe, and Fredrik Kjolstad

    PDF Video
  • DAC Jul 2020

    Creating an Agile Hardware Design Flow

    Rick Bahr, Clark Barrett, Nikhil Bhagdikar, Alex Carsello, Ross Daly, Caleb Donovick, David Durst, Kayvon Fatahalian, Kathleen Feng, Pat Hanrahan, Teguh Hofstee, Mark Horowitz, Dillon Huff, Fredrik Kjolstad, Taeyoung Kong, Qiaoyi Liu, Makai Mann, Jackson Melchert, Ankita Nayak, Aina Niemetz, Gedeon Nyengele, Priyanka Raina, Stephen Richardson, Raj Setaluri, Jeff Setter, Kavya Sreedhar, Maxwell Strange, James Thomas, Christopher Torng, Leonard Truong, Nestan Tsiskaridze, and Keyi Zhang

    PDF
  • SPAA Jul 2020

    Sparse Tensor Transpositions

    Suzanne Mueller, Willow Ahrens, Stephen Chou, Fredrik Kjolstad, and Saman Amarasinghe

    PDF
  • PLDI Jun 2020

    Automatic Generation of Efficient Sparse Tensor Format Conversion Routines

    Stephen Chou, Fredrik Kjolstad, and Saman Amarasinghe

    PDF Video

2019 1

2018 2

2017 2

  • ASE Nov 2017

    taco: A Tool to Generate Tensor Algebra Kernels

    Fredrik Kjolstad, Stephen Chou, David Lugato, Shoaib Kamil, and Saman Amarasinghe

    PDF Video
  • OOPSLA Oct 2017

    The Tensor Algebra Compiler

    Fredrik Kjolstad, Shoaib Kamil, Stephen Chou, David Lugato, and Saman Amarasinghe

    Sparse tensor algebra Distinguished Paper Award

2016 2

2013 1

2012 1

  • PPoPP Feb 2012

    Automatic Datatype Generation and Optimization

    Fredrik Kjolstad, Torsten Hoefler, and Marc Snir

    PDF

2011 1

  • ICSE May 2011

    Transformation for Class Immutability

    Fredrik Kjolstad, Danny Dig, Gabriel Acevedo, and Marc Snir

    PDF

2010 2