Skip to main content
Past eventPartner event

HUD Frontier / RSI RL Environments Hackathon

agentsAIresearcherrobotics
HUD Frontier / RSI RL Environments Hackathon

Overview

🚨 IMPORTANT β€” Please sign up at https://events.ycombinator.com/hud-frontier-june-26 by Friday 17th June 11:59 PM PT. Applications submitted on Luma will NOT be reviewed or recognized.

HUD (W25) and YC are co-hosting the first RSI hackathon β€” a technical weekend focused on frontier RL environments, post-training datasets, evals, and RFT workflows. RL Environments are one of the best ways to improve frontier model capabilities.

The future is possible β€” we need to teach models how to get there.

Try to imagine what a world of 2040 looks like, then work backwards.

We want teams building environments and agents that push model capabilities in coding, ML research, robotics, manufacturing, gaming, agentic collaboration, and autonomous businesses. We encourage highly ambitious and creative projects: autonomous research, fully autonomous businesses, and physical real-life applications of autonomy (VLAs, robotics, manufacturing, etc.).

TL;DR: You can improve models at anything you can verify. The only question left to answer is: what will you teach them?


πŸ› οΈ Who Should Apply

Techno-optimists, ML researchers, engineers, and anyone ambitious who wants to shape the future of models. You don't need previous RL experience.

🎯 Why Join

  • Spend 24 hours collaborating and competing with top builders from across San Francisco and beyond
  • Build SoTA agents, evals, and post-training data
  • Learn and use Reinforcement Learning and Reinforcement Fine-Tuning
  • Get hands-on with the latest tools from companies on the cutting edge
  • Hear directly from industry leaders about what they're building and what they've learned

πŸ† Prizes

  • Grand Prize: Guaranteed YC interview for the next batch
  • A robo-dog, Mac Minis, AirPods Max, AirPods Pro 3, gift cards, and more
  • Sponsor API credits + swag for every participant

πŸ“… Schedule

Saturday, June 20

  • 11:00 AM β€” Doors open, lunch served
  • 12:00 PM β€” Opening ceremony
  • 12:30 PM β€” Hacking begins
  • 6:30 PM β€” Dinner served
  • Hacking continues overnight

Sunday, June 21

  • 8:30 AM β€” Breakfast served
  • 12:00 PM β€” Lunch served
  • 1:30 PM β€” Hacking stops, judging begins
  • 1:45 PM β€” Final presentations
  • 2:45 PM β€” Prizes
  • 3:30 PM β€” Event ends

🍴 Food

All meals catered on-site (breakfast, lunch, dinner) + coffee, snacks, and late-night fuel throughout. Dietary restrictions captured in the application β€” vegetarian, vegan, halal, and gluten-free covered.

🀝 Sponsors

  • HUD: The platform to build RL Environments and agentic evaluations
  • Y Combinator: Make something people want
  • Anthropic: Frontier AI research and the Claude model family
  • Google DeepMind: Google's world-leading AI research lab
  • Modal: AI infrastructure for GPUs and sandboxes
  • Fireworks AI: Build AI agents with fine-tuned open models
  • Daytona: Secure development environment infrastructure and sandboxes for AI agents
  • MiniMax: Frontier AI models for text, voice, video, and music generation
  • Antim Labs: Simulation infrastructure for physical AI
  • SixtyFour: AI agents for people and company research
  • Exa: The web search API for AI
  • Hillclimb: Training data for recursive self-improvement
  • Protege: Unlocking access to rich real-world datasets for AI training

Tracks

Agentic Collaboration

Core track

Autonomous Business

Core track

Best Design

Core track

Chip Design

Core track

Gaming & Worldsims

Core track

ML Research

Core track

Most Creative

Core track

Most Utopian

Core track

Most Viral

Core track

Robotics

Core track

Judges

JR

Jay Ram

Judge

PA

Parth A. Patel

Judge

Jaideep

Jaideep

Founding Engineer at HUD

Mario

Mario

Member of Technical Staff at HUD AI

PB

Paige Bailey

Judge

MH

Muhammad Hashmi

Judge

Borna Perak

Borna Perak

GTM at Daytona

Viswajit Nair

Viswajit Nair

CTO at Antim Labs

gokul8967

gokul8967

Co-founder & President at Antim Labs

eigenron

eigenron

Founding Engineer at Antim Labs

Shrey Kothari

Shrey Kothari

CEO at Antim Labs

H

Henry

founding eng at sixtyfour

Hashim

Hashim

Founding Engineer at Sixtyfour

Kesku

Kesku

Developer Relations at Exa

prdev

prdev

Research Engineer at Hillclimb

JM

Jason Mancuso

Modal

Hana Benko

Hana Benko

GTM Intern at Daytona

Jet Ravi

Jet Ravi

Judge

Y

Yifan

Fireworks AI

Xavier Roma

Xavier Roma

Research Engineer at Stealth

LM

Lorenss Martinsons

Judge

ilya

ilya

Founding Engineer at HUD AI

Chengxi Li

Chengxi Li

MTS at Fireworks AI

Vi Yang

Vi Yang

AI Product Manager at Sierra

Wanda Wang

Wanda Wang

Operating Partner at Diversis Capital

Chenyang Zhao

Chenyang Zhao

Judge

Haoguang (Kai)

Haoguang (Kai)

Program Manager at SGLang

Roland Jaloszynski

Roland Jaloszynski

Co-founder at Veltha

Ismaeel Bashir

Ismaeel Bashir

CEO at Expanse

Eren Mendi

Eren Mendi

Co-founder & CPO at Expanse

Yafet Melake

Yafet Melake

Judge

ivanleomk

ivanleomk

Software Engineer at Google

Nikodem Bieniek

Nikodem Bieniek

CTO at Expanse

LK

Lukass Kellijs

Judge

Erik Dunteman

Erik Dunteman

Member of Technical Staff at Modal

N

nancy

Judge

Projects

WinnerBuild. Scratch for Reinforcement Learning Environments

Build. Scratch for Reinforcement Learning Environments

By Team Transpira

Making RL more accessible WITH A TWIST ;)

AMA4 members
WinnerBrickedUp!

BrickedUp!

By Carataners

RSI on semi-verifiable tasks

MC2 members
WinnerTera: Zero Token Browser Use

Tera: Zero Token Browser Use

By Tera: RL Browser Environment for Zero Token Browser Use

A RL browser env (Markov Decision Process) for agents to improve and execute from past traces. Solve once; Reuse forever.

NA2 members
FinalistNomos

Nomos

By Nomos

The end of the traffic light.

ARA4 members
FinalistTraceback

Traceback

By Traceback

Snapshot the trajectory. Explore every plausible reward hack. Automatically patch the verifier. Prove the fix.

KAA4 members
FinalistTreesearch

Treesearch

By GL

RL data for Autonomous Farming Businesses

LG2 members
Join 44,000+ Builders