Sleazy Ron 2: Electric Boogaloo

Dual Pi Agent Runtime Scheduler

Last year, I demoed a multi-agent system designed to generate screenplays for a 3D embodied character named Sleazy Ron, with the goal of live streaming on Twitch. While the approach worked, it felt primitive, output was often mechanical, as the LLM driving the screenplay tended to fall into repetitive patterns. The system was also limited to text generation, with little capacity for broader agent behavior.

Since then, I’ve completely reworked the runtime architecture into a dual Pi agent system.

The new design separates responsibilities between two agents:

Worker Agent (Core Pi) — operates within its own workspace and filesystem, handling reasoning, planning, and long-running tasks. It represents the agent’s “inner thoughts,” capable of performing complex actions like web searches, note-taking, and task management.

Performer Agent — runs in a continuous loop, translating the worker’s outputs into real-time expression. It generates dialogue, schedules animations, and controls camera movements dynamically via an event bridge.

This separation allows the system to think and act independently: the worker focuses on cognition and problem-solving, while the performer handles embodiment and presentation.

To support this, I built a UI that lets me steer the stream by queuing tasks for the worker. It also provides live visibility into both agents, so I can observe their internal state and behavior in real time.

The agents both run with Pi Harnesses, powered by Codex models.