ProjectBEA
A modular, autonomous AI Persona engine. That can play minecraft!
ProjectBEA started as a simple experiment to learn Python properly and quickly spiraled into one of the most complex things I have ever built. The goal was to create an autonomous AI Persona that could hold real conversations, react with emotions, and entertain an audience on its own, all orchestrated through a modular engine where every component, from LLMs to TTS engines to OBS controls, can be swapped at runtime without touching core logic. Every capability beyond basic chat lives in a plugin skill system. The Memory skill implements a full RAG pipeline using ChromaDB, generating diary entries from past sessions and injecting relevant memories into every prompt. The Discord skill runs a cross-language voice pipeline where a Node js bot captures live audio, sends it to the Python backend for transcription and LLM processing, and streams the response back into the voice channel with barge-in detection and interrupted speech resumption. The Minecraft skill is the piece I am most proud of: a fully autonomous LLM-driven agent that plays the game from scratch, powered by a custom Fabric mod I built that exposes the entire game state over WebSocket, and a Python-side state machine that uses tool-calling to mine, craft, fight, navigate, and reason about its environment. On top of everything sits a React and FastAPI web dashboard with real-time brain activity monitoring, live chat, skill toggling, and hot-reloadable configuration. ProjectBEA is the project that turned me from someone who writes scripts into someone who can architect and manage a large, multi-module, multi-language application. It forced me to solve problems across async Python, WebSocket communication, real-time audio, vector search, LLM orchestration, and game engine modding, all within a single codebase. It is open-source and self-hostable, and I still consider it one of the best thing I have built.
PythonJavaScriptAIFastAPIRAGJavaReact