Skip to main content

Posts

I Built a Pennsylvania Driver’s License Study Chatbot — Here’s Why

  I Built a Pennsylvania Driver’s License Study Chatbot — Here’s Why Preparing for your driver’s license test can be stressful. The manual is long, the rules can feel repetitive, and it’s hard to know what you actually need to memorize versus what you just need to understand conceptually. So I built something to make it easier. I created a study chatbot designed specifically to help people prepare for their driver’s license exam in Pennsylvania . It’s powered by Dify and focuses on interactive learning instead of passive reading. You can try it here: 👉 https://marvinos.online:8093/chat/n2bB1X2Tsig9Gjap Why a Chatbot? Most people study for their permit test by: Skimming the PennDOT manual Taking a few online practice quizzes Hoping for the best The problem? That approach is passive. Learning sticks better when you can: Ask follow-up questions Get explanations in plain language Practice in short bursts Focus on areas where you’re weak A chatbot is perfect for this. Instead of flippi...
Recent posts

The Centralization Trap in AI

  The Centralization Trap in AI. AI is everywhere—and the debate is intense. Enthusiasts call it a force for progress: multiplying productivity, creating new industries, and amplifying human capabilities. Critics warn of job loss, erosion of autonomy, environmental strain, and even existential risks. The real issue isn’t AI itself. It’s who controls it—and who pays the costs. Centralization Always Externalizes Harm Most AI lives in massive, centralized platforms. These data centers draw enormous amounts of electricity and water. Cooling alone can consume millions of gallons annually. High demand drives grid expansion and raises energy costs for local communities, many of whom see no benefit. Platforms also control access, dictate usage, and extract data without meaningful user oversight. Profit and influence concentrate, while environmental, economic, and social costs are externalized. The danger isn’t the technology. It’s the architecture. Why Architecture Matters Centralized AI r...

Do you want to experiment with a local LLM but don’t have a GPU?

Do you want to experiment with a local LLM but don’t have a GPU? Good news: you don’t need one. I’ve been building MarvinOS Local AI Stack (CPU-Only) ; a fully self-hosted AI environment that runs entirely on regular CPU hardware , with no cloud dependency , and no “sign up for an API key” required just to get started. If you’ve wanted to explore local LLMs, build a private knowledge base, or run AI tools in an offline lab environment, this stack is made for exactly that. What it is MarvinOS Local AI Stack (CPU-Only) is a Docker-based, rebuild-safe AI stack that gives you: a local LLM a full web chat UI RAG (Retrieval-Augmented Generation) with a vector database private web search grounding local text-to-speech HTTPS ingress with Nginx …and it all runs locally, on CPU. Why CPU-only matters Not everyone has a spare RTX card lying around. And even if you do , sometimes you want something that can run on: a small server a dev workstation a home la...

Running CUDA Apps in Docker on Ubuntu (The Modern Way)

  Running CUDA Apps in Docker on Ubuntu (The Modern Way) These days, it’s hard to find a serious Machine Learning project that doesn’t expect an NVIDIA GPU . Whether you’re training models, running inference, or doing heavy compute workloads, CUDA is usually part of the stack. The good news: you can run GPU workloads cleanly inside Docker — without turning your host machine into dependency spaghetti . In this guide, I’ll show you how to set up Docker + NVIDIA GPU support on Ubuntu and verify everything works by running a CUDA container . What You’ll Need (Prerequisites) Before you start, make sure you have: Ubuntu (x86_64) — Ubuntu 20.04+ recommended ( 22.04 and 24.04 work great ) An NVIDIA GPU with CUDA support A working NVIDIA driver installed on the host Docker Engine installed (Docker CE recommended) Note: Docker’s built-in --gpus support requires modern Docker (this has been standard for years now). Step 1 — Install Docker (Modern Ubuntu Method) This is the...

MarvinOS: Fully Self-Hosted AI

MarvinOS Local AI Stack: Fully Self-Hosted AI I magine having a powerful, fully self-hosted AI experimentation platform that allows you to explore the possibilities of artificial intelligence without relying on cloud dependencies or compromising on security. That's exactly what we're excited to introduce today — the  MarvinOS Local AI Stack ! This innovative tool is designed for local AI experimentation, secure internal LLM access, GPU-accelerated inference, and even supports offline or air-gapped environments. It also includes  Retrieval-Augmented Generation (RAG)  with local document embeddings, enabling long-term knowledge bases without leaving your machine. Key Features & Benefits MarvinOS Local AI Stack offers a wide range of features that make it an ideal choice for those who value autonomy and control over their AI experiments: Fully local LLM inference : No cloud dependency means you're in complete control. RAG with Qdrant vector database : Create local knowle...

I Built a Docker Expert Because I Was Tired of Searching Docs

  I Built a Docker Expert Because I Was Tired of Searching Docs I didn’t set out to build a “Docker expert.” I set out to stop breaking flow. If you’ve worked with Docker long enough, you know the feeling: you know the answer is in the docs, but you don’t know where . The information is correct, but fragmented. CLI flags in one place. Concepts in another. Edge cases buried three clicks deep. By the time you find what you need, the mental context is gone. So instead of reading Docker documentation, I asked a different question: What if I could  talk  to the Docker docs?  Not a chatbot that “knows Docker” in a vague, internet-trained way; but something grounded strictly in Docker’s own words; current, precise, and boringly correct. That’s what I built. The Idea: Treat Documentation as a Dataset Docker’s documentation is excellent. It’s also public, structured, and version-controlled on GitHub. That’s the key insight. Instead of scraping random websites or relying on a...

How I Built an AI App to Help People Pass the USCIS 2025 Civics Test — and Why Personalized Learning Matters

  How I Built an AI App to Help People Pass the USCIS 2025 Civics Test — and Why Personalized Learning Matters Preparing for the USCIS Civics Test is one of the most important steps on the path to U.S. citizenship. It’s not just a test of memorization — it’s about understanding American history, government, and civic values. For many applicants, studying can be intimidating. The material may be unfamiliar, English may not be a first language, and traditional study tools often assume everyone learns the same way. That’s why I built a Dify-powered AI app designed specifically to help people prepare for the USCIS 2025 Civics Test — with a focus on clarity, personalization, and confidence. 👉 Try the app here: https://marvinos.online:8093/chat/eaJZnnTyehL6eaqC The Challenge with Traditional Civics Test Prep Most civics prep resources rely on: Static question lists Memorization-heavy flashcards One-size-fits-all explanations But USCIS applicants come from different backgrounds, culture...