Close Menu

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Middle East conflict casts shadow of global ad outlook

    Customer reviews become a key battleground as AI revolutionizes product discovery

    In graphic detail: Middle-tier creators are fueling the next phase of the creator economy

    Facebook X (Twitter) Instagram
    • Artificial Intelligence
    • Business Technology
    • Cryptocurrency
    • Gadgets
    • Gaming
    • Health
    • Software and Apps
    • Technology
    Facebook X (Twitter) Instagram Pinterest Vimeo
    Tech AI Verse
    • Home
    • Artificial Intelligence

      What the polls say about how Americans are using AI

      February 27, 2026

      Tensions between the Pentagon and AI giant Anthropic reach a boiling point

      February 21, 2026

      Read the extended transcript: President Donald Trump interviewed by ‘NBC Nightly News’ anchor Tom Llamas

      February 6, 2026

      Stocks and bitcoin sink as investors dump software company shares

      February 4, 2026

      AI, crypto and Trump super PACs stash millions to spend on the midterms

      February 2, 2026
    • Business

      The team behind continuous batching says your idle GPUs should be running inference, not sitting dark

      March 13, 2026

      Met Office ‘supercomputing as a service’ one year old

      March 12, 2026

      Tech hiring evolves as candidates ask for AI compute alongside pay and perks

      March 11, 2026

      Oracle is spending billions on AI data centers as cash flow turns negative

      March 11, 2026

      Google: Cloud attacks exploit flaws more than weak credentials

      March 10, 2026
    • Crypto

      Banks Respond to Kraken’s Federal Reserve Access as Trump Sides with Crypto

      March 4, 2026

      Hyperliquid and DEXs Break the Top 10 — Is the CEX Era Ending?

      March 4, 2026

      Consensus Hong Kong 2026: The Institutional Turn 

      March 4, 2026

      New Crypto Mutuum Finance (MUTM) Reports V1 Protocol Progress as Roadmap Enters Phase 3

      March 4, 2026

      Bitcoin Short Sellers Caught Off Guard in New White House Move

      March 4, 2026
    • Technology

      Middle East conflict casts shadow of global ad outlook

      March 13, 2026

      Customer reviews become a key battleground as AI revolutionizes product discovery

      March 13, 2026

      In graphic detail: Middle-tier creators are fueling the next phase of the creator economy

      March 13, 2026

      The Future of Marketing Briefing: a war, an oil spike and an ad market that can’t see what comes next

      March 13, 2026

      As AI creative moves upstream, one production firm is pitching brands a model built on that trend

      March 13, 2026
    • Others
      • Gadgets
      • Gaming
      • Health
      • Software and Apps
    Check BMI
    Tech AI Verse
    You are at:Home»Technology»Building SQLite with a small swarm
    Technology

    Building SQLite with a small swarm

    TechAiVerseBy TechAiVerseFebruary 16, 2026No Comments4 Mins Read3 Views
    Facebook Twitter Pinterest Telegram LinkedIn Tumblr Email Reddit
    Building SQLite with a small swarm
    Share
    Facebook Twitter LinkedIn Pinterest WhatsApp Email

    Building SQLite with a small swarm

    February 12, 2026

    tl;dr

    I tasked Claude, Codex, and Gemini to build a SQLite-like engine in Rust.

    • ~19k~ lines of code.
    • Parser, planner, volcano executor, pager, b+trees, wal, recovery, joins, aggregates, indexing, transaction semantics, grouped aggregates, and stats-aware planning all implemented.
    • 282 unit tests, all passing.

    background

    Treat software engineering like distributed systems, and force coordination with: git, lock files, tests, and merge discipline.


    harness

    ├── AGENT_PROMPT.md       // main agent task prompt
    ├── BOOTSTRAP_PROMPT.md   // bootstrap (initialization) prompt
    ├── COALESCE_PROMPT.md    // deduplication prompt for coalescer agent
    ├── launch_agents.sh      // launches all agents and sets up isolated workspaces
    ├── agent_loop.sh         // per-agent loop/worker script
    ├── restart_agents.sh     // restarts agents
    └── coalesce.sh           // invokes the coalescing script
    

    workflow

    1. bootstrap phase: one Claude run generates baseline docs, crate skeleton, and test harness.
       ├── Cargo.toml         // crate manifest
       ├── DESIGN.md          // architecture design notes
       ├── PROGRESS.md        // test & build progress
       ├── README.md          // project overview
       ├── agent_logs         // per-agent log files
       ├── crates             // workspace subcrates
       ├── current_tasks      // lock files
       ├── notes              // inter-agent notes
       ├── target             // build artifacts
       └── test.sh            // test harness script
      
    2. worker phase: six workers loop forever (2x Claude, 2x Codex, 2x Gemini).

    loop

    1. Each agent pulls latest main.
    2. Claims one scoped task.
    3. Implements + tests against sqlite3 as oracle.
    4. Updates shared progress/notes.
    5. Push.

    analysis

    coordination tax

    • 84 / 154 commits (54.5%) were lock/claim/stale-lock/release coordination.
    • Demonstrates parallel-agent throughput depends heavily on lock hygiene and stale-lock cleanup discipline.

    what helped most

    Two things looked decisive:

    • oracle-style validation + high test cadence (cargo test ... and ./test.sh --fast/full runs captured in PROGRESS.md).
    • strong module boundaries (parser -> planner -> executor <-> storage) so agents could work on orthogonal slices with fewer merge collisions.

    redundancy

    I implemented a coalescer with gemini to clean duplication/drift, since that is the largest problem with parallel agents. However, it only ran once at the end of the project, so it was never actually used during the run itself. I have a cron job which runs it daily, but gemini couldn’t complete the entire de-deuplication when I ran it during the expirement itself, which is to say it stopped mid-way through.

    takeaways

    • Parallelism is great, but only with strict task boundaries.
    • Shared state docs (PROGRESS.md, design notes) are part of the runtime, not “documentation.”
    • Tests are the anti-entropy force.
    • Give agents a narrow interface, a common truth source, and fast feedback, and you get compounding throughput on real systems code.

    replication

    To replicate this setup:

    git clone git@github.com:kiankyars/parallel-ralph.git
    mv parallel-ralph/sqlite .
    chmod 700 sqlite/*.sh
    ./sqlite/launch_agents.sh
    

    restart agents:

    ./sqlite/restart_agents.sh claude/codex/gemini
    

    coalesce agent:

    Assumes you have the relevant CLIs installed (claude, codex, gemini), plus screen, git, Rust toolchain, and sqlite3.


    limitations

    • The documentation in the repo became enormous, PROGRESS.md became 490 lines and look at the sheer amount of notes; all this to say that the coalesce agent must be run as often as the other agents.
    • There isn’t a great way to record token usage since each platform uses a different format, so I don’t have a grasp on which agent pulled the most weight.

    future work

    • Track “substantive run rate”, since many are rate-limited/nothing happened.
    • Only Claude adds itself as a co-author to each commit and I did not do that for Codex and Gemini, so I need to add a commit message for Gemini and Codex.
    • Adding more strict observability because probably a lot of errors were due to the rate limit being hit mid work and then just not being able to like put then essentially at that point there was like only half finished work pushed.

    inspiration

    • https://cursor.com/blog/scaling-agents
    • https://www.anthropic.com/engineering/building-c-compiler

    appendix

    code size snapshot

    Language Files Lines Non-blank/Non-comment
    Rust 14 18,650 ~16,155
    Shell 1 199 ~139
    Total 15 18,849 ~16,294

    154 commits between 2026-02-10 and 2026-02-12.

    usage

    Gemini does not offer a way to monitor usage with their CLI. It’s also not on a weekly usage basis, but rather a 24-hour usage basis. For codex, I used 100% of the Pro Plan weekly usage, which is currently on a 2x promotion. I used 70% of the Claude Pro weekly usage.

    • codex
    • claude

    disclaimer

    • codex wrote the first draft for this post.

    citation

    @misc{kyars2026sqlite,
      author = {Kian Kyars},
      title = {Building SQLite With a Small Swarm},
      year = {2026},
      month = feb,
      day = {12},
      howpublished = {url{https://kiankyars.github.io/machine_learning/2026/02/16/sqlite.html}},
      note = {Blog post}
    }
    
    Share. Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Telegram Email
    Previous ArticleArm wants a bigger slice of the chip business
    Next Article I want to wash my car. The car wash is 50 meters away. Should I walk or drive?
    TechAiVerse
    • Website

    Jonathan is a tech enthusiast and the mind behind Tech AI Verse. With a passion for artificial intelligence, consumer tech, and emerging innovations, he deliver clear, insightful content to keep readers informed. From cutting-edge gadgets to AI advancements and cryptocurrency trends, Jonathan breaks down complex topics to make technology accessible to all.

    Related Posts

    Middle East conflict casts shadow of global ad outlook

    March 13, 2026

    Customer reviews become a key battleground as AI revolutionizes product discovery

    March 13, 2026

    In graphic detail: Middle-tier creators are fueling the next phase of the creator economy

    March 13, 2026
    Leave A Reply Cancel Reply

    Top Posts

    Ping, You’ve Got Whale: AI detection system alerts ships of whales in their path

    April 22, 2025716 Views

    Lumo vs. Duck AI: Which AI is Better for Your Privacy?

    July 31, 2025302 Views

    Wired Headphones Are Making A Comeback, And We Have Gen Z To Thank

    July 22, 2025210 Views

    6.7 Cummins Lifter Failure: What Years Are Affected (And Possible Fixes)

    April 14, 2025172 Views
    Don't Miss
    Technology March 13, 2026

    Middle East conflict casts shadow of global ad outlook

    Middle East conflict casts shadow of global ad outlook By Seb Joseph  •  March 13,…

    Customer reviews become a key battleground as AI revolutionizes product discovery

    In graphic detail: Middle-tier creators are fueling the next phase of the creator economy

    The Future of Marketing Briefing: a war, an oil spike and an ad market that can’t see what comes next

    Stay In Touch
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo

    Subscribe to Updates

    Get the latest creative news from SmartMag about art & design.

    About Us
    About Us

    Welcome to Tech AI Verse, your go-to destination for everything technology! We bring you the latest news, trends, and insights from the ever-evolving world of tech. Our coverage spans across global technology industry updates, artificial intelligence advancements, machine learning ethics, and automation innovations. Stay connected with us as we explore the limitless possibilities of technology!

    Facebook X (Twitter) Pinterest YouTube WhatsApp
    Our Picks

    Middle East conflict casts shadow of global ad outlook

    March 13, 20263 Views

    Customer reviews become a key battleground as AI revolutionizes product discovery

    March 13, 20263 Views

    In graphic detail: Middle-tier creators are fueling the next phase of the creator economy

    March 13, 20262 Views
    Most Popular

    Outbreak turns 30

    March 14, 20250 Views

    New SuperBlack ransomware exploits Fortinet auth bypass flaws

    March 14, 20250 Views

    CDs Offer Guaranteed Returns in an Uncertain Market. Today’s CD Rates, March 14, 2025

    March 14, 20250 Views
    © 2026 TechAiVerse. Designed by Divya Tech.
    • Home
    • About Us
    • Contact Us
    • Privacy Policy
    • Terms & Conditions

    Type above and press Enter to search. Press Esc to cancel.