πŸ“Š Statisticians Workbench – Complete Development Roadmap

Version 3.0.1 • 2026-07-07 • Living Document – Subject to refinement

Current Version: 0.0.11rc2 (Released) Next Version: 0.0.12 (Planned) 0.0.11 Progress: 100% Complete Status: βœ… Released

Version Status Overview

VersionStatusNotes
0.0.9ReleasedDataset management, password policy, admin features
0.0.10ReleasedStatistical Foundation (0.0.2) – Complete
0.0.11ReleasedAI Agents & Collaboration + Notebook Import + Mobile Support (0.0.3) – 100% Complete
0.0.12PlannedAdvanced Analysis, Agent Expansion + Audio I/O (0.0.4)
0.0.13PlannedIntegration & Extensibility (0.0.5)
0.0.14PlannedProduction Readiness (0.0.6)
0.0.15PlannedAdvanced Agent Capabilities (0.0.7)
0.0.16PlannedEcosystem & Marketplace (0.0.8)

Milestone 0.0.2 – "Statistical Foundation"

βœ… COMPLETE

Theme: Core statistical capabilities with a maintainable codebase and foundation for AI Agents.

Delivered in: Version 0.0.10

FeatureSourceStatus
DuckDB Storage Engine (Quack protocol)0.0.2Complete
Dataset Management (Upload + Define)0.0.2Complete
Recipe Framework (CRUD, execution pipeline)0.0.2Complete
Recipe UI (List, wizard, detail, execution results)0.0.2Complete
Statistics Router (Descriptive statistics with caching)0.0.2Complete
Visualisation Stage (Bar, pie, line, scatter charts)0.0.2Complete
Column Schema Fetch (Type badges, statistics)0.0.2Complete
User Groups (100 groups, sharing, admin management)0.0.3Complete
Resource Sharing (AI, DB, Datasets, Recipes)0.0.3Complete
Shared Connections (* prefix, badges, view-only)0.0.3Complete
Group Descriptions (Admin UI)0.0.3Complete
Shared Memory (Caching with TTL)0.0.2Complete
Multilingual Support (Backend + Frontend)0.0.2Complete
Define Dataset (Tables and views from DB connections)0.0.2Complete
General Chat Agent0.0.3Complete
Database Connections (PostgreSQL)0.0.5Complete
Schema Simplification (Foreign keys, indexes, storageType)0.0.10Complete
Multiple Preparation Rules per Recipe0.0.10Complete
Admin Groups Page Fix0.0.10Complete
Admin User Details Page Fix0.0.10Complete
Datasets Upload History Filter0.0.10Complete
PostgreSQL/MySQL Test Connection Error Cleanup0.0.10Complete
quack-proxy Systemd Service0.0.10Complete

Milestone 0.0.3 – "AI Agents, Collaboration & Notebook Import"

βœ… Complete 100% Complete (87/87)

Theme: AI Agents, collaboration, sharing, user roles, and mobile screen size support.

Delivered in: Version 0.0.11 (rc1 + rc2)

76 Complete
1 Partial
10 Pending
87 Total Features

Group Administrator Role 12/12 Complete

FeatureStatusEvidence
Database schema (isGroupAdmin field)CompleteUser model in schema.prisma
Seed data with Group Admin supportCompleteprisma/seed.ts
Permission functions in lib/admin.tsCompleteisGroupAdmin, canManageGroupUsers, canManageUser, canPromoteGroupAdmin, getVisibleUsers, getUserGroup
Middleware protection (proxy.ts)CompleteRoute protection for all admin paths
Admin endpoints with permission checksCompleteAll admin routes block non-admins
Group management endpointsComplete/api/admin/groups/users, /api/admin/groups/promote
Admin groups pageCompleteFull management UI
Admin user details pageCompleteUser management within group
Conditional sidebar renderingCompleteAdmin section visible to Group Admins
Self-modification preventionCompleteCannot modify own account
Dropdown display fixesCompleteProper names in closed state
GroupAdminBadge componentCompleteShows "Group Admin" badge in UI

Example User (Demo Account) 14/14 Complete

FeatureStatusEvidence
Database schema (isExampleUser field)CompleteUser model in schema.prisma
Seed data (exampleuser@example.com / User1234#)Completeprisma/seed.ts
Permission functions in lib/admin.tsCompleteisExampleUser, canChangePassword, canPerformAdminAction, canModifyAdminResources, canViewAdminPages
Middleware protection (proxy.ts)CompleteRoute protection for all protected paths
Auth endpoints blockingComplete/api/auth/change-password, /api/auth/reset-password, /api/auth/forgot-password
Admin endpoints permission checksCompleteAll admin routes block Example Users
User resource endpoints blockingCompleteAI connections, database connections, datasets, recipes
/api/user/role endpointCompleteRole detection for frontend
ExampleUserBadge componentCompleteShows "Example User" badge in UI
ExampleUserBanner componentCompleteRead-only banner with register button
ExampleUserReadonlyWrapper componentCompleteWraps content with read-only overlay
Password visibility restrictionCompleteEye icon disabled for Example Users
Language override for Example UsersCompleteSession language from login overrides profile
Read-only views for all pagesCompleteAll pages show lock banner for Example Users

Agent Session Management 5/5 Complete

FeatureStatusEvidence
Chat model (id, userId, title, createdAt, updatedAt)Completeprisma/schema.prisma
Message model (id, chatId, role, content, createdAt)Completeprisma/schema.prisma
ChatManager orchestratorCompletebackend/src/chat/manager.py
CRUD operationsCompletebackend/src/chat/crud.py
Message managementCompletebackend/src/chat/messages.py

General Chat Agent 8/8 Complete

FeatureStatusEvidence
Chat router endpointsCompletebackend/src/chat_router.py
Anthropic providerCompletebackend/src/chat/providers/anthropic.py
Ollama providerCompletebackend/src/chat/providers/ollama.py
OpenAI-compatible providerCompletebackend/src/chat/providers/openai.py
Shared connection supportCompletebackend/src/chat/connection.py
Full chat UICompletefrontend/app/chat/page.tsx
Language context system messageCompletebackend/src/chat/language.py
Error message translationCompletebackend/src/chat_router.py

Data Preparation Stage Infrastructure 13/13 Complete

FeatureStatusEvidence
Design documentCompleteworkbench-data-preparation.md
Database schema (DataPreparationRule model)Completeprisma/schema.prisma
Backend CRUD endpointsCompletebackend/src/routers/datasets/preparation.py
Backend IntegrationCompleteApplied in recipe execution
Preview endpointComplete/api/datasets/{id}/preparation/preview
Frontend UI – Dataset pageCompletefrontend/app/datasets/[id]/page.tsx
Frontend UI – Recipe creationCompletefrontend/app/recipes/new/page.tsx
Frontend UI – Recipe editCompletefrontend/app/recipes/[id]/page.tsx
Frontend UI – Execution resultsCompletefrontend/app/recipes/executions/[id]/page.tsx
Multiple rules per recipeCompleteRecipePreparationRule junction table
Dynamic filter operatorsCompleteBased on column type
data_preparation stage executorCompleteDataPreparationExecutor applies rules in order with before/after metadata
Integration with recipe execution as a stageCompletePreparation runs as first-class stage in recipe pipeline

Jupyter Notebook Import 14/14 Complete

FeatureStatusEvidence
Notebook parser + sanitisationCompletebackend/src/routers/notebooks/parser.py
Data extraction from outputsCompleteDataFrame parsing from text/plain + text/html
DuckDB storage (schema-per-import)Completebackend/src/routers/notebooks/storage.py
NotebookImport tracking tableCompletePrisma schema + PG record
Import page (file picker, preview, results)Completefrontend/app/notebooks/import/page.tsx
List page (past imports, delete)Completefrontend/app/notebooks/page.tsx
Validation UX (buttons always enabled, red error banners)CompleteClient-side validation in handleImport/handlePreview
PostgreSQL storage (append + create database)Completestorage.py β€” asyncpg, atomic rollback
MySQL storage (append + create database)Completestorage.py β€” aiomysql, table prefix strategy
Remote delete (PG/MySQL cleanup)CompleteSchema CASCADE (PG), table prefix DROP (MySQL), full DB DROP (create mode)
canCreateTables detection + badgeCompletetest-postgres/route.ts, test-mysql/route.ts, purple Tables badge
System database guardsCompleteBlocks imports into postgres/template0/template1/mysql/sys
Group sharing + Example user guardsCompletenotebookGroup field, share toggle, example user 403 + banner
Auto-create dataset + success redirectCompleteSingle-table checkboxes, redirect to /notebooks after import

AI Agent Framework Foundation 5/5 Complete

FeatureStatusEvidence
Chat module refactoredCompletebackend/src/chat/ (connection.py, crud.py, messages.py, title.py, language.py, manager.py, providers/)
Recipes module refactoredCompletebackend/src/routers/recipes/ (crud.py, execute.py, helpers.py, history.py, models.py, stages/)
Datasets router splitCompletebackend/src/routers/datasets/ (crud.py, upload.py, define.py, schema.py, describe.py, preparation.py)
Base agent classCompleteAIAgent ABC with ask(), ask_structured(), AgentFactory registry
Agent-specific agent logicCompleteDatasetCleanerAgent, DatabaseDesignerAgent, RecipeAssistantAgent
Copy-to-clipboard on all chatsCompleteCopyButton component with clipboard API β€” all 4 AI chat pages

Activity Logs & Audit 0/2 β€” Moved to 0.0.6

FeatureStatusNotes
Activity LogsPendingUser activity tracking
Audit TrailPendingSystem-wide audit logging

More Statistical Techniques 8/8 Complete

TechniqueStatusNotes
Descriptive statisticsCompleteMean, median, mode, variance, std_dev, skewness, kurtosis, min, max, range, quartiles
Correlation matrixCompletePearson, Spearman, Kendall
t-test (independent and paired)Completescipy ttest_ind/ttest_rel + Cohen's d
ANOVA (one-way and two-way)Completescipy f_oneway + statsmodels OLS/anova_lm Type II
Linear regressionCompletescipy linregress (simple) + statsmodels OLS (multiple)
Chi-square testCompletescipy chi2_contingency + CramΓ©r's V
More advanced statistical methodsPlannedFuture expansion

πŸ“± Mobile Screen Size Support 7/7 Complete

FeatureStatusEvidence
useMobile hook (768px breakpoint)Completefrontend/hooks/useMobile.ts
Hamburger drawer overlay navigationCompletefrontend/components/layout.tsx β€” Mobile header + slide-in drawer + backdrop
Responsive sidebars (datasets, chat, upload)Complete5 files: w-64 β†’ w-full md:w-64, flex β†’ flex-col md:flex-row
Fixed-width select containers β†’ responsiveComplete12 Select containers across admin/models, admin/groups, datasets, chat pages
Global touch target minimums (44px)Completefrontend/app/globals.css β€” buttons, links, selects, checkboxes, radios
Mobile keyboard clearance paddingCompletelayout.tsx β€” pb-24 on mobile main content area
Desktop layout preservedCompleteZero visual change at β‰₯768px; all md: breakpoints are additive

πŸŽ‰ Milestone 0.0.3 β€” All Items Complete

100% Complete

Activity Logs and Audit Trail moved to milestone 0.0.6 (Production Readiness). Mobile screen size support added (2026-07-07): hamburger drawer, responsive sidebars, touch targets, keyboard padding β€” 7 features across 9 files.

Milestone 0.0.4 – "Advanced Analysis & Agent Expansion"

πŸ“‹ Planned

Theme: Advanced statistical techniques, expanding the AI Agent ecosystem, and recipe export/import.

FeatureStatusNotes
More Chart TypesPlannedHistogram, boxplot, heatmap, 3D plots
Interactive VisualisationsPlannedUser interaction with charts
Export VisualisationsPlannedPNG, SVG, PDF exports
Advanced Statistical TechniquesPlannedBayesian methods, time series, clustering
Data Preparation AgentPlannedCleaning, transformation, feature engineering guidance
Statistical Analysis AgentPlannedAdvanced statistics, hypothesis testing, model recommendations
Visualisation AgentPlannedChart and dashboard recommendations
Export/Import RecipesPlannedJSON/YAML export and import
Recipe TemplatesPlannedPre-built recipe templates
Audio Input/OutputCompleteSpeech-to-text (mic capture via Web Speech API) + text-to-speech (AI response via SpeechSynthesis). Browser support detection with error messages. Per-user audio settings panel (voice, speed/pitch, reset). Mic, speaker, and settings gear icons on all 4 AI chat pages.

Milestone 0.0.5 – "Integration & Extensibility"

πŸ“‹ Planned

Theme: Connecting to more data sources and extending the platform.

FeatureStatusNotes
More Database TypesPlannedMySQL, SQLite, Snowflake, BigQuery
API Token AuthenticationPlannedFor programmatic access
WebhooksPlannedEvent-driven integration
Agent Tool ExpansionPlannedSQL execution, schema inspection, dataset analysis, recipe creation, dataset creation
Custom Agent Development KitPlannedFor building custom agents
Plugin ArchitecturePlannedExtensible plugin system

Milestone 0.0.6 – "Production Readiness"

πŸ“‹ Planned

Theme: Making the Workbench enterprise-ready.

FeatureStatusNotes
Performance OptimisationPlannedQuery optimisation, caching strategies
Monitoring & AlertingPlannedMetrics, dashboards, alerts
Backup & RecoveryPlannedAutomated backups, restore procedures
User DocumentationPlannedComprehensive user guides
Developer DocumentationPlannedAPI docs, architecture guides
User Role DocumentationPlannedComplete role-based access control documentation
Demo Mode EnhancementsPlannedImproved demo experience
Agent Security ReviewPlannedSecurity audit of agent system
Activity Logs & Audit TrailPlannedUser activity tracking + system-wide audit logging (moved from 0.0.3)
Comprehensive TestingPlannedUnit tests, integration tests, E2E tests

Milestone 0.0.7 – "Advanced Agent Capabilities"

πŸ“‹ Planned

Theme: Making agents more powerful and autonomous.

FeatureStatusNotes
Multi-step Agent WorkflowsPlannedDSPy Programs, sequential operations
Agent CollaborationPlannedMultiple agents working together
Agent Tool SecurityPlannedPermission-based tool access
Agent Configuration UIPlannedUser-configurable agent settings
Agent Performance MonitoringPlannedAgent execution metrics
Custom Agent CreationPlannedUser-defined agents

Milestone 0.0.8 – "Ecosystem & Marketplace"

πŸ“‹ Planned

Theme: Building an ecosystem around the Workbench.

FeatureStatusNotes
Recipe Sharing (Public/Private)PlannedShare recipes with the community
Agent SharingPlannedShare custom agents
Community TemplatesPlannedPre-built templates for common tasks
External Integration SDKPlannedSDK for building integrations
Plugin Architecture (Phase 2)PlannedEnhanced plugin system
Agent MarketplacePlannedCommunity-contributed agents

Summary of Milestones

MilestoneThemeKey DeliverablesTarget
0.0.2Statistical FoundationCore stats, code restructure, sharing features, schema simplificationβœ… Complete
0.0.3AI Agents & CollaborationDataset Agent, DB Designer Agent, Recipe Assistant, Group Admin, Example User, Data Preparation, 8 Stats Techniques, Agent Framework, Copy-to-Clipboard, Audio I/O (mic, speaker, settings), MS SQL Server, Mobile Screen Size Support (hamburger drawer, responsive sidebars, touch targets, keyboard padding)βœ… 100% Complete
0.0.4Advanced Analysis, Agent Expansion & AudioAudio I/O, advanced stats, new agents, visualisations, export/importπŸ“‹ Future
0.0.5Integration & ExtensibilityMore DB types, API, tool expansionπŸ“‹ Future
0.0.6Production ReadinessActivity Logs, Audit Trail, performance, monitoring, docs, role documentationπŸ“‹ Future
0.0.7Advanced Agent CapabilitiesMulti-step workflows, securityπŸ“‹ Future
0.0.8Ecosystem & MarketplaceSharing, community, pluginsπŸ“‹ Future

Key Themes Across Milestones

Theme0.0.20.0.30.0.40.0.50.0.60.0.70.0.8
Statistical AnalysisπŸ”΄πŸŸ’πŸŸ’
Dataset ManagementπŸ”΄πŸŸ‘πŸŸ‘πŸŸ’
Visualisation🟑🟒
User CollaborationπŸŸ’πŸ”΄
User Roles & PermissionsπŸŸ‘πŸ”΄πŸŸ’
AI AgentsπŸŸ‘πŸ”΄πŸ”΄πŸŸ‘πŸŸ’πŸŸ’
IntegrationπŸ”΄
Production ReadinessπŸ”΄
EcosystemπŸ”΄
Recipe Portability🟒
πŸ”΄ Primary Focus 🟑 Supporting Feature 🟒 Enhancement

πŸ“ Summary of Changes (Version 3.0.1)