Business-Management/changelog/2026-04-14_doc-service.md

2026-04-14 — PDF Document Service

Timestamp: 2026-04-14T00:00:00+00:00

Summary

Added features/doc-service — a FastAPI microservice that accepts PDF uploads, extracts text with pdfplumber, and uses a pluggable AI provider (Anthropic, Ollama, or LM Studio) to classify and extract structured data. Integrated it into the main backend via httpx proxy routers. Added an admin settings UI at /apps/documents/settings/admin. Updated the frontend route tree, Nav, and AppsPage.

Files Added

• features/doc-service/Dockerfile — UID 1001, pre-creates /data/documents and /config
• features/doc-service/pyproject.toml — service dependencies
• features/doc-service/alembic.ini — separate alembic_version_doc_service table
• features/doc-service/.env.example
• features/doc-service/scripts/start.sh — migrations + uvicorn
• features/doc-service/scripts/start_dev.sh — migrations + uvicorn --reload
• features/doc-service/alembic/env.py — async migrations, VERSION_TABLE isolation
• features/doc-service/alembic/versions/0001_create_doc_tables.py — documents, document_categories, document_category_assignments
• features/doc-service/app/main.py — no CORS (internal service)
• features/doc-service/app/core/config.py — DATABASE_URL, DATA_DIR, CONFIG_PATH settings
• features/doc-service/app/database.py — async engine, AsyncSessionLocal, Base
• features/doc-service/app/deps.py — get_user_id from X-User-Id header
• features/doc-service/app/models/document.py — Document ORM model
• features/doc-service/app/models/category.py — DocumentCategory ORM model
• features/doc-service/app/models/category_assignment.py — CategoryAssignment composite PK
• features/doc-service/app/models/__init__.py
• features/doc-service/app/schemas/document.py — DocumentOut, DocumentStatusOut, DocumentTypeUpdate, CategoryOut
• features/doc-service/app/schemas/category.py — CategoryCreate, CategoryOut, CategoryUpdate
• features/doc-service/app/routers/documents.py — upload, list, get, status, patch type, delete, file download, category assignment
• features/doc-service/app/routers/categories.py — CRUD for DocumentCategory
• features/doc-service/app/services/storage.py — aiofiles write, path helpers, delete
• features/doc-service/app/services/config_reader.py — load_doc_config() with 30s TTL cache
• features/doc-service/app/services/ai/__init__.py — get_provider() factory
• features/doc-service/app/services/ai/base.py — AIProvider ABC, shared prompts
• features/doc-service/app/services/ai/anthropic_provider.py — AnthropicProvider
• features/doc-service/app/services/ai/openai_compat.py — OpenAICompatProvider (Ollama + LM Studio)
• backend/app/core/app_config.py — DocServiceConfig Pydantic model, load/save with atomic write, api_key masking
• backend/app/routers/settings.py — GET/PATCH /api/settings/documents/*, admin only
• backend/app/routers/documents_proxy.py — httpx proxy to doc-service /documents/*
• backend/app/routers/categories_proxy.py — httpx proxy to doc-service /categories/*
• frontend/src/pages/DocumentsPage.tsx — upload, list, status polling, categories, file download
• frontend/src/pages/DocumentAdminSettingsPage.tsx — AI provider config, connection test, upload limits

Files Modified

• backend/app/main.py — registered settings_router, categories_proxy (before!), documents_proxy
• backend/pyproject.toml — moved httpx to main deps, added anthropic>=0.28, openai>=1.0
• frontend/src/App.tsx — added /apps/documents and /apps/documents/settings/admin routes, removed /settings
• frontend/src/components/Nav.tsx — removed Settings link, added Profile link, logo links to /
• frontend/src/pages/AppsPage.tsx — replaced stub with app launcher card grid
• frontend/src/api/client.ts — added documents, categories, and settings API functions
• docker-compose.yml — added doc-service service, doc_data + app_config volumes, removed internal:true from backend-net, added app_config volume to backend
• docker-compose.dev.yml — added doc-service dev override with --reload
• TODO.md — added PDF Documents app section

Files Deleted

• frontend/src/pages/SettingsPage.tsx — stub replaced by per-app settings pages

---

2026-04-14 — Server-side pagination and filter bar

Timestamp: 2026-04-14T12:00:00+00:00

Summary

Added server-side pagination and a filter bar to the Documents feature.

Files Added / Modified / Deleted

• Modified features/doc-service/app/schemas/document.py — Added DocumentPage schema (items, total, page, pages)
• Modified features/doc-service/app/routers/documents.py — GET /documents now accepts page, per_page, sort, order, status, document_type, search query params; returns DocumentPage
• Modified frontend/src/api/client.ts — listDocuments accepts DocumentListParams; added DocumentPage and DocumentListParams interfaces
• Modified frontend/src/pages/DocumentsPage.tsx — Added FilterBar (search, status, type, sort, order) and Pagination controls; query key includes params for cache isolation

---

2026-04-14 — AI Service priority queue + model config update

Timestamp: 2026-04-14T15:00:00+00:00

Summary

Added a priority queue system to ai-service with start/pause/resume/stop controls. Updated LM Studio model to gemma-4-e4b-it.

Files Added / Modified / Deleted

• Created features/ai-service/app/services/queue.py — in-memory asyncio.PriorityQueue with HIGH/NORMAL/LOW priorities, FIFO within same level, single async worker with pause/resume/stop
• Created features/ai-service/app/schemas/queue.py — QueueRequest, JobStatus, QueueStatus Pydantic models
• Created features/ai-service/app/routers/queue.py — POST /queue/jobs, GET /queue/jobs/{id}, DELETE /queue/jobs/{id}, GET /queue/status, POST /queue/pause|resume|start|stop
• Modified features/ai-service/app/routers/chat.py — extracted execute_chat() (called by queue worker); POST /chat now submits to queue at NORMAL priority and awaits result
• Modified features/ai-service/app/main.py — start/stop queue worker in lifespan; mount queue router
• Modified features/ai-service/app/services/config_reader.py — default model updated to gemma-4-e4b-it
• Modified features/ai-service/pyproject.toml — httpx moved to runtime deps
• Modified features/ai-service/.env — model updated to gemma-4-e4b-it