curo/kite - kite - Gitea: Git with a cup of tea

curo/kite

Fork 0

Commit Graph

Author	SHA1	Message	Date
curo1305	0d51d023ce	feat(03-02): implement presigned upload flow, quota enforcement, cleanup task - Replace POST /api/documents/upload with POST /api/documents/upload-url + /{id}/confirm - upload-url: create pending Document row with user_id=None (Wave 2), return presigned PUT URL - confirm: stat MinIO for authoritative size (T-03-05), atomic quota UPDATE (T-03-06, STORE-03) - Confirm returns 413 with {used_bytes, limit_bytes, rejected_bytes} on quota exceeded (STORE-05) - Wave 2 guard: skip quota UPDATE when doc.user_id is None (Plan 03-03 removes this) - Add GET /api/auth/me/quota to api/auth.py (STORE-04) - services/storage.py: remove save_upload (D-04); add GREATEST(0, used_bytes-delta) quota decrement to delete_document (STORE-06) - tasks/document_tasks.py: add cleanup_abandoned_uploads Celery beat task (D-06) - celery_app.py: add beat_schedule for cleanup-abandoned-uploads every 30 minutes - tests/test_documents.py: replace legacy /upload tests with xfail; add real test logic for upload-url/confirm/get-quota - tests/test_quota.py: implement real test logic with xfail for PostgreSQL-specific SQL	2026-05-23 14:32:12 +02:00
curo1305	32d67de1ca	feat(01-05): introduce celery_app + tasks/document_tasks + session-aware classifier - Add backend/celery_app.py: Celery("docuvault") with Redis broker, JSON serialization, and tasks.document_tasks.* routed to documents queue; reads REDIS_URL directly from os.environ (no config import — Pitfall 7) - Add backend/tasks/__init__.py: empty package marker - Add backend/tasks/document_tasks.py: sync extract_and_classify Celery task that calls asyncio.run(_run()) to retrieve bytes from MinIO, extract text via extractor, and classify via classifier; classification failure is non-fatal - Update backend/services/classifier.py: classify_document and suggest_topics_for_document now accept session: AsyncSession as first arg; all storage.* calls updated to async session-injection pattern - Add extract_text_from_bytes helper to services/extractor.py for bytes-based extraction (used by Celery worker, which retrieves bytes from MinIO)	2026-05-22 09:45:33 +02:00

Author

SHA1

Message

Date

curo1305

0d51d023ce

feat(03-02): implement presigned upload flow, quota enforcement, cleanup task

- Replace POST /api/documents/upload with POST /api/documents/upload-url + /{id}/confirm
- upload-url: create pending Document row with user_id=None (Wave 2), return presigned PUT URL
- confirm: stat MinIO for authoritative size (T-03-05), atomic quota UPDATE (T-03-06, STORE-03)
- Confirm returns 413 with {used_bytes, limit_bytes, rejected_bytes} on quota exceeded (STORE-05)
- Wave 2 guard: skip quota UPDATE when doc.user_id is None (Plan 03-03 removes this)
- Add GET /api/auth/me/quota to api/auth.py (STORE-04)
- services/storage.py: remove save_upload (D-04); add GREATEST(0, used_bytes-delta) quota decrement to delete_document (STORE-06)
- tasks/document_tasks.py: add cleanup_abandoned_uploads Celery beat task (D-06)
- celery_app.py: add beat_schedule for cleanup-abandoned-uploads every 30 minutes
- tests/test_documents.py: replace legacy /upload tests with xfail; add real test logic for upload-url/confirm/get-quota
- tests/test_quota.py: implement real test logic with xfail for PostgreSQL-specific SQL

2026-05-23 14:32:12 +02:00

curo1305

32d67de1ca

feat(01-05): introduce celery_app + tasks/document_tasks + session-aware classifier

- Add backend/celery_app.py: Celery("docuvault") with Redis broker, JSON
  serialization, and tasks.document_tasks.* routed to documents queue;
  reads REDIS_URL directly from os.environ (no config import — Pitfall 7)
- Add backend/tasks/__init__.py: empty package marker
- Add backend/tasks/document_tasks.py: sync extract_and_classify Celery task
  that calls asyncio.run(_run()) to retrieve bytes from MinIO, extract text
  via extractor, and classify via classifier; classification failure is non-fatal
- Update backend/services/classifier.py: classify_document and
  suggest_topics_for_document now accept session: AsyncSession as first arg;
  all storage.* calls updated to async session-injection pattern
- Add extract_text_from_bytes helper to services/extractor.py for bytes-based
  extraction (used by Celery worker, which retrieves bytes from MinIO)

2026-05-22 09:45:33 +02:00

2 Commits