docs(13-09): complete move and delete mutation plan summary

This commit is contained in:
curo1305
2026-06-22 20:04:38 +02:00
parent 508d27643b
commit a77b7324aa
3 changed files with 201 additions and 7 deletions
+3 -3
View File
@@ -24,7 +24,7 @@ Before any phase is marked complete:
| Phase | Name | Goal | Requirements | | Phase | Name | Goal | Requirements |
|------:|------|------|--------------| |------:|------|------|--------------|
| 12 | 6/6 | Complete | 2026-06-21 | | 12 | 6/6 | Complete | 2026-06-21 |
| 13 | 8/11 | In Progress| | | 13 | 9/11 | In Progress| |
| 14 | Selective Analysis and Byte Cache | Analyze selected cloud scopes through cancellable jobs backed by bounded, private, on-demand byte caching | ANALYZE-01..07, CACHE-03..05 | | 14 | Selective Analysis and Byte Cache | Analyze selected cloud scopes through cancellable jobs backed by bounded, private, on-demand byte caching | ANALYZE-01..07, CACHE-03..05 |
| 15 | Unified Smart Search | Search local and analyzed cloud documents by exact text or semantic ideas without downloading files during queries | SEARCH-01..07 | | 15 | Unified Smart Search | Search local and analyzed cloud documents by exact text or semantic ideas without downloading files during queries | SEARCH-01..07 |
| 16 | Change Tracking and Reliability | Detect external provider changes, mark stale indexes, remove deleted items, and harden refresh behavior | SYNC-02..04 | | 16 | Change Tracking and Reliability | Detect external provider changes, mark stale indexes, remove deleted items, and harden refresh behavior | SYNC-02..04 |
@@ -80,7 +80,7 @@ Plans:
**Depends on:** Phase 12 **Depends on:** Phase 12
**Requirements:** CONN-01, CONN-02, CONN-03, CLOUD-02, CLOUD-03, CLOUD-04, CLOUD-05, CLOUD-06, CLOUD-07, CLOUD-09 **Requirements:** CONN-01, CONN-02, CONN-03, CLOUD-02, CLOUD-03, CLOUD-04, CLOUD-05, CLOUD-06, CLOUD-07, CLOUD-09
**Plans:** 8/11 plans executed **Plans:** 9/11 plans executed
**Execution waves:** Wave 0: 13-01 and 13-02 in parallel; Wave 1: 13-03 after 13-01; Wave 2: 13-04 after 13-01 and 13-03; Wave 3: 13-05 after 13-01, 13-03, and 13-04; Wave 4: 13-06 after 13-05; Wave 5: 13-07 and 13-08 in parallel (13-07 after 13-02, 13-04, and 13-06; 13-08 after 13-03, 13-04, and 13-06); Wave 6: 13-09 after 13-08; Wave 7: 13-10 after 13-02, 13-04, 13-07, and 13-09; Wave 8: 13-11 after 13-03 through 13-10. **Execution waves:** Wave 0: 13-01 and 13-02 in parallel; Wave 1: 13-03 after 13-01; Wave 2: 13-04 after 13-01 and 13-03; Wave 3: 13-05 after 13-01, 13-03, and 13-04; Wave 4: 13-06 after 13-05; Wave 5: 13-07 and 13-08 in parallel (13-07 after 13-02, 13-04, and 13-06; 13-08 after 13-03, 13-04, and 13-06); Wave 6: 13-09 after 13-08; Wave 7: 13-10 after 13-02, 13-04, 13-07, and 13-09; Wave 8: 13-11 after 13-03 through 13-10.
Plans: Plans:
@@ -93,7 +93,7 @@ Plans:
- [x] 13-06-PLAN.md — Complete upload reconcile, freshness, and metadata-only audit follow-through before frontend queue wiring. - [x] 13-06-PLAN.md — Complete upload reconcile, freshness, and metadata-only audit follow-through before frontend queue wiring.
- [x] 13-07-PLAN.md — Wire the shared browser queue and binary-only preview or download fallback through thin cloud view handlers. - [x] 13-07-PLAN.md — Wire the shared browser queue and binary-only preview or download fallback through thin cloud view handlers.
- [x] 13-08-PLAN.md — Implement backend create-folder and rename semantics with collision, stale, and stable-identity safeguards. - [x] 13-08-PLAN.md — Implement backend create-folder and rename semantics with collision, stale, and stable-identity safeguards.
- [ ] 13-09-PLAN.md — Implement backend move and delete semantics with same-connection, disclosure, security, and audit safeguards. - [x] 13-09-PLAN.md — Implement backend move and delete semantics with same-connection, disclosure, security, and audit safeguards.
- [ ] 13-10-PLAN.md — Finish shared-browser mutation UX, store-backed health behavior, reconnect copy, and the no-probe invariant. - [ ] 13-10-PLAN.md — Finish shared-browser mutation UX, store-backed health behavior, reconnect copy, and the no-probe invariant.
- [ ] 13-11-PLAN.md — Run closeout-only docs, versions, full gates, explicit secret scan, and ship-readiness checks. - [ ] 13-11-PLAN.md — Run closeout-only docs, versions, full gates, explicit secret scan, and ship-readiness checks.
+9 -4
View File
@@ -6,14 +6,14 @@ current_phase: 13
current_phase_name: virtual-local-cloud-operations current_phase_name: virtual-local-cloud-operations
status: executing status: executing
stopped_at: Completed 13-07-PLAN.md stopped_at: Completed 13-07-PLAN.md
last_updated: "2026-06-22T17:53:10.202Z" last_updated: "2026-06-22T18:04:30.267Z"
last_activity: 2026-06-22 last_activity: 2026-06-22
last_activity_desc: Phase 13 execution started last_activity_desc: Phase 13 execution started
progress: progress:
total_phases: 6 total_phases: 6
completed_phases: 2 completed_phases: 2
total_plans: 21 total_plans: 21
completed_plans: 18 completed_plans: 19
percent: 33 percent: 33
--- ---
@@ -26,7 +26,7 @@ progress:
## Current Position ## Current Position
Phase: 13 (virtual-local-cloud-operations) — EXECUTING Phase: 13 (virtual-local-cloud-operations) — EXECUTING
Plan: 9 of 11 Plan: 10 of 11
Status: Ready to execute Status: Ready to execute
Last activity: 2026-06-22 — Phase 13 execution started Last activity: 2026-06-22 — Phase 13 execution started
@@ -59,6 +59,7 @@ Last activity: 2026-06-22 — Phase 13 execution started
| Phase 13 P06 | 5m | 2 tasks | 3 files | | Phase 13 P06 | 5m | 2 tasks | 3 files |
| Phase 13 P07 | 30m | 2 tasks | 5 files | | Phase 13 P07 | 30m | 2 tasks | 5 files |
| Phase 13 P08 | 20m | 2 tasks | 2 files | | Phase 13 P08 | 20m | 2 tasks | 2 files |
| Phase 13 P09 | 30m | 2 tasks | 3 files |
## Accumulated Context ## Accumulated Context
@@ -102,7 +103,7 @@ _Updated at each phase transition._
| Field | Value | | Field | Value |
|---|---| |---|---|
| Last session | 2026-06-22T17:52:59.873Z | | Last session | 2026-06-22T18:03:31.577Z |
| Next action | Execute Phase 12.1 Plan 01 | | Next action | Execute Phase 12.1 Plan 01 |
| Pending decisions | None | | Pending decisions | None |
| Resume file | None | | Resume file | None |
@@ -130,3 +131,7 @@ _Updated at each phase transition._
- [Phase ?]: Create-folder bounded retry up to 5 attempts with keep_both_name counter suffix D-05/D-06 - [Phase ?]: Create-folder bounded retry up to 5 attempts with keep_both_name counter suffix D-05/D-06
- [Phase ?]: Stale guard for create-folder and rename calls update_folder_state before returning typed stale body D-07 - [Phase ?]: Stale guard for create-folder and rename calls update_folder_state before returning typed stale body D-07
- [Phase ?]: Reconcile-before-return for create-folder and rename: upsert_cloud_item + update_folder_state T-13-26 - [Phase ?]: Reconcile-before-return for create-folder and rename: upsert_cloud_item + update_folder_state T-13-26
- [Phase ?]: Phase 13 P09 decisions
- [Phase ?]: Phase 13 P09
- [Phase ?]: Phase 13 P09
- [Phase ?]: Phase 13 P09
@@ -0,0 +1,189 @@
---
phase: "13"
plan: "09"
subsystem: cloud-operations
status: complete
tags:
- cloud
- move
- delete
- stale-guard
- descendant-safety
- reconciliation
- audit
- disclosure
- tdd
dependency_graph:
requires:
- "13-08 (create-folder and rename collision, stale guard, reconciliation)"
- "13-06 (upload reconcile-before-return pattern)"
- "13-04 (operations.py route layer + typed result vocabulary)"
provides:
- "Move with same-connection validation, descendant safety, stale guard, reconciliation (D-07, D-08, D-09, T-13-27, T-13-28)"
- "Delete with folder disclosure, parent folder invalidation, metadata-only audit (D-10, D-11, T-13-29)"
- "Metadata-only audit rows for move (cloud.item_moved) and delete (cloud.item_deleted)"
- "11 new behavioral tests in test_cloud_mutations.py"
- "2 xfail promotions in test_cloud_audit.py (move and delete audit rows)"
affects:
- "13-10 through 13-11 (remaining plans)"
tech_stack:
added:
- "_is_descendant_destination() helper in operations.py — ancestor-chain walk via cloud_items"
- "Descendant destination check in move_cloud_item before adapter call (D-09)"
- "Stale result handler in move_cloud_item: update_folder_state + typed stale body (D-07)"
- "Move success: upsert_cloud_item with new parent_ref (reconcile-before-return)"
- "Move success: update_folder_state for both source and destination folders"
- "Move success: write_audit_log 'cloud.item_moved' with metadata-only payload"
- "Delete: pre-fetch item kind and parent_ref for D-10 disclosure"
- "Delete success: update_folder_state for parent folder"
- "Delete success: write_audit_log 'cloud.item_deleted' with delete_kind metadata"
- "Delete response carries is_folder=True / item_kind for frontend disclosure (D-10)"
patterns:
- "Reconcile-before-return: upsert + folder invalidation + audit before success response"
- "Descendant-safe move: ancestor-chain walk through cloud_items metadata (no provider call)"
- "Stale-guard: folder state invalidation on stale result before returning typed stale body"
- "Metadata-only audit: connection_id, provider_item_id, operational metadata — never tokens or bytes"
- "Folder disclosure: is_folder + item_kind in delete response (D-10)"
key_files:
modified:
- path: "backend/api/cloud/operations.py"
change: "move_cloud_item: descendant check, stale guard, reconcile-before-return, audit; delete_cloud_item: pre-fetch metadata, folder invalidation, disclosure, audit"
- path: "backend/tests/test_cloud_mutations.py"
change: "Added 11 behavioral tests (RED then GREEN) for Plan 09"
- path: "backend/tests/test_cloud_audit.py"
change: "Promoted xfail for test_move_success_writes_audit_row and test_delete_success_writes_audit_row; added mock adapters for deterministic audit verification"
decisions:
- "Descendant detection walks ancestor chain through cloud_items DB (metadata-only, no provider call)"
- "Move stale guard marks the source folder (where the item was) as non-fresh"
- "Move success invalidates both source and destination folders — both listings changed"
- "Delete response carries is_folder and item_kind for frontend D-10 folder vs file disclosure"
- "Delete pre-fetches item metadata before adapter call so disclosure is available regardless of provider result"
- "Audit xfail markers in test_cloud_audit.py promoted to passing tests with explicit mock adapters"
metrics:
duration: "~30 minutes"
completed: "2026-06-22"
tasks_completed: 2
tasks_planned: 2
files_changed: 3
files_created: 0
tests_added: 11
tests_passing: 766
---
# Phase 13 Plan 09: Move and Delete — Validation, Reconciliation, and Audit Summary
**One-liner:** Move descendant-safety, stale guard, and reconcile-before-return; delete folder disclosure and metadata-only audit rows for both move and delete.
## Tasks Completed
| Task | Name | Commit | Key Files |
|------|------|--------|-----------|
| 1 (RED) | Add failing tests for move stale-guard, descendant safety, reconciliation, and delete/audit | af7d45f | test_cloud_mutations.py |
| 1/2 (GREEN) | Implement move/delete with stale guards, reconciliation, disclosure, and audit | 508d276 | api/cloud/operations.py, test_cloud_audit.py |
## What Was Built
### Task 1: Move — Descendant Safety, Stale Guard, Centralized Reconciliation
**`_is_descendant_destination()` helper in `backend/api/cloud/operations.py`:**
New async helper that walks the ancestor chain of a proposed destination through `cloud_items` metadata:
```python
while current_ref is not None:
if current_ref == source_item_id:
return True # destination is a descendant of source
# look up parent of current_ref via CloudItem.parent_ref
current_ref = parent_item.parent_ref if parent_item else None
```
- D-09: Backend independently rejects descendant destinations without provider involvement
- Protection against cycles via a visited-set guard
**`move_cloud_item` in `backend/api/cloud/operations.py`:**
Comprehensive move implementation:
1. **D-08 Cross-connection rejection** — before any adapter call (unchanged)
2. **D-09 Self-destination rejection** — before any adapter call (unchanged)
3. **D-09 Descendant destination rejection** — metadata-only ancestor-chain walk before adapter call
4. **Pre-fetch item metadata** — resolves `source_parent_ref`, `item_kind`, `item_name` before adapter
5. **D-07 Stale guard** — stale adapter result marks source folder non-fresh, returns typed stale body
6. **Reconcile-before-return on success:**
- `upsert_cloud_item` with `parent_ref=resolved_dest_parent_ref`
- `update_folder_state` for source folder (item removed)
- `update_folder_state` for destination folder (item added)
- `write_audit_log` `cloud.item_moved` with metadata-only payload
- `session.commit()`
### Task 2: Delete — Folder Disclosure and Metadata-Only Audit
**`delete_cloud_item` in `backend/api/cloud/operations.py`:**
1. **Pre-fetch item metadata** — resolves `item_kind` and `item_parent_ref` before adapter call
2. **D-10 Folder disclosure** — response includes `is_folder` and `item_kind` for frontend to display stronger folder-delete warning
3. **Reconcile-before-return on success:**
- `update_folder_state` for parent folder (item removed)
- `write_audit_log` `cloud.item_deleted` with `delete_kind`, `item_kind`, `provider_item_id`
- `session.commit()`
4. **D-11 Trash vs permanent**`delete_kind` in audit metadata and response `reason` distinguish trashed vs permanent delete
Success response now includes:
```python
{
"kind": "deleted",
"reason": "trashed", # or "permanent"
"provider_item_id": "...",
"item_kind": "folder", # D-10 disclosure
"is_folder": True, # D-10 stronger confirmation
}
```
## Test Suite Results
```
766 passed, 17 skipped, 4 deselected, 10 xfailed, 55 warnings
```
Previous baseline (Plan 08): 755 passed, 17 skipped, 4 deselected, 12 xfailed
- 11 new tests added in `test_cloud_mutations.py` (all pass)
- 2 xfail markers promoted in `test_cloud_audit.py` (move + delete audit tests now pass)
- Net: +11 passing, -2 xfailed = 766 total passing
## Deviations from Plan
### Auto-fixed Issues
**1. [Rule 1 - Bug] Audit tests in test_cloud_audit.py needed mock adapters**
- **Found during:** Task 2 (GREEN verification)
- **Issue:** `test_move_success_writes_audit_row` and `test_delete_success_writes_audit_row` were promoted from xfail but used real connections without mock adapters — provider calls returned 503 which was not in the accepted status codes
- **Fix:** Added explicit mock adapters with `build_mutable_cloud_adapter` patch so tests exercise the audit write path deterministically
- **Files modified:** `backend/tests/test_cloud_audit.py`
- **Commit:** 508d276 (included in GREEN commit)
## Known Stubs
None. Move and delete reconciliation are fully functional, including stale guards, descendant safety, and metadata-only audit rows.
## Threat Flags
No new security surfaces introduced. T-13-27, T-13-28, T-13-29 are mitigated:
- **T-13-27 (move destinations):** Descendant-chain walk + self-check + cross-connection check enforce D-08 and D-09 before and independently of provider submission.
- **T-13-28 (stale move safety):** Stale guard stops move, refreshes source folder, requires retry — never forcing a stale move.
- **T-13-29 (delete disclosure and audit):** Typed delete results carry `is_folder`/`item_kind`; audit tests verify no token or byte appears in `metadata_`.
## Self-Check: PASSED
- FOUND: `backend/api/cloud/operations.py` with `_is_descendant_destination`, move stale guard, move/delete reconcile-before-return, and move/delete audit writes
- FOUND: `backend/tests/test_cloud_mutations.py` with 11 new behavioral tests
- FOUND: `backend/tests/test_cloud_audit.py` with promoted move/delete xfail markers and mock adapters
- FOUND commit: `af7d45f` (RED tests)
- FOUND commit: `508d276` (GREEN implementation)
- Full suite: 766 passed, 17 skipped, 4 deselected, 10 xfailed