ADW Pipeline System — v2

Confirmed Decisions & Implementation Roadmap — 2026-03-07
5/5 Decisions Confirmed All Recommendations Accepted Ready for Implementation
Decision Progress

All Decisions Confirmed

Decision Completion 100%
5 of 5 decisions resolved — respondent: Jonathan — 2026-03-07
5/5
Decisions Resolved
0
Open Threads
3
Implement Now
2
Deferred (Trigger-Based)
Confirmed

Confirmed Decisions

All 5 decisions accepted the recommended option. These are now confirmed architectural facts for the ADW pipeline.

D1 — Confirmed
Batched Issue Processing
Single-issue processing (current)
No changes needed. Pipeline stays single-issue. Revisit if queue depth regularly exceeds 5.
D2 — Confirmed
Long-Running Implementation
Checkpoint + Resume (v2)
Design checkpoint at step boundaries. Resume from last successful step on context exhaustion. Deferred until first failure.
D3 — Confirmed
GitHub API Retry Strategy
Exponential backoff (3 retries)
Implement 1s/2s/4s retry in github_ops.py. Standard pattern, immediate value.
D4 — Confirmed
CSA-to-ADW Back-Link
Auto-update manifest
ADW writes adw_issues_created to _handoff.json and sets status: handed-off. Full traceability.
D5 — Confirmed
Allowlist Scaling
Convention-based auto-discovery (v2)
Repos with .adw-pipeline.json auto-enroll. Allowlist becomes deny-list. Implement when repos approach 30.
Roadmap

Implementation Roadmap

Prioritized by immediate impact and dependency order. Three decisions implement now; two are trigger-based and deferred.

Implementation Timeline

    


    

      

        
Now

        

          
D3: Exponential Backoff for GitHub API

          
Add 3-retry exponential backoff (1s/2s/4s) to all GitHub API calls in github_ops.py. Standard pattern, low risk, immediate reliability improvement.

          
Confirmed: Exponential backoff (3 retries) | Complexity: Low | File: github_ops.py

        

      

      

        
Now

        

          
D4: CSA-to-ADW Back-Link Auto-Update

          
After ADW processes a handoff, write adw_issues_created array and update status: handed-off in the CSA workspace's _handoff.json.

          
Confirmed: Auto-update manifest | Complexity: Medium | Files: adw_pipeline.py, worker.py

        

      

      

        
Now

        

          
D1: Validate Single-Issue Model

          
No code change — current single-issue processing confirmed as correct. Add queue depth metric logging to validate assumption (depth < 5).

          
Confirmed: Single-issue (current) | Complexity: None | Monitoring only

        

      

      

        
Triggered

        

          
D2: Checkpoint/Resume on Context Exhaustion

          
Design checkpoint mechanism at pipeline step boundaries. Activates when first context exhaustion failure occurs. Until then, manual --resume is the bridge.

          
Confirmed: Checkpoint + resume (v2) | Trigger: First context exhaustion failure

        

      

      

        
Triggered

        

          
D5: Convention-Based Auto-Discovery

          
Repos with .adw-pipeline.json auto-enroll. Allowlist flips to deny-list. Activates when repo count approaches 30 or team grows.

          
Confirmed: Auto-discovery (v2) | Trigger: Repos > 30 or team > 1

        

      

    

  


  
  

    Architecture
    
Confirmed Architecture

    
Pipeline architecture with confirmed decisions integrated. Green annotations show where confirmed decisions apply.


    

      
Pipeline with Confirmed Enhancements

      

      

    


    

      
ComponentCurrent StateConfirmed EnhancementStatus

      
        

          github_ops.py
          No retry on API errors
          D3: Exponential backoff (1s/2s/4s, 3 retries)
          Implement now
        

        

          adw_pipeline.py
          No handoff back-link
          D4: Write adw_issues_created to _handoff.json
          Implement now
        

        

          worker.py
          Single-issue processing
          D1: Confirmed — no change needed
          Confirmed
        

        

          adw_pipeline.py
          Fail + notify on context exhaustion
          D2: Checkpoint + resume (trigger-based)
          Deferred
        

        

          config.py
          22-repo manual allowlist
          D5: .adw-pipeline.json convention (trigger-based)
          Deferred
        

      
    

  


  
  

    Next Steps
    
Implementation Path


    

      
Implementation Sequence

      

      

    


    

      
Immediate Actions

      
    
        
  1. D3: Exponential backoff — Add retry decorator to github_ops.py API calls. Estimated: 1 ADW issue.
    2. 
        
  2. D4: Manifest back-link — Update adw_pipeline.py completion step to write adw_issues_created to CSA workspace _handoff.json. Estimated: 1 ADW issue.
    3. 
        
  3. D1: Queue depth logging — Add metric log line in worker.py to track queue depth. Zero-risk observability addition.
    4. 
      

      
Deferred (Trigger-Based)

      
    
        
  1. D2: Checkpoint/resume — Design doc when first context exhaustion occurs. Bridge: manual --resume.
    2. 
        
  2. D5: Auto-discovery — Convention file spec when repo count approaches 30.
    3.