DataScout

arckit datascout <data-need>

arckit datascout "real-time traffic data UK"
arckit datascout "company financials"
arckit datascout "geolocation API"

arckit requirements "traffic monitoring dashboard"
arckit data-model "traffic monitoring dashboard"

arckit datascout "real-time traffic data UK"

### DfT Real-Time Traffic API (UK Government)

**Total Score:** 92/100

| Criterion | Score | Weight | Weighted | Rationale |
|-----------|-------|--------|----------|----------|
| Requirements Fit | 10/10 | 30% | 30 | Perfectly matches DR-003 (real-time traffic flow) |
| Data Quality | 9/10 | 25% | 22.5 | Official DfT data, updated every 5 minutes |
| License & Cost | 10/10 | 20% | 20 | Free, Open Government Licence (OGL) |
| API Quality | 9/10 | 15% | 13.5 | RESTful, JSON, good docs, rate limit 600/hour |
| Compliance | 10/10 | 5% | 5 | UK-hosted, GDPR-compliant, no personal data |
| Reliability | 9/10 | 5% | 4.5 | 99.5% uptime (government SLA) |

**Recommendation:** ✅ HIGHLY RECOMMENDED (official government source, free, high quality)

## Gap Analysis

### GAP-001: Real-Time Parking Availability

**Requirement:** DR-005 - Real-time parking space availability (city-wide)

**Gap:** No centralized UK API for parking availability across councils

**Impact:** Cannot fulfill FR-012 (show nearby parking in app)

**Options:**
1. **Council-by-Council Integration:** Integrate with individual council parking APIs (e.g., Westminster, Camden)
   - **Pros:** Accurate, real-time
   - **Cons:** 30+ integrations needed for London alone, inconsistent APIs
2. **Parking Aggregator (ParkWhiz, JustPark):** Commercial API aggregating parking data
   - **Pros:** Single API, national coverage
   - **Cons:** Licensing cost (£5,000/year), limited council partnerships
3. **Build Custom Scraper:** Scrape council websites for parking data
   - **Pros:** Free
   - **Cons:** Unreliable, legal risks (ToS violations), no real-time guarantee

**Recommendation:** Option 2 (ParkWhiz API) - cost justified by national coverage and time savings

## Data Utility Analysis

### Utility Opportunity: Census Demographics

**Primary Requirement:** DR-002 - Store customer postcodes for delivery routing

**Discovered Source:** ONS Census API (free, UK Government)

**Additional Utility:**
1. **Market Segmentation:** Link postcodes to Census demographics (age, income, household size)
   - **Use Case:** Personalized product recommendations (families vs singles)
2. **Service Planning:** Identify underserved areas (low delivery coverage, high demand)
   - **Use Case:** Optimize warehouse locations, delivery routes
3. **Compliance:** GDPR-compliant (anonymized, aggregated data)
   - **Use Case:** Avoid processing individual-level demographic PII

**Impact:**
- Enhances existing data model (E-001: Customer entity)
- Supports future FR-xxx requirements (personalization, analytics)
- No additional cost (free ONS API)

**Recommendation:** ✅ ADD TO DATA MODEL (new attribute: `census_area_id`)

# Data Source Discovery Document

## Document Control
- Document ID: ARC-001-DSCT-v1.0
- Version: 1.0
- Status: DRAFT

## Executive Summary
- Total Sources Discovered: 12
- UK Government Sources: 5
- Commercial APIs: 4
- Free/Freemium APIs: 2
- Open Datasets: 1

## Requirements Coverage
- Data Requirements (DR-xxx): 8 requirements
- Coverage: 87.5% (7/8 fulfilled)
- Gaps: 1 (DR-005: Real-time parking)

## Discovered Sources (by Category)

### UK Government Open Data
[Source 1, Source 2, ...]

### Commercial APIs
[Source 3, Source 4, ...]

### Free/Freemium APIs
[Source 5, Source 6, ...]

### Open Datasets
[Source 7, ...]

## Evaluation & Recommendations

### Top Recommended Sources
[Sorted by total score, 90+]

### Conditional Recommendations
[Scored 70-89, suitable for specific use cases]

### Not Recommended
[Scored <70, significant drawbacks]

## Gap Analysis
[Requirements not fulfilled, options, recommendations]

## Data Utility Analysis
[Additional value beyond primary requirements]

## Data Model Impact
[New entities, attributes, relationships to add]

## Integration Considerations
[Authentication, rate limits, data formats, error handling]

## Compliance & Privacy
[GDPR, data residency, third-party processors, DPIA triggers]

## Cost Analysis
[Licensing fees, pay-per-request, free tier limits]

## Next Steps
[Actions: add to data model, research vendors, create ADR, conduct DPIA]