Admin
Connectors
Redshift
Owner · AWGCommercial system of record. Join key is dim_user → AUMS UUID, so coverage is definitionally complete.
AWG platform API
Owner · AWGEntitlement handshake and subscription lifecycle transitions.
Firebase
Owner · SimpleStreamuser_id property carries the AUMS UUID on 96.1% of events. The 3.9% gap is pre-auth sessions, which cannot resolve by design.
NPAW
Owner · SimpleStreamHighest-risk dependency in the project. Volume is 14% below expected because Tizen and tvOS payloads are not yet in the S3 feed; QoE metrics for those platforms are labelled partial everywhere they appear.
Datadog
Owner · SimpleStreamNo metric in this tool depends solely on Datadog. APM traces and RUM sessions are absent from every reading until this connects.
CloudWatch CDN
Owner · AWGEdge logs carry a request id, not an AUMS UUID. Treated as a cohort-level signal only — never attributed to an individual user.
Zendesk
Owner · Sony L1Requester email resolves through dim_user. The 1.6% gap is tickets raised from addresses with no matching subscription.
Open data-health issues
- NPAWPartial
Interim S3 raw-data delivery — Data API access still open (§16 Q4)
- DatadogNot connected
Awaiting API key — instrumentation at very early stages
- CloudWatch CDNLagging
S3 standard access logs (batch)
- FirebaseSchema drift
user_properties.plan_tier added 26 Aug
What a degraded source does to a reading
- PartialThe metric is computed over the population that did resolve and labelled partial everywhere it appears. It is never silently averaged with the missing group.
- AbsentNo metric in the tool depends solely on Datadog, so its absence removes APM and RUM detail without invalidating any headline figure.
- Cohort-onlyCloudWatch carries a request id rather than an AUMS UUID, so edge findings are reported as cohort signals and never attributed to a person.
- AlertableCoverage and freshness failures raise alerts of their own — 1 is open now against the NPAW feed.
Ingestion run history
| Run | Source | Status | Started | Duration | Rows loaded | Rejected |
|---|---|---|---|---|---|---|
| IR-88412 | ZD | Success | 4m ago | 2m | 18 | — |
| IR-88411 | AWG | Success | 9m ago | 5m | 34,120 | — |
| IR-88409 | RSHFT | Success | 18m ago | 6m | 174,280 | — |
| IR-88407 | NPAW | Partial | 32m ago | 6m | 402,680 | — |
| IR-88404 | FIRE | Success | 44m ago | 6m | 894,112 | 1,284 |
| IR-88394 | RSHFT | Success | 1h 18m ago | 7m | 168,940 | — |
| IR-88398 | CW | Success | 1h 40m ago | 6m | 2,425,500 | — |
| IR-88396 | NPAW | Failed | 2h 32m ago | 3m | 0 | — |
| IR-88390 | FIRE | Partial | 3h 44m ago | 10m | 812,004 | 9,882 |
| IR-88387 | CW | Failed | 5h 40m ago | 4m | 0 | — |
- IR-88407Loaded 5 of 7 platform partitions. Tizen and tvOS partitions absent from the S3 prefix — not an error, the interim feed does not carry them.
- IR-884041,284 events rejected: user_properties.plan_tier appeared on 26 Aug and is not in the target schema. Rejects are quarantined, not dropped.
- IR-88398Batch delivery. 94 minutes behind a 60-minute target — the lag is the delivery cadence, not a fault.
- IR-88396S3 GetObject 403 on prefix npaw/2026/08/28/11. Credential rotated by NPAW without notice; retried successfully at 12:14.
- IR-88390Elevated reject rate during the 3.4.1 rollout — 9,882 events carried an app_version string the dimension did not yet contain.
- IR-88387Manifest for the 08:00 batch never arrived. Backfilled by IR-88398.
Retention against the history the detectors need
- RSHFTRedshiftretains 730dneeds 90d640d headroom
- AWGAWG platform APIretains 365dneeds 90d275d headroom
- FIREFirebaseretains 60dneeds 30d30d headroom
- NPAWNPAWretains 30dneeds 28d2d headroom
- DDOGDatadogretains 15dneeds —no detectors
- CWCloudWatch CDNretains 30dneeds 28d2d headroom
- ZDZendeskretains 1095dneeds 30d1065d headroom