All Mission Files

Scenario 2: Stripe to S3 with a 3-day lookback

You are asked to design a pipeline that pulls payments from Stripe's API into raw/payments/ in shop-data-lake, with a 3-day lookback window to pick up refunds.

OUTBOUNDStripe APIpayments, last 3 dayspaymentsLambdanightly, 22:00S3 BUCKET · 28 OCTOBER1write, 26 Oct2refunds, 27 Oct3refunds, 28 Octversion 1version 2version 3raw/payments/2026-10-26.jsonLifecycle ruleNoncurrentDays 30S3 BUCKET · FROM 28 NOVEMBERversion 1, deleted 27 Novversion 2, deleted 28 Novversion 3raw/payments/2026-10-26.jsonOUTBOUNDStripe APIpayments, last 3 dayspaymentsLambdanightly, 22:00S3 BUCKET · 28 OCTOBER1write, 26 Oct2refunds, 27 Oct3refunds, 28 Octversion 1version 2version 3raw/payments/2026-10-26.jsonLifecycle ruleNoncurrentDays 30S3 BUCKET · FROM 28 NOVEMBERversion 1,deleted 27 Novversion 2,deleted 28 Novversion 3raw/payments/2026-10-26.json

Stripe API sends payments (last 3 days) down to Lambda (nightly, 22:00).

"To determine the number of days an object is noncurrent, Amazon S3 looks at when its successor was created."