AWS Lambda Deployment - Premier League

Overview

Deploy the Premier League API as serverless functions on AWS Lambda. This deployment method provides automatic scaling, pay-per-use pricing, and zero server management. All file exports (CSV, JSON, PDF) are automatically saved to Amazon S3.

Architecture

The Lambda deployment includes three separate functions:

PlayersPremierLeagueData: Handles player statistics endpoints (/player_ranking, /player_csv, /player_json, /player_pdf)
RankingPremierLeagueData: Handles ranking endpoints (/ranking, /ranking_csv, /ranking_json, /ranking_pdf)
TransferPremierLeagueData: Handles transfer endpoints (/transfers_in, /transfers_out, /transfers_csv, /transfers_json)

Each function is configured with:

Runtime: Python 3.11
Timeout: 30 seconds
Memory: 1024 MB
API Gateway: HTTP events for RESTful access

Reference: premier_league/lambda_functions/serverless.yml:25-112

Prerequisites

Before deploying, ensure you have:

AWS Account

Create an AWS account if you don’t have one: aws.amazon.com

IAM Permissions

Configure IAM user/role with the following permissions:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": [
        "s3:PutObject",
        "s3:GetObject"
      ],
      "Resource": "arn:aws:s3:::your-bucket-name/*"
    }
  ]
}

These permissions allow Lambda functions to read and write files to S3.

S3 Bucket

Create an S3 bucket in the AWS Console:

Go to S3 service in AWS Console
Click “Create bucket”
Choose a unique name (e.g., premier-league-exports)
Select your preferred region
Configure settings (default settings work fine)
Click “Create bucket”

Install Serverless Framework

Install the Serverless Framework and required plugins globally:

npm install -g serverless
npm install -g serverless-python-requirements

Install Premier League Library

Install the library with Lambda support:

pip install premier_league[lambda]

Deployment

Quick Deploy

Deploy with a single command using the built-in deployment script:

S3_BUCKET_NAME=your-bucket-name python -m premier_league.lambda_functions.deploy_premier_league \
  --aws-profile your-aws-profile \
  --region us-east-1

Parameters:

S3_BUCKET_NAME: Your S3 bucket name (defaults to premier-league-bucket if not specified)
--aws-profile: AWS CLI profile name (optional, uses default profile if not specified)
--region: AWS region (e.g., us-east-1, eu-west-1, ca-central-1)

Reference: premier_league/lambda_functions/deploy_premier_league.py:13-23

Deployment Examples

# Deploy using default AWS profile
S3_BUCKET_NAME=my-premier-league-bucket python -m premier_league.lambda_functions.deploy_premier_league \
  --region us-east-1

Deployment Output

After successful deployment, you’ll receive API endpoint URLs:

Service Information
service: Premier_League_Data_Tool
stage: dev
region: us-east-1
stack: Premier_League_Data_Tool-dev
resources: 15
api keys:
  None
endpoints:
  GET - https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/player_ranking
  GET - https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/ranking
  GET - https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/transfers_in
  ...
functions:
  PlayersPremierLeagueData: Premier_League_Data_Tool-dev-PlayersPremierLeagueData
  RankingPremierLeagueData: Premier_League_Data_Tool-dev-RankingPremierLeagueData
  TransferPremierLeagueData: Premier_League_Data_Tool-dev-TransferPremierLeagueData

Save these endpoint URLs - you’ll need them to interact with your deployed API.

Serverless Configuration

The deployment uses a pre-configured serverless.yml file with the following structure:

service: Premier_League_Data_Tool

provider:
  name: aws
  region: ca-central-1
  stage: ${opt:stage, 'dev'}
  iamRoleStatements:
    - Effect: 'Allow'
      Action:
        - s3:PutObject
        - s3:GetObject
  environment:
    S3_BUCKET_NAME: ${env:S3_BUCKET_NAME, 'premier-league-bucket'}

Key Configuration:

Service Name: Premier_League_Data_Tool
Default Region: ca-central-1 (can be overridden with --region)
Stage: dev (can be customized with --stage flag)
IAM Role: Automatically grants S3 read/write permissions
Environment Variable: S3_BUCKET_NAME passed to all Lambda functions

Reference: premier_league/lambda_functions/serverless.yml:1-13

Lambda Function Details

Player Statistics Function

Handler: src/player_lambda.lambda_handler Endpoints:

GET /player_ranking - Get player statistics as JSON
GET /player_csv - Export to CSV (saves to S3)
PUT /player_json - Export to JSON (saves to S3)
GET /player_pdf - Export to PDF (saves to S3)

Query Parameters:

season - Target season (e.g., “2023-2024”)
stat_type - “G” for goals or “A” for assists
filename - Required for export endpoints
limit - Maximum number of results
header - Custom header for exports
league - Target league name

Reference: premier_league/lambda_functions/src/player_lambda.py:63-79

Ranking Function

Handler: src/ranking_lambda.lambda_handler Endpoints:

GET /ranking - Get league standings
GET /ranking_csv - Export to CSV (saves to S3)
PUT /ranking_json - Export to JSON (saves to S3)
GET /ranking_pdf - Export to PDF (saves to S3)

Transfer Function

Handler: src/transfers_lambda.lambda_handler Endpoints:

GET /transfers_in - Get incoming transfers
GET /transfers_out - Get outgoing transfers
PUT /transfers_csv - Export to CSV (saves to S3)
GET /transfers_json - Export to JSON (saves to S3)

Reference: premier_league/lambda_functions/serverless.yml:26-78

S3 File Storage

All exported files (CSV, JSON, PDF) are automatically saved to your configured S3 bucket. The Lambda functions handle the upload process:

S3_BUCKET_NAME = os.environ["S3_BUCKET_NAME"]

# Example: Export CSV to S3
export_to_csv(filename, data, header=header)
save_to_s3(f"{filename}.csv", S3_BUCKET_NAME)

File Naming Convention:

Files use the filename parameter from your request
Extensions are added automatically (.csv, .json, .pdf)
Files are stored at the root level of your bucket

Reference: premier_league/lambda_functions/src/player_lambda.py:12,42-43

Accessing Exported Files

AWS Console
AWS CLI
boto3 (Python)

Open AWS S3 Console
Navigate to your bucket
Find and download the exported file

# List files in bucket
aws s3 ls s3://your-bucket-name/

# Download a specific file
aws s3 cp s3://your-bucket-name/top_scorers.csv ./

import boto3

s3 = boto3.client('s3')

# Download file
s3.download_file(
    'your-bucket-name',
    'top_scorers.csv',
    'local_file.csv'
)

Testing the Deployment

Test your deployed endpoints using cURL or any HTTP client:

# Get top scorers
curl "https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/player_ranking?stat_type=G&limit=10"

# Get league rankings
curl "https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/ranking?season=2023-2024"

# Export to CSV (saves to S3)
curl -X GET "https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/player_csv?stat_type=G&filename=scorers&limit=20"

# Get transfers
curl "https://xxxxxxxxxx.execute-api.us-east-1.amazonaws.com/dev/transfers_in?team=Arsenal&season=2023-2024"

Managing the Deployment

Update Deployment

Redeploy after making changes:

S3_BUCKET_NAME=your-bucket-name python -m premier_league.lambda_functions.deploy_premier_league \
  --aws-profile your-profile \
  --region us-east-1

Serverless Framework performs incremental updates automatically.

Remove Deployment

Remove all Lambda functions and API Gateway resources:

serverless remove \
  --config ~/.../premier_league/lambda_functions/serverless.yml \
  --aws-profile your-profile \
  --region us-east-1

This removes the Lambda functions and API endpoints but does not delete your S3 bucket or its contents.

View Logs

View function logs using AWS CLI:

# View player function logs
serverless logs -f PlayersPremierLeagueData --tail

# View ranking function logs
serverless logs -f RankingPremierLeagueData --tail

# View transfer function logs
serverless logs -f TransferPremierLeagueData --tail

Cost Optimization

Lambda Pricing

AWS Lambda pricing is based on:

Requests: $0.20 per 1M requests
Duration: $0.0000166667 per GB-second

With 1024 MB memory and 30s timeout:

~$0.0005 per request
AWS Free Tier: 1M requests/month + 400,000 GB-seconds/month

Most users stay within free tier limits.

S3 Storage Costs

S3 Standard pricing:

Storage: $0.023 per GB/month
PUT requests: $0.005 per 1,000 requests
GET requests: $0.0004 per 1,000 requests

Exported files are typically small (< 1 MB), resulting in minimal costs.

Optimization Tips

Set up S3 lifecycle policies to delete old exports
Use S3 Intelligent-Tiering for infrequently accessed files
Monitor CloudWatch metrics to identify unused functions
Consider reducing memory allocation if functions don’t need 1024 MB
Implement caching to reduce duplicate API calls

Troubleshooting

Deployment fails with credentials error

Error: AWS credentials not foundSolution: Configure AWS credentials:

aws configure --profile your-profile

Enter your AWS Access Key ID, Secret Access Key, and default region.

S3 bucket access denied

Error: Access Denied when uploading to S3Solution: Verify your IAM role has the required S3 permissions:

Check the IAM role attached to Lambda
Ensure it has s3:PutObject and s3:GetObject permissions
Verify the bucket name in the environment variable matches your actual bucket

Function timeout errors

Error: Task timed out after 30.00 secondsSolution: Increase the timeout in serverless.yml:

functions:
  PlayersPremierLeagueData:
    timeout: 60  # Increase to 60 seconds

Then redeploy.

Package size too large

Error: Deployment package size exceeds limitSolution: The serverless-python-requirements plugin handles this automatically by:

Using slim versions of packages
Excluding unnecessary files
Compressing the deployment package

If issues persist, consider using Lambda Layers for large dependencies.

Advanced Configuration

Custom Stage Deployment

S3_BUCKET_NAME=prod-bucket python -m premier_league.lambda_functions.deploy_premier_league \
  --aws-profile production \
  --region us-east-1 \
  --stage production

Environment-Specific Buckets

# Development
S3_BUCKET_NAME=dev-premier-league python -m premier_league.lambda_functions.deploy_premier_league \
  --region us-east-1 --stage dev

# Production
S3_BUCKET_NAME=prod-premier-league python -m premier_league.lambda_functions.deploy_premier_league \
  --region us-east-1 --stage prod

Custom Domain Names

To use a custom domain:

Set up a domain in Route 53 or your DNS provider
Create an ACM certificate
Add custom domain configuration to serverless.yml:

custom:
  customDomain:
    domainName: api.yourdomain.com
    certificateName: '*.yourdomain.com'
    basePath: 'premier-league'
    stage: ${self:provider.stage}
    createRoute53Record: true

Install the serverless domain manager plugin:

npm install -g serverless-domain-manager

Next Steps

Local Deployment

Run the API locally for development and testing

API Endpoints

Explore available API endpoints and parameters

AWS Lambda Docs

Learn more about AWS Lambda

Serverless Framework

Deep dive into Serverless Framework

Overview

Endpoints

Deployment

​Overview

​Architecture

​Prerequisites

​Deployment

​Quick Deploy

​Deployment Examples

​Deployment Output

​Serverless Configuration

​Lambda Function Details

​Player Statistics Function

​Ranking Function

​Transfer Function

​S3 File Storage

​Accessing Exported Files

​Testing the Deployment

​Managing the Deployment

​Update Deployment

​Remove Deployment

​View Logs

​Cost Optimization

​Troubleshooting

​Advanced Configuration

​Custom Stage Deployment

​Environment-Specific Buckets

​Custom Domain Names

​Next Steps

Local Deployment

API Endpoints

AWS Lambda Docs

Serverless Framework

Build docs developers (and LLMs) love

Overview

Architecture

Prerequisites

Deployment

Quick Deploy

Deployment Examples

Deployment Output

Serverless Configuration

Lambda Function Details

Player Statistics Function

Ranking Function

Transfer Function

S3 File Storage

Accessing Exported Files

Testing the Deployment

Managing the Deployment

Update Deployment

Remove Deployment

View Logs

Cost Optimization

Troubleshooting

Advanced Configuration

Custom Stage Deployment

Environment-Specific Buckets

Custom Domain Names

Next Steps