Skip to main content

​
Required Tools

Before deploying the llms.txt Generator, ensure you have the following tools installed on your local machine.

​
Tool Versions

AWS CLI

Version 2.0 or higher required for AWS resource management

Terraform

Version 1.0 or higher for infrastructure as code

Docker

Latest version for building and pushing container images

Node.js

Version 20 or higher for frontend development

​
Installation Commands

# Install Homebrew (if not already installed)
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

# Install all required tools
brew install awscli terraform docker node [email protected]

# Start Docker daemon
open -a Docker

​
Verify Installations

Run these commands to verify all tools are properly installed: 
# AWS CLI
aws --version
# Expected: aws-cli/2.x.x ...

# Terraform
terraform --version
# Expected: Terraform v1.x.x

# Docker
docker --version
# Expected: Docker version 24.x.x

# Node.js
node --version
# Expected: v20.x.x

# Python
python3 --version
# Expected: Python 3.11.x
If any command fails, revisit the installation steps for that specific tool.

​
Required Accounts

You’ll need accounts with the following services. Most offer free tiers suitable for getting started.

​
AWS Account

1

Create AWS Account

Visit aws.amazon.com and sign up for a new account. You’ll need:
  • Valid email address
  • Credit card for verification
  • Phone number for 2FA
2

Enable Billing Alerts

Set up billing alerts to avoid unexpected charges:
  1. Go to AWS Billing Console
  2. Navigate to “Billing Preferences”
  3. Enable “Receive Billing Alerts”
  4. Create CloudWatch alarm for budget threshold
3

Create IAM User

For security, create an IAM user instead of using root credentials:
  1. Go to IAM Console
  2. Create new user with “Programmatic access”
  3. Attach policy: AdministratorAccess (or custom limited policy)
  4. Save Access Key ID and Secret Access Key
Cost Estimate: AWS infrastructure will cost approximately $35-40/month. Free tier covers some services for the first 12 months.

​
Supabase Account

1

Sign Up

Visit supabase.com and create a free account using:
  • GitHub account (recommended)
  • Email and password
2

Create Project

  1. Click “New Project”
  2. Choose organization (or create new)
  3. Enter project name: llmstxt-generator
  4. Create strong database password (save it securely)
  5. Select region closest to your users
  6. Choose free tier plan
3

Save Credentials

From Project Settings → API, copy:
  • Project URL: https://xxxxx.supabase.co
  • Anon/Public Key: eyJhbGc... (long string)
Free Tier: 500MB database, 1GB file storage, 2GB bandwidth/month. Sufficient for testing and small deployments.

​
Cloudflare Account

1

Create Account

Visit cloudflare.com and sign up with email.
2

Enable R2 Storage

  1. Navigate to R2 in dashboard
  2. Click “Purchase R2”
  3. Enable R2 (free tier available)
3

Create R2 Bucket

  1. Click “Create bucket”
  2. Name: llmstxt (or your preferred name)
  3. Location: Automatic (recommended)
  4. Enable public access
4

Generate API Token

  1. Go to “Manage R2 API Tokens”
  2. Click “Create API Token”
  3. Permissions: Read & Write
  4. Bucket: Select your bucket or “All buckets”
  5. Save:
    • Access Key ID
    • Secret Access Key
    • Endpoint URL: https://xxxxx.r2.cloudflarestorage.com
5

Get Public Domain

  1. Return to bucket settings
  2. Copy “Public R2.dev subdomain”: https://pub-xxxxx.r2.dev
  3. Alternatively, configure custom domain
Free Tier: 10GB storage, 1M Class A operations, 10M Class B operations per month.

​
Vercel Account (Frontend)

1

Sign Up

Visit vercel.com and create account with:
  • GitHub account (recommended for Git integration)
  • GitLab or Bitbucket
  • Email
2

Install Vercel CLI

npm install -g vercel
vercel login
Free Tier: 100GB bandwidth, unlimited deployments, automatic HTTPS.

​
Optional: Brightdata Account

Brightdata’s Scraping Browser is optional but recommended for crawling modern JavaScript-heavy websites.
1

Create Account

Visit brightdata.com and sign up.
2

Create Scraping Browser Zone

  1. Navigate to Proxies & Scraping
  2. Add Zone → Scraping Browser
  3. Name: scraping_browser1
  4. Set password
3

Save Credentials

From zone settings, copy:
  • Customer ID (your account ID)
  • Zone name: scraping_browser1
  • Zone password: (the one you set)
Pricing: Pay-per-use, approximately 0.001perpagerequest.First0.001 per page request. First 1 free credit available.

​
Optional: OpenRouter Account

OpenRouter provides access to multiple LLM models for enhancing page descriptions.
1

Create Account

Visit openrouter.ai and sign up.
2

Generate API Key

  1. Go to API Keys section
  2. Create new key
  3. Copy and save securely
3

Add Credits

  1. Navigate to Billing
  2. Add credits (start with $5-10)
LLM enhancement is optional. You can deploy without it and enable later.

​
Credentials Checklist

Before proceeding, ensure you have collected all these credentials:
  • AWS Access Key ID
  • AWS Secret Access Key
  • AWS Region (e.g., us-east-1)
  • Supabase Project URL
  • Supabase Anon Key
  • R2 Endpoint URL
  • R2 Access Key ID
  • R2 Secret Access Key
  • R2 Bucket Name
  • R2 Public Domain
  • Brightdata Customer ID (optional)
  • Brightdata Zone Password (optional)
  • OpenRouter API Key (optional)
Store all credentials securely using a password manager. Never commit credentials to version control.

​
Next Steps

AWS Setup

Configure AWS CLI and identify VPC resources for ECS deployment

Build docs developers (and LLMs) love

Get started for freeTalk to us