Overview
Smart Reframing solves one of the biggest challenges in repurposing content for social media: converting horizontal (landscape) videos into vertical formats without losing the action. ClypAI’s AI-powered reframing tracks the important elements in your video and automatically crops for optimal vertical viewing.Platform Optimization: Over 98% of TikTok and Instagram Reels content is consumed in vertical format. Horizontal videos perform poorly on these platforms.
The Vertical Format Challenge
Most content is recorded in landscape (16:9) format:- Desktop screens and monitors
- Traditional cameras and webcams
- Streaming software defaults
- Professional video equipment
- TikTok
- Instagram Reels
- YouTube Shorts
- Snapchat Spotlight
How Smart Reframing Works
Content Analysis
ClypAI analyzes your video frame-by-frame to identify:
- Faces and people
- Text and graphics
- Movement and action
- Points of visual interest
- Screen shares and presentations
Intelligent Tracking
The system tracks important elements throughout the video:
- Face Tracking: Keeps speakers centered in frame
- Action Tracking: Follows movement and gestures
- Text Tracking: Ensures on-screen text remains visible
- Multi-Subject Tracking: Manages multiple people or elements
- Scene Changes: Smoothly transitions between different shots
Smooth Reframing
The vertical crop automatically adjusts its position:
- Smooth panning to follow movement
- Natural transitions between subjects
- Optimized centering and composition
- Maintains visual stability
- Avoids distracting jerky movements
Supported Aspect Ratios
ClypAI can reframe your content to any aspect ratio:Vertical (9:16)
Best for: TikTok, Instagram Reels, YouTube Shorts1080 x 1920 pixelsMaximizes screen real estate on mobile devices
Portrait (4:5)
Best for: Instagram Feed, Facebook Stories1080 x 1350 pixelsLarger feed presence without being too tall
Square (1:1)
Best for: Instagram, LinkedIn, X (Twitter)1080 x 1080 pixelsUniversal format that works everywhere
Reframing Modes
Choose the reframing mode that best suits your content:Auto Mode (Recommended)
Fully automatic reframing with AI making all decisions:- Tracks faces and speakers automatically
- Follows on-screen action
- Handles scene changes intelligently
- Best for: Podcasts, interviews, vlogs, talking-head content
Center Mode
Keeps the crop centered on the frame:- Static center position
- No tracking or movement
- Simple and predictable
- Best for: Already-centered content, presentations, static shots
Manual Mode
Full control over crop position:- Keyframe-based positioning
- Custom tracking paths
- Fine-tune specific moments
- Best for: Creative projects, specific composition needs
Text-Priority Mode
Prioritizes keeping on-screen text visible:- Detects and tracks text elements
- Ensures captions and graphics stay in frame
- Secondary priority on faces
- Best for: Tutorial videos, presentations with text overlays
Platform-Specific Optimization
ClypAI’s Smart Reframing understands each platform’s unique requirements:- TikTok
- Instagram Reels
- YouTube Shorts
- X (Twitter)
TikTok Optimization
- 9:16 vertical format (1080x1920)
- Maximum 60-second clips
- High-energy crops with dynamic movement
- Text-safe zones for TikTok UI elements
- Optimized encoding for TikTok’s compression
- Extra headroom for profile picture overlay
- Safe zones for “like” and “comment” buttons
- Caption positioning to avoid UI overlap
Multi-Person Scenarios
Smart Reframing handles complex multi-person videos:Interviews and Conversations
- Two People: Alternates focus between speakers
- Panel Discussions: Intelligently frames active speaker
- Split Screens: Detects and reframes split-screen layouts
Group Content
- Group Shots: Finds optimal framing to include all important faces
- Dynamic Groups: Adjusts as people enter or leave frame
- Priority Speakers: Maintains focus on primary speaker
Speaker Detection: ClypAI uses audio analysis combined with visual tracking to identify who’s speaking and prioritize them in the frame.
Screen Share and Presentation Content
Special handling for screen recordings and presentations:Screen Recording Mode
- Detects screen share content automatically
- Prioritizes text and UI elements
- Maintains cursor visibility
- Zooms in on important areas
Presentation Mode
- Keeps slides fully visible
- Maintains text readability
- Smart cropping of wide slides
- Picture-in-picture option for speaker
Dashboard Controls
Fine-tune reframing directly in your ClypAI dashboard:Preview and Adjust
- Side-by-Side Preview: See original and reframed versions simultaneously
- Frame-by-Frame Review: Step through your video to check reframing
- Tracking Visualization: See what the AI is tracking in real-time
- Quick Adjustments: Adjust crop position with simple controls
Reframing Settings
Customize how Smart Reframing works:- Tracking Sensitivity: How aggressively to follow movement
- Pan Speed: How quickly the crop moves
- Stabilization: Amount of motion smoothing
- Priority Settings: What to prioritize (faces, text, action)
Before and After
See the impact of Smart Reframing:| Without Smart Reframing | With Smart Reframing |
|---|---|
| Static center crop that cuts off speakers | Dynamic tracking keeps speakers in frame |
| Text and graphics lost outside frame | All important text remains visible |
| Awkward composition | Professional, natural framing |
| Same crop for entire video | Intelligent adjustments throughout |
Best Practices
Record with Reframing in Mind
Record with Reframing in Mind
If you know you’ll be reframing for vertical:
- Stay more centered in frame
- Avoid important elements at extreme edges
- Use close-up shots when possible
- Consider recording in 4K for more cropping flexibility
Preview Before Exporting
Preview Before Exporting
Always preview your reframed clips before exporting:
- Check that faces stay in frame
- Verify text readability
- Ensure smooth tracking transitions
- Review any manual adjustments
Use Platform Presets
Use Platform Presets
Take advantage of platform-specific presets:
- Automatically apply best settings for each platform
- Save time with pre-configured options
- Ensure platform compliance
Combine with Auto-Captions
Combine with Auto-Captions
Smart Reframing works perfectly with auto-captions:
- Captions are automatically positioned for vertical format
- Text-safe zones prevent UI overlap
- Captions enhance reframed clips
Advanced Features
Custom Tracking
Manually define what to track in specific scenes:- Identify the subject or element to track
- Draw a bounding box around it
- ClypAI maintains focus on that element
- Override AI decisions for creative control
Keyframe Animation
Create custom crop movements:- Set keyframes at specific timestamps
- Define exact crop positions
- Create custom transitions
- Perfect for artistic or branded content
Batch Reframing
Apply reframing settings to multiple clips:- Configure reframing settings once
- Select multiple clips
- Apply settings to all at once
- Process clips in parallel
Integration with Workflows
Smart Reframing integrates seamlessly with your content workflow:- AI Clipping: Generated clips are automatically reframed
- Auto-Captions: Captions positioned for vertical format
- Brand Kits: Apply brand overlays after reframing
Getting Started
Choose Reframing Mode
Select Auto mode for AI-powered reframing, or choose another mode for specific needs.
Try Smart Reframing
Upload a horizontal video and automatically reframe it for TikTok, Reels, and Shorts.
Coming Soon: Real-time reframing preview during upload, AI learning from your manual adjustments, and cinematic reframing modes with advanced camera movements.