Mobile Package Overview

​

Overview

​

Installation

npm install @navai/voice-mobile react-native-webrtc

​

Quick Start

import { useMobileVoiceAgent } from '@navai/voice-mobile';
import { useNavigation } from '@react-navigation/native';

function VoiceButton() {
  const navigation = useNavigation();
  const { start, stop, isConnected, error } = useMobileVoiceAgent({
    runtime,
    runtimeLoading: false,
    runtimeError: null,
    navigate: (path) => navigation.navigate(path)
  });

  return (
    <Button onPress={isConnected ? stop : start}>
      {isConnected ? 'Stop' : 'Start'} Voice
    </Button>
  );
}

​

Core Features

​

React Native Integration

• WebRTC audio streaming via react-native-webrtc
• Automatic microphone permission handling (Android)
• React Navigation integration
• Mobile-optimized session management

​

Voice Agent Runtime

• Function calling with mobile and backend functions
• Route-based navigation commands
• Automatic tool execution and response handling
• Context-aware instruction generation

​

WebRTC Transport

• OpenAI Realtime API WebRTC connection
• Configurable audio constraints
• Remote audio volume control
• Connection state management

​

Architecture

​

Package Exports

​

Hooks

• useMobileVoiceAgent - Main React hook for voice integration

​

Core APIs

• createNavaiMobileAgentRuntime - Create agent runtime with tools
• createNavaiMobileBackendClient - Backend API client
• createReactNativeWebRtcTransport - WebRTC transport layer
• createNavaiMobileVoiceSession - Voice session manager

​

Utilities

• loadNavaiFunctions - Load and register mobile functions
• resolveNavaiRoute - Resolve route paths from names
• extractNavaiRealtimeToolCalls - Extract tool calls from events
• buildNavaiRealtimeToolResultEvents - Build tool result events

​

Configuration

• resolveNavaiMobileApplicationRuntimeConfig - Resolve app runtime config
• resolveNavaiMobileRuntimeConfig - Resolve runtime configuration
• resolveNavaiMobileEnv - Resolve environment variables

​

Type Exports

​

Platform Support

• iOS 11.0+
• Android API 21+
• React Native 0.60+

​

Dependencies

• react-native-webrtc - WebRTC support (peer dependency)
• react and react-native - React Native framework (peer dependencies)

​

Next Steps