← kwindla hultman kramer

Search is a built-in tool in the Gemini Multimodal Live API

January 17, 2025

Search is a built-in tool in the Gemini Multimodal Live API.

Here's an iOS starter project that shows:

🌐 How to to use the Gemini search built-in tool.
➕ Using built-in search with custom functions.
🔊 iOS + Gemini Multimodal Live speech-to-speech + WebRTC
📲 Opening Google Maps on iOS to show location data from Gemini.
🇧🇷 Where you should eat in Florianópolis, Brazil.

Link to the code and notes on Gemini search in the 🧵

Here's the code:

[1]

The code defines three `tools` for Gemini:
1. get_my_current_location
2. set_restaurant_location
3. search_tool

The first two are custom functions. When Gemini invokes these functions, the function call is handled by the iOS app…

  1. https://github.com/pipecat-ai/pipecat-travel-companion-demo