GEMINI LABJP
ROBOTICS — The ER 1.6 preview that shut down on August 31 does have a successor. Gemini Robotics ER 2 is in public preview, in both standard and streaming variantsVIDEO — ER 2 judges success and failure from live video rather than still snapshots, which is what lets it catch spills, slips, and misalignments while a task is still runningDEADLINE — Next up is September 30, when gemini-omni-flash-preview is retired. The target is gemini-omni-1.1-flash, GA since August 27, and there are now under four weeks leftAPIKEY — Every remaining standard API key, restricted ones included, stops working during September. The replacement is an auth key bound to a Google Cloud service accountPRICE — Gemini 3.7 Flash keeps its introductory $0.75/$3.75 per 1M through December 31, then moves to $1.50/$7.50 on January 1, 2027. Any estimate crossing the year needs both figuresAUDIO — Gemini 3.5 Transcribe handles language detection across 85+ languages, speaker diarization, word-level timestamps, and custom vocabulary biasing of up to 1,000 termsROBOTICS — The ER 1.6 preview that shut down on August 31 does have a successor. Gemini Robotics ER 2 is in public preview, in both standard and streaming variantsVIDEO — ER 2 judges success and failure from live video rather than still snapshots, which is what lets it catch spills, slips, and misalignments while a task is still runningDEADLINE — Next up is September 30, when gemini-omni-flash-preview is retired. The target is gemini-omni-1.1-flash, GA since August 27, and there are now under four weeks leftAPIKEY — Every remaining standard API key, restricted ones included, stops working during September. The replacement is an auth key bound to a Google Cloud service accountPRICE — Gemini 3.7 Flash keeps its introductory $0.75/$3.75 per 1M through December 31, then moves to $1.50/$7.50 on January 1, 2027. Any estimate crossing the year needs both figuresAUDIO — Gemini 3.5 Transcribe handles language detection across 85+ languages, speaker diarization, word-level timestamps, and custom vocabulary biasing of up to 1,000 terms
Articles/API / SDK
API / SDK/2026-03-19Advanced

Google Personal Intelligence × Gemini API — Build Personalized AI Experiences

Personal Intelligence enables Gemini to access Gmail, Google Photos, Calendar data for personalized responses. Implement Grounding with Google Services for custom apps.

Personal IntelligenceGemini API230PersonalizationGrounding4Google Workspace17

Google Personal Intelligence × Gemini API

March 2026 brought Personal Intelligence nationwide rollout. Gemini connects to Gmail, Google Photos, Calendar for personalized answers.

How Personal Intelligence Works

Personal Intelligence provides user account data (Gmail, Google Photos, Calendar, etc.) as Gemini context. User asks "Show me business trip photos," Gemini auto-retrieves from Photos + matches Calendar travel dates + returns relevant memories.

Core technology: Grounding with Google Services — Gemini accesses Google services real-time for personalized information.

Privacy-First Design

Personal Intelligence uses opt-in model. Disabled by default; users explicitly enable. Gemini never uses accessed data for model training.

Developers must request minimum-needed OAuth scopes and secure user consent.

Gemini API Grounding Implementation

Grounding with Google Search

import google.generativeai as genai
 
genai.configure(api_key="YOUR_API_KEY")
 
model = genai.GenerativeModel(
    "gemini-3.1-pro",
    tools=[genai.Tool(google_search=genai.GoogleSearch())]
)
 
response = model.generate_content(
    "Current Tokyo weather and recommended outfit?"
)
 
# Access grounding metadata
for candidate in response.candidates:
    if candidate.grounding_metadata:
        for chunk in candidate.grounding_metadata.grounding_chunks:
            print(f"Source: {chunk.web.uri}")

Real-time Grounding with Google Search adds latest web information to Gemini responses, with source attribution.

Grounding with Google Maps

model = genai.GenerativeModel(
    "gemini-3.1-pro",
    tools=[genai.Tool(google_maps=genai.GoogleMaps())]
)
 
response = model.generate_content(
    "Suggest 3 vegetarian-friendly lunch spots near Shibuya Station"
)

Maps Grounding provides real store info, reviews, and addresses for location-based queries.

Workspace Integration Automation

Interactions API for Workspace Automation

from google.cloud import aiplatform
from google.cloud.aiplatform import interactions
 
# Define agent
agent = interactions.Agent(
    model="gemini-3.1-pro",
    tools=[
        interactions.WorkspaceTool(
            scopes=["drive.readonly", "docs.readonly", "sheets"]
        )
    ],
    system_instruction="""
    You are Workspace assistant.
    Search Drive files, read Docs/Sheets,
    create new documents as requested.
    """
)
 
# Start session
session = agent.start_session(user_id="user-123")
 
# Execute Workspace task
response = session.send_message(
    "Find last month's monthly report in Drive. "
    "Extract sales data into a spreadsheet."
)

Interactions API enables Gemini to autonomously search Drive, read Docs, modify Sheets on user's behalf.

Google AI Pro/Ultra Workspace Features

These Workspace capabilities available via:

  • Google AI Pro ($19.99/month)
  • Google AI Ultra (premium tier)

Pro includes Gemini Advanced + full Workspace AI assistance. Ultra adds Deep Think, Project Mariner, advanced features.

Pixel Actions—Mobile AI Integration

2026 Pixel Drop introduced "Pixel Actions" enabling app control via Gemini. Example: "Book restaurant reservation"→ Gemini operates reservation app.

Developers integrate via App Actions API, declaring intents apps handle.

Personalized AI App Design Principles

Minimal Privilege Principle: Request only essential data access. Unnecessary scopes damage user trust.

Transparency: Show users exactly what data AI uses. Grounding metadata includes source information—always display it.

Staged Permission Expansion: Don't request all scopes upfront. Expand permissions as features get used.

Local Processing: Process personal data on-device when possible. Gemini Nano on-device model is complementary approach.

Example: Personal Email Assistant

def build_email_context(user_id):
    """Build Gemini system prompt from Gmail data"""
 
    # Fetch unread emails
    service = gmail_service()
    results = service.users().messages().list(
        userId='me',
        q='is:unread',
        maxResults=10
    ).execute()
 
    messages = results.get('messages', [])
    email_summary = "Recent unread emails:\n"
 
    for msg in messages:
        subject = get_email_subject(msg)
        sender = get_email_sender(msg)
        email_summary += f"- From {sender}: {subject}\n"
 
    return f"""
    You are helpful email assistant.
 
    User's recent emails:
    {email_summary}
 
    Help with:
    - Suggesting responses
    - Prioritizing emails
    - Finding information in past emails
    - Auto-organizing messages
    """
 
# Usage
context = build_email_context("user-123")
response = genai.GenerativeModel(
    "gemini-3.1-pro",
    system_instruction=context
).generate_content(
    "What's the key action item from recent emails?"
)

Building Personalized Applications

Principles enabling Gemini-powered personalization:

  1. OAuth 2.0 Secure: Implement proper OAuth flows; never store credentials
  2. Minimum Scopes: Request only necessary Google API permissions
  3. User Agency: Allow easy permission revocation; respect user choices
  4. Transparent Grounding: Always disclose data sources to users
  5. Graceful Degradation: Function without personal data when access unavailable

Wrapping up

Google Personal Intelligence + Gemini API enables building truly personalized AI applications accessing user Gmail, Photos, Calendar, Drive. Proper implementation respects privacy while delivering value.

Applications properly designed become indispensable assistants understanding personal context.

Share

Thank You for Reading

Gemini Lab is ad-free, supported entirely by members like you. We publish practical guides daily with implementation code, benchmarks, and production-ready patterns. If you've found it useful, we'd love to have you on board.

  • Copy-paste ready implementation code
  • New advanced guides published daily
  • $5/mo or $15 for lifetime access
View Membership →

If you found this article helpful, a small tip ($1.50) would mean a lot to us. Your support helps keep this site ad-free and covers server and hosting costs.

Related Articles

API / SDK2026-06-20
Gemini API Grounding × Structured Output Guide — Turn Web Search Results into Typed JSON Data
Combine Gemini API Grounding with Google Search and Structured Output to extract real-time web information as type-safe JSON data. Practical implementation patterns included.
API / SDK2026-05-18
Why Your Apps Script Stops Mid-Batch When Calling the Gemini API — UrlFetchApp Timeouts and the 6-Minute Execution Limit
When Apps Script calls the Gemini API, two limits collide: UrlFetchApp's response timeout and the 6-minute script runtime cap. Here is how to tell them apart and how I work around them with chunking, checkpoints, and time-based triggers.
API / SDK2026-09-01
Your New Gemini API Key Never Took Effect, and Load Order Wasn't the Reason
When several sources supply the same environment variable, swapping your key can leave the old value in place. Here is what four load orders actually produced, and a ledger that records which source won.
📚RECOMMENDED BOOKS
Build a Large Language Model (From Scratch)
Sebastian Raschka
LLM Dev
Prompt Engineering for LLMs
Berryman & Ziegler
Prompting
AI Engineering
Chip Huyen
AI Eng
* Contains affiliate links
See all →