Jentic OSThe workplace. An in-house AI platform for every employeeJentic OneSafe access. Agents reach your systems without holding keysJentic AIRThe foundation. Gets your existing platforms ready for AI
Pricing

GET STARTED

API DirectoryBrowse 10,000+ APIs ready for AI agent integrationDocumentationGuides and API reference

TOOLS

API ScoringCheck your AI readiness using our scorecardArazzo UIVisualize Arazzo workflows as interactive documentationArazzo EditorBuild and edit multi-step API workflows visually

COMMUNITY

GitHubOpen source projects and examplesOpen StandardsBuilt on open specs. Never locked in.
All ResourcesEverything in one placeBlogLatest articles and insightsTech Talk NewsletterAPIs, AI agents, architecture and strategyWebinarsLive sessions and on-demand recordingsReports & WhitepapersOriginal research on enterprise AI
About UsOur mission and teamCareersJoin our teamContactGet in touch
Try it now
Jentic OSJentic OneJentic AIR
Pricing
API DirectoryDocumentationAPI ScoringArazzo UIArazzo EditorGitHubOpen Standards
All ResourcesBlogTech Talk NewsletterWebinarsReports & Whitepapers
About UsCareersContact
Try it now
JenticJentic
Products
  • Jentic OS
  • Jentic One
  • Jentic AIR
For Developers
  • API Directory
  • Documentation
  • GitHub
Company
  • About Jentic
  • Careers
  • Contact Us
  • Trust Centre
ISO/IEC 27001:2022 certification badge issued by Prescient SecurityISO/IEC 27001:2022 certification badge issued by Prescient Security

Information Security Management System

Certified to ISO/IEC 27001:2022 by Prescient Security

AICPA SOC for Service Organizations logoAICPA SOC for Service Organizations logo

SOC 2® Type 1 report

Audited by Prescient Assurance

Terms & Conditions•Privacy Policy•
© 2026 Jentic Technology Ltd. All rights reserved.
2 Grattan Court East, Dublin, D02 VX86, Ireland
Switch to light modeSwitch to dark mode
APIs / AI/ML / Google / Cloud Video Intelligence API
Cloud Video Intelligence API logo

Google Cloud Video Intelligence API

Browse all Google APIs
45
AI ReadinessFoundational (D)45/100
See full scorecard
Official vendor OpenAPI document · agent-readyAI/MLVisionoauth28 EndpointsREST

For Agents

Annotate videos for labels, shots, text, speech, and explicit content so an agent can build searchable metadata or moderate content without running its own ML.

Use for: I need to annotate a video for label detection, Transcribe the spoken audio in a marketing video stored in Cloud Storage, Detect explicit content in user-uploaded videos before publishing, Find every shot change in a long-form documentary

Not supported: Does not handle video editing, transcoding, or live streaming - use for asynchronous video annotation (labels, shots, text, speech, explicit content) only.

The Cloud Video Intelligence API analyzes video stored in Cloud Storage or supplied inline to detect objects, label content, identify shot changes, recognize on-screen text, transcribe speech, and flag explicit content. Annotation is performed asynchronously via long-running operations, with results returned per shot, per frame, or per segment depending on the requested feature. It powers content moderation, video search, and automated metadata pipelines.

Jentic One on GithubView OpenAPI Document

Install Jentic One Beta

Connect the Cloud Video Intelligence API to your agent

Jentic One is a self-hosted execution layer for AI agents. It lets your agent call the Cloud Video Intelligence API, or any other public or private API you need. You set the rules, the agent never sees your credentials, and every call is logged.

Two steps, two machines. Install the instance in a safe environment, then register your agent from wherever it runs.

1

Step 1: Jentic One Host machine

# On the machine that will host your Jentic One instance:
curl -fsSL "https://jentic.com/install.sh?src=apis&api=%2Fapis%2Fgoogleapis.com%2Fvideointelligence" | sh
2

Step 2: Agent machine

# On the machine where your agent runs (keep this separate from the instance):
curl -fsSL "https://jentic.com/install.sh?src=apis&api=%2Fapis%2Fgoogleapis.com%2Fvideointelligence" | sh
jentic register       # connects your agent to your Jentic One instance

Jentic One is in public beta. The setup above keeps your agent separate from the instance, which is what you want before using real credentials: an agent running as the same OS user as Jentic One can read its stored keys directly. Just evaluating? A single local install is fine to start. See the secure deployment guide for the tiers.

Capabilities

What an agent can do with Cloud Video Intelligence API.

Annotate a video for object tracking, label detection, and shot change detection

Run optical character recognition on text that appears on screen across a video

Transcribe spoken audio in supported languages with timestamps

Flag explicit content frame-by-frame for moderation pipelines

Track long-running annotation operations from submission through completion

Cancel or delete an annotation operation that is no longer needed

Use Cases

Patterns agents use Cloud Video Intelligence API for, with concrete tasks.

★ User-Generated Content Moderation

Platforms hosting user uploads run every video through the Video Intelligence API to flag explicit content, violence-adjacent labels, and profanity in transcribed speech before the asset goes live. The annotate endpoint accepts a Cloud Storage URI and returns a per-frame confidence score for each enabled feature, which the moderation pipeline thresholds before approving or routing to human review. This is dramatically faster than running an in-house vision model.

Annotate a Cloud Storage video for EXPLICIT_CONTENT_DETECTION and reject uploads with any frame above 0.8 confidence

Video Search and Metadata Indexing

Media libraries enrich every uploaded video with label, shot, and OCR annotations so editors can search across footage by subject, scene, or on-screen text. The API returns timestamped annotations that the indexer maps into a search engine document, turning raw video into queryable metadata. Annotation is asynchronous and free of model maintenance overhead.

Submit a videos:annotate request with LABEL_DETECTION, SHOT_CHANGE_DETECTION, and TEXT_DETECTION on a Cloud Storage URI

Automated Captioning and Transcripts

Publishers generate first-pass captions and searchable transcripts by enabling SPEECH_TRANSCRIPTION on the annotate request. The API returns word-level timing that the captioning pipeline converts into WebVTT or SRT files for upload to a video player. This dramatically reduces editor time on large back-catalogs.

Annotate a video with SPEECH_TRANSCRIPTION and convert the response into a WebVTT caption file

AI Agent Video Understanding

An AI agent integrated through Jentic answers prompts like 'summarize this clip' by submitting a Video Intelligence annotation, polling the long-running operation, and assembling the labels, shots, and transcripts into a structured summary. Because the API uses OAuth 2.0 with the cloud-platform scope, Jentic isolates the token in your Jentic One instance and exposes only a scoped reference to the agent.

Search Jentic for annotate a video, submit annotation, and poll until the operation completes

Key Endpoints

8 endpoints — the cloud video intelligence api analyzes video stored in cloud storage or supplied inline to detect objects, label content, identify shot changes, recognize on-screen text, transcribe speech, and flag explicit content.

METHOD

PATH

DESCRIPTION

POST

/v1/videos:annotate

Submit an annotation request for one or more features

GET

/v1/{+name}/operations

List annotation operations

POST

/v1/operations/{+name}:cancel

Cancel a running annotation operation

DELETE

/v1/operations/{+name}

Delete a completed operation

POST

/v1/videos:annotate

Submit an annotation request for one or more features

GET

/v1/{+name}/operations

List annotation operations

POST

/v1/operations/{+name}:cancel

Cancel a running annotation operation

DELETE

/v1/operations/{+name}

Delete a completed operation

Jentic AI Readiness Score

This API is usable in Jentic One now. Its AI-readiness score against Jentic's framework shows where it stands today and where improvements would make it even easier for agents to use.

C

Cloud Video Intelligence API

- Foundational (D)
45/100
50
Foundational Compliance
56
Developer Experience & Jentic Compatibility
24
AI-Readiness & Agent Experience
94
Agent Usability
63
Security
63
AI Discoverability
Powered by JenticScoring Framework 1.0.0 | Scoring Engine 0.4.0
Show dimension breakdown
50

Foundational Compliance

Base layer of spec validity and structural soundness.

Grade: C-Signals: 4
66%

Lint Results

Aggregated quality score from linter diagnostics, weighted by severity.

100%

Resolution Completeness

Percentage of `$ref` references that resolve successfully.

0%

Specification Validity

Checks whether the API description parses successfully and conforms to its declared specification (e.g., OpenAPI).

35%

Structural Integrity

Structural correctness score based on schema issues using logarithmic dampening.

56

Developer Experience & Jentic Compatibility

Clarity, completeness, and ingestion readiness for developers and tooling.

Grade: CSignals: 4
0%

Example Density

How richly the API is illustrated with examples.

100%

Example Validity

Percentage of examples that conform to their schemas.

25%

Response Coverage

Percentage of operations with complete response definitions (success, client error, server error).

100%

Tooling Readiness

Health of API ingestion, bundling, and resolution within Jentic pipelines.

24

AI-Readiness & Agent Experience

Semantic breadth, depth, and agent comprehension for AI systems.

Grade: FSignals: 4
95%

Description Coverage

Coverage of descriptions across API elements.

0%

Error Standardization

Coverage of RFC 9457 Problem Details for error responses.

0%

OperationId Quality

Coverage, uniqueness, and casing consistency of operationIds for AI inference.

0%

Summary Coverage

Coverage of summaries across operations/tags/info.

94

Agent Usability

Functional utility, complexity comfort, and AI orchestration readiness.

Grade: A+Signals: 1
94%

Complexity Comfort

Agent comfort level based on API operational and structural complexity.

63

Security

Trust, risk posture, and security compliance.

Grade: B-Signals: 1
62%

Authentication Strength

Average quality of security schemes based on authentication method strength (weakest link for OAuth2).

63

AI Discoverability

Findability, semantic richness, and reasoning readiness.

Grade: B-Signals: 1
62%

Descriptive Richness

Clarity and depth of descriptions across API elements.

View full reportHow the score is calculatedMore about the dimensions

Score it yourself

Every API in the directory is allowlisted, so you can re-score it with no key required.

Score your own APIScoring CLI agent skill
npx @jentic/api-scorecard-cli score <openapi-url>

Why Jentic?

What agents get from Jentic-routed access to this vendor.

Setup

Wiring the Cloud Video Intelligence API by hand means setting up a Google service account, granting the cloud-platform scope, submitting the annotate request, and polling the long-running operation to completion yourself. Through Jentic you install once, import the Cloud Video Intelligence API from the API Directory, store the service-account credential once, and your agent calls it.

Permission scoping

The video input and requested features travel in the request body, so scope by operation: limit the agent to the operations it needs, such as videos:annotate and reading operation status. You choose the operations it may call, so cancelling or deleting an operation is not included unless you add it.

Credential isolation

Your Video Intelligence service-account credential is stored once, encrypted, by your own Jentic One instance and injected at execution time. It never enters the agent's prompt, logs, or context.

Intent-based discovery

Agents search Jentic by intent such as 'transcribe a video' or 'detect explicit content', and Jentic returns the videos:annotate operation with its input schema so the agent calls the right endpoint without browsing the reference docs.

Related APIs

Alternatives and complements available in the Jentic catalogue.

Alternative

Cloud Vision API

→

Image-level annotation; Video Intelligence is the per-frame, per-shot equivalent for video

Choose Vision when the input is a still image; choose Video Intelligence when the input is a video file or stream.

Alternative

Cloud Speech-to-Text API

→

Audio-only transcription without the rest of the video annotation feature set

Choose Speech-to-Text when only transcription is needed; choose Video Intelligence when transcription must be aligned with shots, labels, or explicit content detection.

Complementary

Cloud Translation API

→

Translate transcripts produced by Video Intelligence into other languages

Choose Translation when an agent needs to localize the transcript that Video Intelligence returns.

Complementary

Cloud Storage API

→

Stage video files in a bucket so Video Intelligence can read them by URI

Choose Cloud Storage to upload and manage the source videos; Video Intelligence reads them via gs:// URIs.

FAQs

Specific to using Cloud Video Intelligence API through Jentic.

What authentication does the Cloud Video Intelligence API use?

The Cloud Video Intelligence API uses OAuth 2.0 with the https://www.googleapis.com/auth/cloud-platform scope. Through Jentic, the OAuth token is stored encrypted in your Jentic One instance and only a scoped reference is exposed to the agent at execution time.

Can I detect explicit content in videos with the Video Intelligence API?

Yes. Submit a POST /v1/videos:annotate with features set to EXPLICIT_CONTENT_DETECTION. The response (delivered via the long-running operation) contains per-frame likelihood values from VERY_UNLIKELY to VERY_LIKELY that a moderation pipeline can threshold.

What are the rate limits for the Cloud Video Intelligence API?

Default project quotas allow 5 concurrent annotation operations and 1,000 annotation requests per day, with file-size and length caps documented per feature. Higher quotas can be requested in the Google Cloud Console for production workloads.

How do I annotate a video through Jentic with the Video Intelligence API?

Install Jentic with pip install jentic, search for annotate a video, load the schema for POST /v1/videos:annotate, then call it with the Cloud Storage URI and the features array. Poll the returned operation name until done is true to retrieve the annotations.

Does the Video Intelligence API support inline video bytes or only Cloud Storage URIs?

Both. The annotate request accepts inputUri for a Cloud Storage object or inputContent for base64-encoded video bytes up to a per-feature size limit. Cloud Storage is recommended for files over a few megabytes to avoid request timeouts.

Why is my annotation operation taking so long to complete?

Annotation runtime scales with video length and the number of enabled features. SPEECH_TRANSCRIPTION and OBJECT_TRACKING are the slowest; expect minutes for a 10-minute clip with multiple features enabled. Use GET /v1/{+name}/operations to monitor progress and cancel runs that exceed your budget.

Can I limit what my agent is allowed to do with the Cloud Video Intelligence API?

Yes. Because you self-host Jentic One, your own rules decide which Video Intelligence operations and credentials the agent may use. Since the video input and requested features travel in the request body, you scope by operation: you can limit the agent to just the calls it needs, such as submitting videos:annotate and reading operation status, and leave out cancelling or deleting operations unless you explicitly add them. The service-account credential stays in your instance and is injected only when a permitted operation runs.

GET STARTED

Start building with Cloud Video Intelligence API

Explore with Jentic One
View OpenAPI Document