Natural Language Youtube Search Save

Search inside YouTube videos using natural language

Project README

Natural Language YouTube Search

Open In Colab

Use OpenAI's CLIP neural network to search inside YouTube videos. You can try it by running the notebook on Google Colab.

New

How it works

  1. Download the YouTube video
  2. Extract every N-th frame
  3. Encode all frames using CLIP
  4. Encode a natural language search query using CLIP
  5. Find the images that best match the search query

For more details see the notebook.

Examples

Here are some example searches from this YouTube video of a car driving around San Francisco.

"A fire truck"

Search results for "A fire truck" Search results for "A fire truck" Search results for "A fire truck"

"Road works"

Search results for "Road works" Search results for "Road works" Search results for "Road works"

"People crossing the street"

Search results for "People crossing the street" Search results for "People crossing the street" Search results for "People crossing the street"

"The Embarcadero"

Search results for "The Embarcadero" Search results for "The Embarcadero" Search results for "The Embarcadero"

"Waiting at the red light"

Search results for "Waiting at the red light" Search results for "Waiting at the red light" Search results for "Waiting at the red light"

"Green bike lane"

Search results for "Green bike lane" Search results for "Green bike lane" Search results for "Green bike lane"

"A street with tram tracks"

Search results for "A street with tram tracks" Search results for "A street with tram tracks" Search results for "A street with tram tracks"

"The Transamerica Pyramid"

Search results for "The Transamerica Pyramid" Search results for "The Transamerica Pyramid" Search results for "The Transamerica Pyramid"

Natural language search on Unsplah

You can also try my other project to search from 2M photos on Unsplash using natural language queries:

Natural Language Image Search

Open Source Agenda is not affiliated with "Natural Language Youtube Search" Project. README Source: haltakov/natural-language-youtube-search
Stars
836
Open Issues
3
Last Commit
11 months ago
License
MIT

Open Source Agenda Badge

Open Source Agenda Rating