natural-language-youtube-search
AI
image and video search
SHOW HN2021
Legend
natural-language-youtube-search
Search inside YouTube videos using natural language queries
github.comHow HN took it
6 positive, 10 neutral or asking, 0 mixed, 3 critical, out of 19 comments about the project. Thread score +0.03.
Idea: 4 for, 1 againstDesign: 1 for, 0 againstExecution: 0 for, 1 againstPerformance: 1 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Impressive results of CLIP-based frame search
From 3 comments
This is a demonstration of the abilities of OpenAI's CLIP neural network. The tool will download a YouTube video, extract frames at regular intervals and precompute the feature…
vladoh on HNAwesome! I'm currently working on the exact same thing (but with OCR added). Thank you for releasing this.
mockingbirdy on HNThis is amazing. I'm going to get this running on my Dropbox. Curious what it gets out of scanned documents as well.
ramraj07 on HN
Heatmap of query scores per frame adds value
From 1 comment
Looks great! Adds a whole dimension to the video. Thanks.
pininja on HN
Objections
Downloading YouTube videos may violate YouTube's terms of use
From 2 comments
Downloading YouTube videos is a Terms of Use violation, no?
gbennett71 on HNhttps://www.youtube.com/static?template=terms&gl=AU Permissions and Restrictions You may access and use the Service as made available to you, as long as you comply with this…
gbennett71 on HN
Scanning many videos is slow and does not scale
From 1 comment
> The tool will download a YouTube video, extract frames at regular intervals That should be able to scale well :-)
mandeepj on HN
Requests
Search across all of YouTube, not just a provided video
From 1 comment
The problem still exists that you have to provide it the YouTube video to search within, would be nice if there was a tool to search across all of YouTube.
suyash on HN
Support for OCR text search in video
From 2 comments
Awesome! I'm currently working on the exact same thing (but with OCR added). Thank you for releasing this.
mockingbirdy on HN> the exact same thing (but with OCR added) Hmmm... what does "with OCR added" mean? If there is text in the video (e.g. street sign) that it can also be searched??
canada_dry on HN
Smarter frame extraction such as keyframes
From 1 comment
Great demo. Wondering whether it would be more efficient if extracting frames where the content has changed (e.g. over a threshold and/or all I-frames)? Also, could this be used…
canada_dry on HN
Questions
Does it produce an occurrence index or word map
From 1 comment
This is very cool! Does this produce a occurrence index by any chance? It would be neat to explore a word map of a video.
pininja on HN
Can it detect complex events like traffic violations
From 1 comment
Can it work for more advance keywords like say, "traffic violation" where it spots a car jumping red light or pedestrian not using a crosswalk, etc? It could be very useful to…
Crazyontap on HN
Alternatives named
Google search linking to YouTube timestamps
From 1 comment
CLIP is quite a new model published by OpenAI in January. Their work is novel and pushed the state-of-the-art in this area by a lot. I'm sure that Google is also working on…
vladoh on HN