TidalWaves API
Data
news metadata api
SHOW HN2020
124points
45comments
#511of 3,028 in 2020
Top 17%of 2020 by points
How HN took it
CuriousMostly questions and neutral comments
3 positive, 17 neutral or asking, 1 mixed, 4 critical, out of 25 comments about the project. Thread score -0.06.
Execution: 0 for, 3 againstIdea: 2 for, 0 against
The thread, comment by comment
Each row is a top-level comment and its replies, in HN's order. Select a cell to open that comment on HN.
positive neutral or mixed critical about another commenter or something else the maker
What HN said
What people liked
Map visualization looks good
From 1 comment
Nice project. I actually did pretty much the same a long time ago: an API around GDELT data. Your map looks fantastic, btw. The problem with GDELT is that they don't have that…
artembugara on HN
Useful for various projects
From 1 comment
Hey there, first off cool stuff I can see this being plenty useful for various projects. We're exploring GDELT data for our own needs and I was wondering if you wouldn't mind…
Grimm1 on HN
Objections
GDELT data is messy with duplicates and inconsistent tagging
From 2 comments
As someone who has built event pipelines from GDELT data, I'd advise folks to not start (a GDELT project) with high expectations. Not only are there plenty of duplicates, but…
arusahni on HNThanks! There are a lot of issues with GDELT data, but the things that come to mind recently are: - Missing keywords. Huge topics like "brexit" won't be found, so you need to…
prohobo on HN
Duplicate breaking stories shown in the list
From 1 comment
There are duplicates on the list of 4 breaking stories. They have the exact same title, too.
awestroke on HN
Rapid API hosts many low-quality APIs
From 1 comment
I've never heard of RapidAPI before, but it seems kind of scammy. As in, nice idea, bit just filled with low-quality spam APIs wrapping presumably free or cheaper services, not…
OJFord on HN
Requests
Publish the full list of news sources
From 2 comments
What are the 1000+ news sources? Is there a list of publications? e.g. New York Times, The Australian, Bangkok Post... ? I understand your data comes from GDELT. I'm new to that…
wombatmobile on HNThanks for replying. I'm not sure what is useful yet - first of all I am trying to understand the scope of the data sources and the methodology for selections displayed in…
wombatmobile on HN
Add JSON-LD/RDF output for WikiData integration
From 1 comment
Have you considered using JSON-LD/RDF for this? It would make it easier to integrate with WikiData and data from other sources.
abraxaz on HN
Fuzzy title matching to merge duplicate stories
From 1 comment
I'm definitely thinking of ways to improve it for long-term stories. You're right, fuzzy string matching would do wonders for that, thanks :)
prohobo on HN
Questions
What news sources are included?
From 1 comment
What are the 1000+ news sources? Is there a list of publications? e.g. New York Times, The Australian, Bangkok Post... ? I understand your data comes from GDELT. I'm new to that…
wombatmobile on HN
How is trending popularity calculated?
From 1 comment
Thanks for replying. I'm not sure what is useful yet - first of all I am trying to understand the scope of the data sources and the methodology for selections displayed in…
wombatmobile on HN
What does the tone field mean?
From 1 comment
In the json data sample the site shows, what does 'tone' field means?
vadiml on HN
Alternatives named
GDELT
From 2 comments
As someone who has built event pipelines from GDELT data, I'd advise folks to not start (a GDELT project) with high expectations. Not only are there plenty of duplicates, but…
arusahni on HNHey there, first off cool stuff I can see this being plenty useful for various projects. We're exploring GDELT data for our own needs and I was wondering if you wouldn't mind…
Grimm1 on HN
ICEWS
From 1 comment
For some uses (if accuracy is more important than speed), ICEWS is available as periodic dumps on Dataverse. They use CAMEO for event encoding which - if imperfect - at least is…
nl on HN
NewsCatcher API
From 1 comment
Nice project. I actually did pretty much the same a long time ago: an API around GDELT data. Your map looks fantastic, btw. The problem with GDELT is that they don't have that…
artembugara on HN