‹ BackHN Continuity

Thread

The Philadelphia Inquirer built Scrape, an AI tool to surface hyperlocal news

25 points · 10 comments · giuliomagnifico

  1. mmooss · · focus · HN ↗
    > Early on, the team tried to balance quality with the high cost of searching many small, scattered sources. They discovered that prompting can implicitly control search depth and behavior, but only after trial and error.

    I don't understand the cost here. The number of sources should be relatively tiny - it's not a general Internet search. The amount of data scraped would seem to be relatively tiny - how much data is there on suburban-county, PA?

    1. [deleted] · · focus · HN ↗

      [deleted]

    2. tclancy · · focus · HN ↗
      I think it’s more about how many different types of content you’re looking at. Public google calendars, Facebook event pages, personal sites, etc.
    3. mrweasel · · focus · HN ↗
      For the individual county it's probably not a ton of data, but multiply it up, it's a lot for all the counties in e.g. Philadelphia.

      Normally there is data, meetings, events and so that you wouldn't report on in a newspaper, because it's really only relevant to maybe a few thousand people, but for those thousands it might be really important.

      My city publishes a lot of stuff on their website, it's hard to find, relevant to maybe a thousand people, maybe less. The school board meetings, public utility companies, companies in general all publish massive amounts of information that's never surfaced, but is relevant to those living in the vicinity. Being able to collect all of this, sort it, assess it's relevans and produce hyper local news could be a massive boost for local grassroots movements and participation in local affairs and elections.

      1. thephyber · · focus · HN ↗
        Agree that the permutation becomes a problem, but the organization should be super simple: the state mandates the use of some standard index file format for all municipalities governments, not unlike how sitemap.xml works for a website index.

        There is a community-run project that standardizes each election's results across states, counties, and precincts. It could be a template for local info releases.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.